📚 3LM: A Benchmark for Arabic LLMs in STEM and Code

Hugging Face announces the release of 3LM, a benchmark for evaluating Arabic large language models on STEM and code generation, consisting of three datasets: Native STEM, Synthetic STEM, and translated code benchmarks (HumanEval-ar, MBPP-ar).

The post reports evaluation results for over 40 models.