- OALL v2 Average 68
- ArabicMMLU 68.2
- AraTrust 82.5
Falcon-Arabic-7B
Falcon-Arabic-7B.
14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Technology Innovation Institute May 2025 Falcon-Arabic-7B
Open weights Small
No Epoch Capabilities Index score yet
- IFEval 57.6% #123 /126
- MMLU 63.3% #110 /127
- GSM8K 67.7% #71 /87
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ARC-Challenge | 53.5% | #38 of 45 | Model card | |
| MMLU | 63.3% | #110 of 127 | Model card | |
| WinoGrande | 68.4% | #37 of 42 | Model card | |
| HellaSwag | 71.4% | #42 of 47 | Model card | |
| IFEval | 57.6% | #123 of 126 | Model card | |
| TruthfulQA | 31.5% | #28 of 28 | Model card | |
| AlGhafa | 72.4% | #1 of 1 | Model card | |
| ALRAGE | 72.3% | #1 of 1 | Model card | |
| ArabCulture | 65.2% | #1 of 1 | Model card | |
| ArabicMMLU | 68.3% | #1 of 1 | Model card | |
| MadinahQA | 73.6% | #1 of 1 | Model card | |
| Open Arabic LLM Leaderboard v2 | 68.3% | #1 of 1 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 67.7% | #71 of 87 | Model card |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| AraTrust | 82.6% | #1 of 1 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it. 12 of them aren't in the launch post.
Capabilities
- Open Arabic LLM Leaderboard v2 68.3
- AlGhafa 72.4
- ArabicMMLU 68.3
- MadinahQA 73.6
- ALRAGE 72.3
- ArabCulture 65.2
- AraDiCE
- IFEval 57.6
- GSM8K 67.7
- HellaSwag 71.4
- ARC-Challenge 53.5
- WinoGrande 68.4
- MMLU 63.3
Hallucination
- TruthfulQA 31.5
Safety
- AraTrust 82.6