Meet new Sonar (Perplexity blog) 11 Feb 2025
- Factuality 85.1
- Readability 85.9
- IFEval 86.8
- MMLU (0-shot) 87.1
sonar
sonar.
Perplexity Released 21 Jan 2025 6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Perplexity Jan 2025 sonar
Closed weights
No Epoch Capabilities Index score yet
- IFEval 86.8% #58 /126
- MMLU 87.1% #39 /127
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 87.1% | #39 of 127 | Model card | |
| IFEval | 86.8% | #58 of 126 | Model card | |
| Wer wird Millionär? LLM Benchmark | 3956.0 | #38 of 76 | Official leaderboard | |
| Answer Factuality (Perplexity) | 85.1% | #1 of 1 | Model card | |
| Readability (Perplexity) | 85.9% | #1 of 1 | Model card |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveBench | 46.9% | #29 of 48 | Epoch AI |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.