Developer
Ai2
27 indexed models; 8 currently meet the evidence threshold for the overall ranking. Together they have results from 14 evaluations.
Models by Ai2
| Model | Evals | Components | Rank | Release date |
|---|---|---|---|---|
| Llama 3.1 Tulu 3 8B | 3 | 5/7 | 40 | 2024-11-20 |
| Olmo 3 7B Instruct | 3 | 3/7 | 97 | 2025-11-19 |
| Olmo 3.1 32B Instruct | 3 | 2/7 | 119 | 2025-12-10 |
| Olmo 2 0325 32B Instruct | 8 | 6/7 | 222 | 2025-03-13 |
| Olmo 3.1 32B Think | 3 | 2/7 | 249 | 2025-12-10 |
| Olmo 2 1124 13B Instruct | 6 | 5/7 | 270 | 2024-11-26 |
| Olmo 2 1124 7B Instruct | 6 | 5/7 | 295 | 2024-11-26 |
| Olmoe 1B 7B 0125 Instruct | 5 | 3/7 | 301 | 2025-01-27 |
| Llama 3.1 Tulu 3 70B | 1 | 1/7 | — | — |
| Llama 3.1 Tulu 3 70B Dpo | 1 | 2/7 | — | 2024-11-20 |
| Llama 3.1 Tulu 3 70B Ppo Rlvf | 1 | 2/7 | — | 2024-11-20 |
| Llama 3.1 Tulu 3 70B Sft | 1 | 2/7 | — | 2024-11-18 |
| Llama 3.1 Tulu 3 8B Dpo | 2 | 5/7 | — | 2024-11-20 |
| Llama 3.1 Tulu 3 8B Ppo Rlvf | 1 | 2/7 | — | 2024-11-20 |
| Llama 3.1 Tulu 3 8B Sft | 2 | 5/7 | — | 2024-11-18 |
| Molmo2 8B | 1 | 1/7 | — | 2025-12-14 |
| Olmo 3 32B Think | 2 | 1/7 | — | 2025-11-19 |
| Olmo 3 7B | 2 | 2/7 | — | — |
| Olmo 3 7B Think | 1 | 1/7 | — | 2025-11-18 |
| Olmo 7B 0724 Instruct | 2 | 5/7 | — | 2024-07-09 |
| Olmo 7B Instruct Hf | 1 | 3/7 | — | — |
| Olmoe 1B 7B 0924 Instruct | 1 | 3/7 | — | — |
| Tulu 2 13B | 1 | 2/7 | — | — |
| Tulu 2 7B | 1 | 2/7 | — | — |
| Tulu 2 Dpo 13B | 1 | 4/7 | — | 2023-11-13 |
| Tulu 2 Dpo 70B | 1 | 4/7 | — | 2023-11-12 |
| Tulu 2 Dpo 7B | 1 | 4/7 | — | 2023-11-13 |
Evaluations covering Ai2 models (14)
AA-Omniscience · AbstentionBench · AgentDrive Safety Compliance · AILuminate General Purpose AI Chat · Arena Factuality — Text Arena (factuality-only weighting) · AuAu Authoritarian Response Audit · DecodingTrust · Enkrypt AI Safety Leaderboard · HELM Safety · HUMAINE Trust, Ethics and Safety · IndoBias-Pairs — parity-aware culturally grounded bias · PandaBench JBB direct-request panel · SALAD-Bench · UAVBench safety-critical decision recognition