Model profile
Mistral Large 3
Evidence summary
Mistral Large 3 has an estimated overall rank of #287; its 90% source-sensitivity interval is #170–#298. Its behavior-only rank is #279; company governance moves the combined estimate to #287. Published evidence spans 14 evals and 6 of 7 behavior components. Its strongest relative result is HUMAINE Trust, Ethics and Safety (trust_ethics_safety_score, #3 of 54); its weakest is Alignment Leaderboard (safety, #24 of 24).
Compare this model
Only models sharing at least one published sub-eval are listed.
Official and reference links
- Artificial Analysis ↗mistral-large-3
- Hugging Face ↗mistralai/Mistral-Large-3-675B-Instruct-2512
- Official model page ↗Exact model document · Reviewed official Hugging Face owner · official repository
- Release source ↗direct research preview identity date
Published eval results
Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.
| Eval / sub-eval | Rank | Value | Distribution | Source |
|---|---|---|---|---|
| AA-Omnisciencehallucination_rate | #207 / 328 | ↓0.8596 | Source ↗official | |
| Alignment Leaderboardcorrigibility | #24 / 24 | ↑3.845 | Source ↗official | |
| Alignment Leaderboardhonesty | #23 / 24 | ↑3.083 | Source ↗official | |
| Alignment Leaderboardnon_manipulation | #24 / 24 | ↑2.402 | Source ↗official | |
| Alignment Leaderboardrobustness | #24 / 24 | ↑2.28 | Source ↗official | |
| Alignment Leaderboardsafety | #24 / 24 | ↑2.865 | Source ↗official | |
| Alignment Leaderboardscheming | #24 / 24 | ↑3.211 | Source ↗official | |
| Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating | #80 / 112 | ↑1422.0 | Source ↗official | |
| AuAu Authoritarian Response Auditbehavioral_vignette_arr_percent | #14 / 17 | ↓28 | Source ↗official | |
| AuAu Authoritarian Response Auditrealistic_prompt_arr_percent | #12 / 17 | ↓2.7 | Source ↗official | |
| BullshitBench v2clear_pushback_rate | #105 / 106 | ↑0.02 | Source ↗official | |
| Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate | #101 / 104 | ↓80.16 | Source ↗official | |
| DystopiaBenchbasaglia_score | #41 / 50 | ↓69.8 | Source ↗official | |
| DystopiaBenchbaudrillard_score | #47 / 50 | ↓77.73 | Source ↗official | |
| DystopiaBenchhuxley_score | #38 / 50 | ↓75.8 | Source ↗official | |
| DystopiaBenchlaguardia_score | #36 / 50 | ↓69 | Source ↗official | |
| DystopiaBenchorwell_score | #29 / 50 | ↓70.93 | Source ↗official | |
| DystopiaBenchpetrov_score | #41 / 50 | ↓78.47 | Source ↗official | |
| HUMAINE Trust, Ethics and Safetytrust_ethics_safety_score | #3 / 54 | ↑29.36 | Source ↗official | |
| LiveSecBenchethics | #34 / 43 | ↑24.59 | Source ↗official | |
| LiveSecBenchfactuality | #24 / 43 | ↑43.2 | Source ↗official | |
| LiveSecBenchlegality | #33 / 43 | ↑20.79 | Source ↗official | |
| LiveSecBenchprivacy | #41 / 43 | ↑10.14 | Source ↗official | |
| LiveSecBenchpsychological_health | #28 / 43 | ↑43.44 | Source ↗official | |
| PHAREbias_resistance_diagnostic | #10 / 66 | ↑0.6272 | Source ↗official | |
| PHAREhallucination_resistance_diagnostic | #51 / 70 | ↑0.6803 | Source ↗official | |
| PHAREharm_resistance_diagnostic | #54 / 70 | ↑0.8806 | Source ↗official | |
| PHAREjailbreak_resistance_diagnostic | #67 / 67 | ↑0.249 | Source ↗official | |
| RealityTest — Text AI-Identity Disclosuredisclosure_probability | #17 / 17 | ↑0.078 | Source ↗official | |
| RefusalBenchyouden_j | #18 / 19 | ↑0.004237 | Source ↗official | |
| StereoTales Harmful Associationsbenign_significant_association_score | #10 / 23 | ↑86.47 | Source ↗official | |
| Vectara HHEM Factual Consistencyfactual_consistency_rate | #83 / 94 | ↑85.5 | Source ↗official |
Values evaluations
Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.
UGI Political Values
Taiwan Sovereignty Benchmark Pro
| Dimension | Value | Distribution |
|---|---|---|
| Pro-Taiwan rubric compatibility | 45 | |
| Warning-phrase rate | 30 | |
| Soft-censorship rate | 5 | |
| API-error rate | 0 |