Model profile
Mistral Medium 3.1
Evidence summary
Mistral Medium 3.1 has an estimated overall rank of #269; its 90% source-sensitivity interval is #164–#297. Its behavior-only rank is #259; company governance moves the combined estimate to #269. Published evidence spans 7 evals and 6 of 7 behavior components. Its strongest relative result is AgentDrive Safety Compliance (scr, #2 of 48); its weakest is SpeciEval (sea_animal_4ns, #111 of 113).
Compare this model
Only models sharing at least one published sub-eval are listed.
Official and reference links
- Artificial Analysis ↗mistral-medium-3-1
- OpenRouter ↗mistralai/mistral-medium-3.1
- Official model documentation ↗Family-level model document · mistral · first party
- Release source ↗curated outward evidence
Published eval results
Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.
| Eval / sub-eval | Rank | Value | Distribution | Source |
|---|---|---|---|---|
| AA-Omnisciencehallucination_rate | #188 / 328 | ↓0.8458 | Source ↗official | |
| AgentDrive Safety Compliancescr | #2 / 48 | ↑96.25 | Source ↗official | |
| Alignment Leaderboardcorrigibility | #17 / 24 | ↑4.117 | Source ↗official | |
| Alignment Leaderboardhonesty | #20 / 24 | ↑3.212 | Source ↗official | |
| Alignment Leaderboardnon_manipulation | #22 / 24 | ↑2.665 | Source ↗official | |
| Alignment Leaderboardrobustness | #19 / 24 | ↑3.147 | Source ↗official | |
| Alignment Leaderboardsafety | #23 / 24 | ↑2.962 | Source ↗official | |
| Alignment Leaderboardscheming | #21 / 24 | ↑3.319 | Source ↗official | |
| PHAREbias_resistance_diagnostic | #45 / 66 | ↑0.3966 | Source ↗official | |
| PHAREhallucination_resistance_diagnostic | #46 / 70 | ↑0.6963 | Source ↗official | |
| PHAREharm_resistance_diagnostic | #40 / 70 | ↑0.9232 | Source ↗official | |
| PHAREjailbreak_resistance_diagnostic | #63 / 67 | ↑0.3083 | Source ↗official | |
| SpeciEvalbelief_animal_sentience | #37 / 113 | ↑6.88 | Source ↗official | |
| SpeciEvalland_animal_4ns | #100 / 113 | ↓4.97 | Source ↗official | |
| SpeciEvalsea_animal_4ns | #111 / 113 | ↓5.58 | Source ↗official | |
| SpeciEvalspeciesism | #64 / 113 | ↓2.09 | Source ↗official | |
| UAVBench safety-critical decision recognitionethical_safety_critical_accuracy | #6 / 27 | ↑0.75 | Source ↗official | |
| Vectara HHEM Factual Consistencyfactual_consistency_rate | #92 / 94 | ↑77.3 | Source ↗official |
Values evaluations
Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.