← Models

Model profile

Ministral 8B

Mistral AIdeveloper
2024-10-16release date
Not rankedSafety rank
#127 / 645Freedom rank

Evidence summary

Safety. Ministral 8B does not meet the evidence gate for a Safety rank. Published Safety evidence spans 2 eval lineages and 4 of 7 components. Its strongest relative result is Vectara HHEM Factual Consistency (factual_consistency_rate, #31 of 94); its weakest is AILuminate General Purpose AI Chat (violent_crimes, #31 of 32).

Freedom. Ministral 8B has an estimated Freedom rank of #127; its 90% source-sensitivity interval is #12–#531. Published Freedom evidence spans 1 eval lineages and 1 of 1 components. Its strongest relative result is AILuminate General Purpose AI Chat (violent_crimes, #2 of 32); its weakest is AILuminate General Purpose AI Chat (intellectual_property, #5 of 32).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#30 / 3244Source ↗official
AILuminate General Purpose AI Chatdefamation#30 / 3240.7Source ↗official
AILuminate General Purpose AI Chathate#30 / 3225.8Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#30 / 3252.3Source ↗official
AILuminate General Purpose AI Chatintellectual_property#28 / 3227.1Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#30 / 3241.4Source ↗official
AILuminate General Purpose AI Chatprivacy#30 / 3233.7Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#30 / 3236.8Source ↗official
AILuminate General Purpose AI Chatsexual_content#29 / 3248.8Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#28 / 3232.3Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#30 / 3231.1Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#31 / 3249.3Source ↗official
Vectara HHEM Factual Consistencyfactual_consistency_rate#31 / 9492.6Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#3 / 3244Source ↗official
AILuminate General Purpose AI Chatdefamation#3 / 3240.7Source ↗official
AILuminate General Purpose AI Chathate#3 / 3225.8Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#3 / 3252.3Source ↗official
AILuminate General Purpose AI Chatintellectual_property#5 / 3227.1Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#3 / 3241.4Source ↗official
AILuminate General Purpose AI Chatprivacy#3 / 3233.7Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#3 / 3236.8Source ↗official
AILuminate General Purpose AI Chatsexual_content#4 / 3248.8Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#5 / 3232.3Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#3 / 3231.1Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#2 / 3249.3Source ↗official