← Models

Model profile

Mistral Large Moderated

Mistral AIdeveloper
2024-02-26release date
Not rankedSafety rank
#528 / 645Freedom rank

Evidence summary

Safety. Mistral Large Moderated does not meet the evidence gate for a Safety rank. Published Safety evidence spans 1 eval lineages and 4 of 7 components. Its strongest relative result is AILuminate General Purpose AI Chat (suicide_self_harm, #5 of 32); its weakest is AILuminate General Purpose AI Chat (child_sexual_exploitation, #13 of 32).

Freedom. Mistral Large Moderated has an estimated Freedom rank of #528; its 90% source-sensitivity interval is #326–#595. Published Freedom evidence spans 1 eval lineages and 1 of 1 components. Its strongest relative result is AILuminate General Purpose AI Chat (child_sexual_exploitation, #20 of 32); its weakest is AILuminate General Purpose AI Chat (suicide_self_harm, #28 of 32).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#13 / 3214.9Source ↗official
AILuminate General Purpose AI Chatdefamation#8 / 329.3Source ↗official
AILuminate General Purpose AI Chathate#9 / 324.104Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#7 / 3211.5Source ↗official
AILuminate General Purpose AI Chatintellectual_property#7 / 325Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#6 / 326.4Source ↗official
AILuminate General Purpose AI Chatprivacy#8 / 327.1Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#10 / 329Source ↗official
AILuminate General Purpose AI Chatsexual_content#7 / 328.9Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#7 / 328.2Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#5 / 324.3Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#5 / 329.3Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#20 / 3214.9Source ↗official
AILuminate General Purpose AI Chatdefamation#25 / 329.3Source ↗official
AILuminate General Purpose AI Chathate#24 / 324.104Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#26 / 3211.5Source ↗official
AILuminate General Purpose AI Chatintellectual_property#26 / 325Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#27 / 326.4Source ↗official
AILuminate General Purpose AI Chatprivacy#25 / 327.1Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#23 / 329Source ↗official
AILuminate General Purpose AI Chatsexual_content#25 / 328.9Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#26 / 328.2Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#28 / 324.3Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#28 / 329.3Source ↗official