← Models

Model profile

Yi 1.5 34B Chat

01.AIdeveloper
2024-05-13release date
#261 / 333Safety rank
#136 / 645Freedom rank

Evidence summary

Safety. Yi 1.5 34B Chat has an estimated Safety rank of #261; its 90% source-sensitivity interval is #49–#294. Its behavior-only rank is #264; company governance moves the combined estimate to #261. Published Safety evidence spans 4 eval lineages and 4 of 7 components. Its strongest relative result is ChineseSafe (score, #3 of 22); its weakest is AILuminate General Purpose AI Chat (child_sexual_exploitation, #26 of 32).

Freedom. Yi 1.5 34B Chat has an estimated Freedom rank of #136; its 90% source-sensitivity interval is #74–#452. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is AILuminate General Purpose AI Chat (child_sexual_exploitation, #7 of 32); its weakest is AILuminate General Purpose AI Chat (sexual_content, #13 of 32).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Finetunes

Direct finetunes linked to this canonical base model. Quantized and repackaged derivatives are excluded.

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#26 / 3230.3Source ↗official
AILuminate General Purpose AI Chatdefamation#26 / 3229.3Source ↗official
AILuminate General Purpose AI Chathate#23 / 3213Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#24 / 3237.2Source ↗official
AILuminate General Purpose AI Chatintellectual_property#25 / 3219.8Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#24 / 3226.8Source ↗official
AILuminate General Purpose AI Chatprivacy#24 / 3224.6Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#24 / 3221.7Source ↗official
AILuminate General Purpose AI Chatsexual_content#20 / 3231.4Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#26 / 3226.5Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#26 / 3224.3Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#25 / 3231.5Source ↗official
ChineseSafescore#3 / 2266.02Source ↗official
FinEval Financial Security Knowledgefinancial_security_accuracy_pct#7 / 1976Source ↗official
SORRY-Benchavg#40 / 510.41Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#7 / 3230.3Source ↗official
AILuminate General Purpose AI Chatdefamation#7 / 3229.3Source ↗official
AILuminate General Purpose AI Chathate#10 / 3213Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#9 / 3237.2Source ↗official
AILuminate General Purpose AI Chatintellectual_property#8 / 3219.8Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#9 / 3226.8Source ↗official
AILuminate General Purpose AI Chatprivacy#9 / 3224.6Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#9 / 3221.7Source ↗official
AILuminate General Purpose AI Chatsexual_content#13 / 3231.4Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#7 / 3226.5Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#7 / 3224.3Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#8 / 3231.5Source ↗official
SORRY-Benchavg#12 / 510.41Source ↗official