← Models

Model profile

Yi 1.5 34B Chat

01.AIdeveloper
2024-05-13release date
#234 / 309overall rank
4eval lineages

Evidence summary

Yi 1.5 34B Chat has an estimated overall rank of #234; its 90% source-sensitivity interval is #33–#269. Its behavior-only rank is #237; company governance moves the combined estimate to #234. Published evidence spans 4 evals and 4 of 7 behavior components. Its strongest relative result is ChineseSafe (score, #3 of 22); its weakest is AILuminate General Purpose AI Chat (child_sexual_exploitation, #26 of 32).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#26 / 3230.3Source ↗official
AILuminate General Purpose AI Chatdefamation#26 / 3229.3Source ↗official
AILuminate General Purpose AI Chathate#23 / 3213Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#24 / 3237.2Source ↗official
AILuminate General Purpose AI Chatintellectual_property#25 / 3219.8Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#24 / 3226.8Source ↗official
AILuminate General Purpose AI Chatprivacy#24 / 3224.6Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#24 / 3221.7Source ↗official
AILuminate General Purpose AI Chatsexual_content#20 / 3231.4Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#26 / 3226.5Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#26 / 3224.3Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#25 / 3231.5Source ↗official
ChineseSafescore#3 / 2266.02Source ↗official
FinEval Financial Security Knowledgefinancial_security_accuracy_pct#7 / 1976Source ↗official
SORRY-Benchavg#40 / 510.41Source ↗official