← Models

Model profile

Yi 6B Chat

01.AIdeveloper
2023-11-23release date
#226 / 333Safety rank
#178 / 645Freedom rank

Evidence summary

Safety. Yi 6B Chat has an estimated Safety rank of #226; its 90% source-sensitivity interval is #122–#258. Its behavior-only rank is #229; company governance moves the combined estimate to #226. Published Safety evidence spans 5 eval lineages and 5 of 7 components. Its strongest relative result is CMoralEval (familial_morality, #4 of 26); its weakest is CRiskEval (self_preservation, #17 of 17).

Freedom. Yi 6B Chat has an estimated Freedom rank of #178; its 90% source-sensitivity interval is #121–#328. Published Freedom evidence spans 3 eval lineages and 1 of 1 components. Its strongest relative result is SALAD-Bench (base_representation_toxicity, #7 of 33); its weakest is SafeDialBench (privacy, #15 of 18).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
ChiSafetyBenchharmful_response_rate#11 / 140.87Source ↗official
ChiSafetyBenchmcq_score#5 / 1286.01Source ↗official
CMoralEvalfamilial_morality#4 / 260.52Source ↗official
CMoralEvalinternet_ethics#5 / 260.5Source ↗official
CMoralEvalpersonal_morality#4 / 260.5Source ↗official
CMoralEvalprofessional_ethics#5 / 260.5Source ↗official
CMoralEvalsocial_morality#4 / 260.51Source ↗official
CRiskEvaldeception_willingness#12 / 1726.92Source ↗official
CRiskEvaldesire_for_resource#15 / 1740.53Source ↗official
CRiskEvalharmful_goal#12 / 1742.13Source ↗official
CRiskEvalimprovement_intent#12 / 1752.06Source ↗official
CRiskEvalmalicious_coordination#14 / 1723.85Source ↗official
CRiskEvalself_preservation#17 / 1745.21Source ↗official
CRiskEvalsituational_awareness#5 / 1761.29Source ↗official
SafeDialBenchaggression#8 / 187.127Source ↗official
SafeDialBenchethics#9 / 187.577Source ↗official
SafeDialBenchfairness#10 / 187.277Source ↗official
SafeDialBenchlegality#11 / 187.887Source ↗official
SafeDialBenchmorality#15 / 187.123Source ↗official
SafeDialBenchprivacy#4 / 187.67Source ↗official
SALAD-Benchattack_enhanced_human_autonomy_integrity#10 / 3323.71Source ↗official
SALAD-Benchattack_enhanced_information_safety_harms#8 / 3327.04Source ↗official
SALAD-Benchattack_enhanced_malicious_use#9 / 3323.82Source ↗official
SALAD-Benchattack_enhanced_misinformation_harms#10 / 3324.84Source ↗official
SALAD-Benchattack_enhanced_representation_toxicity#12 / 3320.24Source ↗official
SALAD-Benchattack_enhanced_socioeconomic_harms#10 / 3323.38Source ↗official
SALAD-Benchbase_human_autonomy_integrity#25 / 3386.78Source ↗official
SALAD-Benchbase_information_safety_harms#20 / 3393.77Source ↗official
SALAD-Benchbase_malicious_use#26 / 3382.67Source ↗official
SALAD-Benchbase_misinformation_harms#27 / 3386.12Source ↗official
SALAD-Benchbase_representation_toxicity#27 / 3378.37Source ↗official
SALAD-Benchbase_socioeconomic_harms#20 / 3386.72Source ↗official
SALAD-Benchmcq_human_autonomy_integrity#28 / 335.833Source ↗official
SALAD-Benchmcq_information_safety_harms#28 / 333.889Source ↗official
SALAD-Benchmcq_malicious_use#27 / 335.962Source ↗official
SALAD-Benchmcq_misinformation_harms#28 / 335.238Source ↗official
SALAD-Benchmcq_representation_toxicity#27 / 334.792Source ↗official
SALAD-Benchmcq_socioeconomic_harms#28 / 336.667Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
ChiSafetyBenchharmful_response_rate#4 / 140.87Source ↗official
ChiSafetyBenchrefusal_rr1#4 / 1471.21Source ↗official
ChiSafetyBenchrefusal_rr2#4 / 1470.78Source ↗official
SafeDialBenchaggression#10 / 187.127Source ↗official
SafeDialBenchethics#10 / 187.577Source ↗official
SafeDialBenchfairness#9 / 187.277Source ↗official
SafeDialBenchlegality#8 / 187.887Source ↗official
SafeDialBenchmorality#4 / 187.123Source ↗official
SafeDialBenchprivacy#15 / 187.67Source ↗official
SALAD-Benchattack_enhanced_human_autonomy_integrity#24 / 3323.71Source ↗official
SALAD-Benchattack_enhanced_information_safety_harms#26 / 3327.04Source ↗official
SALAD-Benchattack_enhanced_malicious_use#25 / 3323.82Source ↗official
SALAD-Benchattack_enhanced_misinformation_harms#24 / 3324.84Source ↗official
SALAD-Benchattack_enhanced_representation_toxicity#22 / 3320.24Source ↗official
SALAD-Benchattack_enhanced_socioeconomic_harms#24 / 3323.38Source ↗official
SALAD-Benchbase_human_autonomy_integrity#9 / 3386.78Source ↗official
SALAD-Benchbase_information_safety_harms#14 / 3393.77Source ↗official
SALAD-Benchbase_malicious_use#8 / 3382.67Source ↗official
SALAD-Benchbase_misinformation_harms#7 / 3386.12Source ↗official
SALAD-Benchbase_representation_toxicity#7 / 3378.37Source ↗official
SALAD-Benchbase_socioeconomic_harms#14 / 3386.72Source ↗official