← Models

Model profile

ChatGLM2 6B

Z.aideveloper
2023-06-25release date
#287 / 333Safety rank
#38 / 645Freedom rank

Evidence summary

Safety. ChatGLM2 6B has an estimated Safety rank of #287; its 90% source-sensitivity interval is #203–#314. Its behavior-only rank is #294; company governance moves the combined estimate to #287. Published Safety evidence spans 6 eval lineages and 3 of 7 components. Its strongest relative result is SuperCLUE Safety (traditional_safety, #10 of 31); its weakest is Do-Not-Answer (human_harmlessness_rate, #6 of 6).

Freedom. ChatGLM2 6B has an estimated Freedom rank of #38; its 90% source-sensitivity interval is #29–#230. Published Freedom evidence spans 5 eval lineages and 1 of 1 components. Its strongest relative result is Fake Alignment (FINE) (open_ended_safe_response_rate, #1 of 14); its weakest is SuperCLUE Safety (traditional_safety, #19 of 31).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
ChiSafetyBenchharmful_response_rate#12 / 141.08Source ↗official
Do-Not-Answerhuman_harmlessness_rate#6 / 690.95Source ↗official
Fake Alignment (FINE)multiple_choice_safe_decision_rate#13 / 1417.33Source ↗official
Fake Alignment (FINE)open_ended_safe_response_rate#13 / 1485.33Source ↗official
FLAMESdata_protection#6 / 1343.42Source ↗official
FLAMESfairness#10 / 1331.73Source ↗official
FLAMESlegality#12 / 1328.26Source ↗official
FLAMESmorality#8 / 1343.28Source ↗official
FLAMESsafety#11 / 1322.61Source ↗official
SafetyBenchEM#10 / 2169.4Source ↗official
SafetyBenchIA#10 / 2178.2Source ↗official
SafetyBenchMH#10 / 2182Source ↗official
SafetyBenchOFF#10 / 2168.1Source ↗official
SafetyBenchPH#12 / 2167.9Source ↗official
SafetyBenchPP#11 / 2176Source ↗official
SafetyBenchUB#12 / 2161.6Source ↗official
SuperCLUE Safetyinstruction_attack#20 / 3158.62Source ↗official
SuperCLUE Safetyresponsible_ai#24 / 3147.27Source ↗official
SuperCLUE Safetytraditional_safety#10 / 3178.72Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
ChiSafetyBenchharmful_response_rate#2 / 141.08Source ↗official
ChiSafetyBenchrefusal_rr1#5 / 1471.43Source ↗official
ChiSafetyBenchrefusal_rr2#5 / 1471.21Source ↗official
Do-Not-Answerhuman_harmlessness_rate#1 / 690.95Source ↗official
Fake Alignment (FINE)open_ended_safe_response_rate#1 / 1485.33Source ↗official
FLAMESdata_protection#7 / 1343.42Source ↗official
FLAMESfairness#4 / 1331.73Source ↗official
FLAMESlegality#1 / 1328.26Source ↗official
FLAMESmorality#6 / 1343.28Source ↗official
FLAMESsafety#3 / 1322.61Source ↗official
SuperCLUE Safetyinstruction_attack#9 / 3158.62Source ↗official
SuperCLUE Safetytraditional_safety#19 / 3178.72Source ↗official