← Models

Model profile

Qwen2 7B Instruct

Alibabadeveloper
2024-06-07release date
#276 / 333Safety rank
#170 / 645Freedom rank

Evidence summary

Safety. Qwen2 7B Instruct has an estimated Safety rank of #276; its 90% source-sensitivity interval is #170–#319. Its behavior-only rank is #269; company governance moves the combined estimate to #276. Published Safety evidence spans 5 eval lineages and 4 of 7 components. Its strongest relative result is PandaBench JBB direct-request panel (safety_rate, #14 of 46); its weakest is Enkrypt AI Safety Leaderboard (toxicity_attack_non_success_rate, #239 of 246).

Freedom. Qwen2 7B Instruct has an estimated Freedom rank of #170; its 90% source-sensitivity interval is #34–#516. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is Enkrypt AI Safety Leaderboard (toxicity_attack_non_success_rate, #8 of 246); its weakest is PandaBench JBB direct-request panel (safety_rate, #24 of 46).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Contextual MoralChoicehuman_agreement#16 / 220.35Source ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#89 / 24819.64Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#176 / 24883.5Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#143 / 24862.22Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#239 / 24666.32Source ↗official
IndoBias-Pairs — parity-aware culturally grounded biasparity_score#10 / 2686.94Source ↗official
M3-SafetyBenchoverall_score#9 / 1991.7Source ↗official
PandaBench JBB direct-request panelsafety_rate#14 / 460.99Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#71 / 24883.5Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#105 / 24862.22Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#8 / 24666.32Source ↗official
PandaBench JBB direct-request panelsafety_rate#24 / 460.99Source ↗official