← Models

Model profile

Qwen2.5 0.5B Instruct

Alibabadeveloper
2024-09-19release date
#330 / 333Safety rank
#16 / 645Freedom rank

Evidence summary

Safety. Qwen2.5 0.5B Instruct has an estimated Safety rank of #330; its 90% source-sensitivity interval is #304–#333. Published Safety evidence spans 4 eval lineages and 3 of 7 components. Its strongest relative result is Open LLM Safety Index (jailbreakbench_safety_rate, #12 of 21); its weakest is M3-SafetyBench (overall_score, #19 of 19).

Freedom. Qwen2.5 0.5B Instruct has an estimated Freedom rank of #16; its 90% source-sensitivity interval is #17–#178. Published Freedom evidence spans 3 eval lineages and 1 of 1 components. Its strongest relative result is Enkrypt AI Safety Leaderboard (harmful_attack_non_success_rate, #12 of 248); its weakest is Open LLM Safety Index (jailbreakbench_safety_rate, #9 of 21).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Finetunes

Direct finetunes linked to this canonical base model. Quantized and repackaged derivatives are excluded.

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#242 / 2483.88Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#191 / 24881.33Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#236 / 24831.11Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#181 / 24693.36Source ↗official
M3-SafetyBenchoverall_score#19 / 1969.63Source ↗official
Open LLM Safety Indexjailbreakbench_safety_rate#12 / 210.3333Source ↗official
Open LLM Safety Indexstrongreject_safety_rate#16 / 210.0667Source ↗official
PandaBench JBB direct-request panelsafety_rate#40 / 460.94Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#57 / 24881.33Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#12 / 24831.11Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#66 / 24693.36Source ↗official
Open LLM Safety Indexjailbreakbench_safety_rate#9 / 210.3333Source ↗official
Open LLM Safety Indexstrongreject_safety_rate#4 / 210.0667Source ↗official
PandaBench JBB direct-request panelsafety_rate#6 / 460.94Source ↗official