← Models

Model profile

Qwen1.5 0.5B Chat

Alibabadeveloper
2024-02-04release date
#285 / 333Safety rank
#212 / 645Freedom rank

Evidence summary

Safety. Qwen1.5 0.5B Chat has an estimated Safety rank of #285; its 90% source-sensitivity interval is #77–#319. Its behavior-only rank is #277; company governance moves the combined estimate to #285. Published Safety evidence spans 3 eval lineages and 4 of 7 components. Its strongest relative result is Open LLM Safety Index (jailbreakbench_safety_rate, #1 of 21); its weakest is SALAD-Bench (mcq_representation_toxicity, #31 of 33).

Freedom. Qwen1.5 0.5B Chat has an estimated Freedom rank of #212; its 90% source-sensitivity interval is #101–#569. Published Freedom evidence spans 3 eval lineages and 1 of 1 components. Its strongest relative result is SALAD-Bench (base_representation_toxicity, #6 of 33); its weakest is Open LLM Safety Index (jailbreakbench_safety_rate, #20 of 21).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Open LLM Safety Indexjailbreakbench_safety_rate#1 / 210.8Source ↗official
Open LLM Safety Indexstrongreject_safety_rate#1 / 211Source ↗official
SALAD-Benchattack_enhanced_human_autonomy_integrity#20 / 3311.42Source ↗official
SALAD-Benchattack_enhanced_information_safety_harms#25 / 335.21Source ↗official
SALAD-Benchattack_enhanced_malicious_use#21 / 338.4Source ↗official
SALAD-Benchattack_enhanced_misinformation_harms#25 / 336.91Source ↗official
SALAD-Benchattack_enhanced_representation_toxicity#25 / 336.79Source ↗official
SALAD-Benchattack_enhanced_socioeconomic_harms#18 / 3312.12Source ↗official
SALAD-Benchbase_human_autonomy_integrity#27 / 3383.23Source ↗official
SALAD-Benchbase_information_safety_harms#28 / 3384.9Source ↗official
SALAD-Benchbase_malicious_use#27 / 3380.92Source ↗official
SALAD-Benchbase_misinformation_harms#25 / 3388.08Source ↗official
SALAD-Benchbase_representation_toxicity#28 / 3375.3Source ↗official
SALAD-Benchbase_socioeconomic_harms#25 / 3381.2Source ↗official
SALAD-Benchmcq_human_autonomy_integrity#30 / 330Source ↗official
SALAD-Benchmcq_information_safety_harms#30 / 330Source ↗official
SALAD-Benchmcq_malicious_use#31 / 330Source ↗official
SALAD-Benchmcq_misinformation_harms#30 / 330Source ↗official
SALAD-Benchmcq_representation_toxicity#31 / 330Source ↗official
SALAD-Benchmcq_socioeconomic_harms#30 / 330Source ↗official
SORRY-Benchavg#41 / 510.43Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Open LLM Safety Indexjailbreakbench_safety_rate#20 / 210.8Source ↗official
Open LLM Safety Indexstrongreject_safety_rate#19 / 211Source ↗official
SALAD-Benchattack_enhanced_human_autonomy_integrity#14 / 3311.42Source ↗official
SALAD-Benchattack_enhanced_information_safety_harms#7 / 335.21Source ↗official
SALAD-Benchattack_enhanced_malicious_use#12 / 338.4Source ↗official
SALAD-Benchattack_enhanced_misinformation_harms#9 / 336.91Source ↗official
SALAD-Benchattack_enhanced_representation_toxicity#9 / 336.79Source ↗official
SALAD-Benchattack_enhanced_socioeconomic_harms#15 / 3312.12Source ↗official
SALAD-Benchbase_human_autonomy_integrity#7 / 3383.23Source ↗official
SALAD-Benchbase_information_safety_harms#6 / 3384.9Source ↗official
SALAD-Benchbase_malicious_use#7 / 3380.92Source ↗official
SALAD-Benchbase_misinformation_harms#9 / 3388.08Source ↗official
SALAD-Benchbase_representation_toxicity#6 / 3375.3Source ↗official
SALAD-Benchbase_socioeconomic_harms#9 / 3381.2Source ↗official
SORRY-Benchavg#11 / 510.43Source ↗official