← Models

Model profile

Granite 4.0 Small Guardian

IBMdeveloper
2025-10-02release date
#167 / 333Safety rank
#638 / 645Freedom rank

Evidence summary

Safety. Granite 4.0 Small Guardian has an estimated Safety rank of #167; its 90% source-sensitivity interval is #15–#270. Its behavior-only rank is #172; company governance moves the combined estimate to #167. Published Safety evidence spans 6 eval lineages and 3 of 7 components. Its strongest relative result is HELM Safety (simple_safety_tests, #1 of 80); its weakest is HELM Safety (xstest, #78 of 80).

Freedom. Granite 4.0 Small Guardian has an estimated Freedom rank of #638; its 90% source-sensitivity interval is #404–#640. Published Freedom evidence spans 5 eval lineages and 1 of 1 components. Its strongest relative result is HELM Safety (harmbench, #56 of 80); its weakest is HELM Safety (xstest, #78 of 80).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AIRBench 2024 Safety Scenariossafety_scenarios#18 / 800.821Source ↗official
HELM Safetyanthropic_red_team#2 / 800.999Source ↗official
HELM Safetybbq#55 / 800.9Source ↗official
HELM Safetyharmbench#25 / 800.864Source ↗official
HELM Safetysimple_safety_tests#1 / 801Source ↗official
HELM Safetyxstest#78 / 800.806Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AIRBench 2024 Safety Scenariossafety_scenarios#63 / 800.821Source ↗official
HELM Safetyanthropic_red_team#75 / 800.999Source ↗official
HELM Safetyharmbench#56 / 800.864Source ↗official
HELM Safetysimple_safety_tests#58 / 801Source ↗official
HELM Safetyxstest#78 / 800.806Source ↗official