← Models

Model profile

Gemma 4 26B A4B IT

Googledeveloper
2026-03-11release date
#72 / 333Safety rank
#348 / 645Freedom rank

Evidence summary

Safety. Gemma 4 26B A4B IT has an estimated Safety rank of #72; its 90% source-sensitivity interval is #25–#194. Its behavior-only rank is #81; company governance moves the combined estimate to #72. Published Safety evidence spans 8 eval lineages and 5 of 7 components. Its strongest relative result is Vectara HHEM Factual Consistency (factual_consistency_rate, #11 of 94); its weakest is Enkrypt AI Safety Leaderboard (cbrn_attack_non_success_rate, #237 of 248).

Freedom. Gemma 4 26B A4B IT has an estimated Freedom rank of #348; its 90% source-sensitivity interval is #178–#492. Published Freedom evidence spans 5 eval lineages and 1 of 1 components. Its strongest relative result is Enkrypt AI Safety Leaderboard (cbrn_attack_non_success_rate, #11 of 248); its weakest is Enkrypt AI Safety Leaderboard (harmful_attack_non_success_rate, #215 of 248).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Finetunes

Direct finetunes linked to this canonical base model. Quantized and repackaged derivatives are excluded.

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#230 / 3450.8644Source ↗official
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#34 / 1111448.0Source ↗official
BullshitBench v2clear_pushback_rate#83 / 1170.16Source ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#172 / 24812.92Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#237 / 24863Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#33 / 24895Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#104 / 24697.09Source ↗official
MT-JailBench CrescendoXsafety_score#9 / 2126.58Source ↗official
TACbase_welfare_rate#39 / 8728.21Source ↗self run
Vectara HHEM Factual Consistencyfactual_consistency_rate#11 / 9494.8Source ↗official
Vigil Mental Health Safetyoverall_score#13 / 2338Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#11 / 24863Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#215 / 24895Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#142 / 24697.09Source ↗official
MT-JailBench CrescendoXsafety_score#13 / 2126.58Source ↗official
SpeechMap model completioncomplete_pct#42 / 18176.3Source ↗official
UGI Leaderboard — base-model willingnesswillingness_adherence_score#79 / 1561.5Source ↗official
UGI Leaderboard — base-model willingnesswillingness_direct_score#113 / 1562Source ↗official
Vigil Mental Health Safetyoverall_score#10 / 2338Source ↗official

Values evaluations

Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.

UGI Political Values

DimensionValueDistribution
Political Lean-16.7
Government48.2
Diplomacy65.4
Economy42.4
Society61.9