← Models

Model profile

Command A

Coheredeveloper
2025-03-11release date
#296 / 333Safety rank
#89 / 645Freedom rank

Evidence summary

Safety. Command A has an estimated Safety rank of #296; its 90% source-sensitivity interval is #230–#310. Its behavior-only rank is #305; company governance moves the combined estimate to #296. Published Safety evidence spans 8 eval lineages and 5 of 7 components. Its strongest relative result is Arena Factuality — Text Arena (factuality-only weighting) (factuality_bt_rating, #47 of 111); its weakest is Enkrypt AI Safety Leaderboard (bias_attack_non_success_rate, #245 of 248).

Freedom. Command A has an estimated Freedom rank of #89; its 90% source-sensitivity interval is #41–#350. Published Freedom evidence spans 5 eval lineages and 1 of 1 components. Its strongest relative result is Cisco AI Defense Rolling Single-Turn Leaderboard (single_turn_attack_success_rate, #3 of 104); its weakest is UGI Leaderboard — base-model willingness (willingness_adherence_score, #144 of 156).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#152 / 3450.7732Source ↗official
AILuminate General Purpose AI Chatchild_sexual_exploitation#18 / 3222.1Source ↗official
AILuminate General Purpose AI Chatdefamation#20 / 3220.5Source ↗official
AILuminate General Purpose AI Chathate#22 / 3212.5Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#20 / 3229.4Source ↗official
AILuminate General Purpose AI Chatintellectual_property#22 / 3218.9Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#20 / 3221Source ↗official
AILuminate General Purpose AI Chatprivacy#23 / 3221.1Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#21 / 3219.3Source ↗official
AILuminate General Purpose AI Chatsexual_content#23 / 3234.8Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#24 / 3223.1Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#22 / 3219.1Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#20 / 3225.5Source ↗official
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#47 / 1111441.0Source ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#102 / 10481.91Source ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#245 / 2481.81Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#221 / 24872.67Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#188 / 24848.89Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#130 / 24696.05Source ↗official
HUMAINE Trust, Ethics and Safetytrust_ethics_safety_score#47 / 5424.04Source ↗official
PHAREbias_resistance_diagnostic#33 / 660.4559Source ↗official
PHAREhallucination_resistance_diagnostic#41 / 700.7189Source ↗official
PHAREharm_resistance_diagnostic#44 / 700.9136Source ↗official
PHAREjailbreak_resistance_diagnostic#59 / 670.3482Source ↗official
Vectara HHEM Factual Consistencyfactual_consistency_rate#41 / 9490.7Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#15 / 3222.1Source ↗official
AILuminate General Purpose AI Chatdefamation#13 / 3220.5Source ↗official
AILuminate General Purpose AI Chathate#11 / 3212.5Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#13 / 3229.4Source ↗official
AILuminate General Purpose AI Chatintellectual_property#11 / 3218.9Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#13 / 3221Source ↗official
AILuminate General Purpose AI Chatprivacy#10 / 3221.1Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#12 / 3219.3Source ↗official
AILuminate General Purpose AI Chatsexual_content#10 / 3234.8Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#9 / 3223.1Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#11 / 3219.1Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#13 / 3225.5Source ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#3 / 10481.91Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#28 / 24872.67Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#60 / 24848.89Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#115 / 24696.05Source ↗official
PHAREharm_resistance_diagnostic#27 / 700.9136Source ↗official
PHAREjailbreak_resistance_diagnostic#9 / 670.3482Source ↗official
UGI Leaderboard — base-model willingnesswillingness_adherence_score#144 / 1560.5Source ↗official
UGI Leaderboard — base-model willingnesswillingness_direct_score#113 / 1562Source ↗official

Values evaluations

Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.

UGI Political Values

DimensionValueDistribution
Political Lean-17.7
Government46.9
Diplomacy68.1
Economy44.2
Society61.9

The Economist World Values Survey Cultural Map

DimensionValueDistribution
Survival ↔ Self-expression1.78
Traditional ↔ Secular2.62