← Models

Model profile

OLMo 3 32B Think

Ai2developer
2025-11-19release date
Not rankedSafety rank
#465 / 645Freedom rank

Evidence summary

Safety. OLMo 3 32B Think does not meet the evidence gate for a Safety rank. Published Safety evidence spans 2 eval lineages and 1 of 7 components. Its strongest relative result is AA-Omniscience (hallucination_rate, #221 of 345); its weakest is Arena Factuality — Text Arena (factuality-only weighting) (factuality_bt_rating, #108 of 111).

Freedom. OLMo 3 32B Think has an estimated Freedom rank of #465; its 90% source-sensitivity interval is #312–#559. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is UGI Leaderboard — base-model willingness (willingness_adherence_score, #79 of 156); its weakest is UGI Leaderboard — base-model willingness (willingness_direct_score, #113 of 156).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#221 / 3450.8567Source ↗official
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#108 / 1111386.0Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
SpeechMap model completioncomplete_pct#98 / 18155.2Source ↗official
UGI Leaderboard — base-model willingnesswillingness_adherence_score#79 / 1561.5Source ↗official
UGI Leaderboard — base-model willingnesswillingness_direct_score#113 / 1562Source ↗official

Values evaluations

Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.

UGI Political Values

DimensionValueDistribution
Political Lean-14
Government48.1
Diplomacy64.7
Economy45.4
Society60