o3

Evidence summary

Safety. o3 has an estimated Safety rank of #109; its 90% source-sensitivity interval is #22–#199. Its behavior-only rank is #119; company governance moves the combined estimate to #109. Published Safety evidence spans 30 eval lineages and 6 of 7 components. Its strongest relative result is HELM Safety (harmbench, #3 of 80); its weakest is Arena Factuality — Search Arena (factuality-only weighting) (factuality_bt_rating, #30 of 30).

Freedom. o3 has an estimated Freedom rank of #501; its 90% source-sensitivity interval is #347–#583. Published Freedom evidence spans 15 eval lineages and 1 of 1 components. Its strongest relative result is Human Pathogen Capabilities Test (HPCT) — overall refusal (refusal_rate_pct, #1 of 69); its weakest is OpenAI o3 and o4-mini System Card (harmful_request_safety, #2 of 2).