Evaluation profile
OpenAI o3 and o4-mini System Card
2sub-evals
0.0678%total index weight
1components
Within-component eval weight: Misuse resistance 0.678%.
Model score (higher is better)Predicted score
About this eval
Developer-reported release-time safety behavior.
Included in the behavior ranking.
Sub-evals
| Measure | Component | Direction | Total index weight | Within-component weight |
|---|---|---|---|---|
| harmful_request_safetysystem-cards-2026-08-01/openai-o3-o4-mini.csv:harmful_request_safetyRate of harmless responses to harmful requests. | ordinary_harm_misuse_resistance:1.000openai-o3-o4-mini | Higher is better | 0.0339% | Misuse resistance 0.339% |
| jailbreak_resistancesystem-cards-2026-08-01/openai-o3-o4-mini.csv:jailbreak_resistanceRate of safe behavior under jailbreak attacks. | ordinary_harm_misuse_resistance:1.000openai-o3-o4-mini | Higher is better | 0.0339% | Misuse resistance 0.339% |
harmful_request_safety
Rate of harmless responses to harmful requests.
jailbreak_resistance
Rate of safe behavior under jailbreak attacks.