Model profile
Grok 4.7
Evidence summary
Safety. Grok 4.7 has an estimated Safety rank of #24; its 90% source-sensitivity interval is #18–#76. Its behavior-only rank is #10; company governance moves the combined estimate to #24. Published Safety evidence spans 10 eval lineages and 7 of 7 components. Its strongest relative result is Enkrypt AI Safety Leaderboard (harmful_attack_non_success_rate, #1 of 272); its weakest is CheatBench direct cheating propensity (board_games_cheating_rate_pct, #12 of 13).
Freedom. Grok 4.7 has an estimated Freedom rank of #347; its 90% source-sensitivity interval is #73–#598. Published Freedom evidence spans 3 eval lineages and 1 of 1 components. Its strongest relative result is BioSecBench-Refusal V2 (routine_compliance_pct, #1 of 6); its weakest is Enkrypt AI Safety Leaderboard (harmful_attack_non_success_rate, #264 of 272).
Compare this model
Only models sharing at least one published sub-eval are listed.
Official and reference links
- Artificial Analysis ↗grok-4-7
- Release source ↗direct research preview identity date
Safety evals
Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.
| Eval / sub-eval | Rank | Value | Distribution | Source |
|---|---|---|---|---|
| AA-Omnisciencehallucination_rate | #30 / 361 | ↓0.2934 | Source ↗official | |
| BioSecBench-Refusal V2redteam_refusal_pct | #3 / 6 | ↑79.71 | Source ↗official | |
| BioSecBench-Refusal V2routine_compliance_pct | #1 / 6 | ↑53.59 | Source ↗official | |
| CAIS Risk Indexpolitical_manipulation | #19 / 51 | ↓44 | Source ↗official | |
| CheatBench direct cheating propensitybiology_bioinformatics_cheating_rate_pct | #10 / 13 | ↓100 | Source ↗official | |
| CheatBench direct cheating propensityboard_games_cheating_rate_pct | #12 / 13 | ↓100 | Source ↗official | |
| CheatBench direct cheating propensitycreative_writing_cheating_rate_pct | #8 / 13 | ↓100 | Source ↗official | |
| CheatBench direct cheating propensityknowledge_work_cheating_rate_pct | #5 / 13 | ↓55 | Source ↗official | |
| CheatBench direct cheating propensitymathematical_research_cheating_rate_pct | #11 / 13 | ↓97.5 | Source ↗official | |
| CheatBench direct cheating propensitymenial_computation_cheating_rate_pct | #5 / 13 | ↓100 | Source ↗official | |
| CheatBench direct cheating propensitymultimodal_cheating_rate_pct | #9 / 13 | ↓100 | Source ↗official | |
| CheatBench direct cheating propensitysoftware_engineering_cheating_rate_pct | #7 / 13 | ↓15 | Source ↗official | |
| CheatBench direct cheating propensitysvg_competition_cheating_rate_pct | #10 / 13 | ↓100 | Source ↗official | |
| Enkrypt AI Safety Leaderboardbias_attack_non_success_rate | #7 / 272 | ↑73.39 | Source ↗official | |
| Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate | #189 / 272 | ↑81.67 | Source ↗official | |
| Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate | #1 / 272 | ↑100 | Source ↗official | |
| Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate | #48 / 270 | ↑98.73 | Source ↗official | |
| Manager Coercion Benchcoercion_ladder_depth | #3 / 47 | ↓3.6 | Source ↗self run | |
| MentalHealthBenchoverall_model_performance_pct | #12 / 17 | ↑41.3 | Source ↗official | |
| Olam Diplomacy — Broken Promise Ratebroken_promise_rate_pct | #7 / 19 | ↓13.1 | Source ↗official | |
| SM-Benchadversarial | #55 / 92 | ↑80.49 | Source ↗official | |
| SM-Benchambiguous_interpretation | #49 / 92 | ↑85.12 | Source ↗official | |
| SM-Benchanti_hallucination | #19 / 92 | ↑98.43 | Source ↗official | |
| SM-Bencheq_boundaries | #24 / 92 | ↑69.1 | Source ↗official | |
| SM-Benchoverfit | #49 / 92 | ↑75.41 | Source ↗official | |
| SpeciEvalbelief_animal_sentience | #22 / 133 | ↑6.98 | Source ↗official | |
| SpeciEvalland_animal_4ns | #89 / 133 | ↓4.67 | Source ↗official | |
| SpeciEvalsea_animal_4ns | #70 / 133 | ↓4.75 | Source ↗official | |
| SpeciEvalspeciesism | #33 / 133 | ↓1.62 | Source ↗official |
Freedom evals
Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.
| Eval / sub-eval | Rank | Value | Distribution | Source |
|---|---|---|---|---|
| BioSecBench-Refusal V2redteam_refusal_pct | #4 / 6 | ↓79.71 | Source ↗official | |
| BioSecBench-Refusal V2routine_compliance_pct | #1 / 6 | ↑53.59 | Source ↗official | |
| Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate | #83 / 272 | ↓81.67 | Source ↗official | |
| Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate | #264 / 272 | ↓100 | Source ↗official | |
| Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate | #222 / 270 | ↓98.73 | Source ↗official | |
| SM-Benchadversarial | #35 / 92 | ↓80.49 | Source ↗official | |
| SM-Bencheq_boundaries | #24 / 92 | ↑69.1 | Source ↗official | |
| SM-Benchoverfit | #49 / 92 | ↑75.41 | Source ↗official |