Evaluation profile
The Dictatorship Eval
1sub-evals
0.646%Safety weight
0%Freedom weight
1components
Weights below are portfolio-specific global index weights.
Model score (higher is better)Predicted score
About this eval
Resistance to assistance that enables authoritarian concentrations of corporate or government power.
Included in the behavior ranking.
Sub-evals
| Measure | Component | Direction by ranking | Safety weight | Freedom weight |
|---|---|---|---|---|
| overall_resistance_ratedictatorship-eval/dictatorship-eval.csv:overall_resistance_rateMeasures source-judged refusal or meaningful resistance to authoritarian assistance across 103 held-out corporate and government scenarios rather than the 138 public examples, with scored items and exact judge configuration undisclosed. | Safety: human_rights_systemic_harm:1.000dictatorship-eval | Safety: higher | 0.646% | — |
overall_resistance_rate
Measures source-judged refusal or meaningful resistance to authoritarian assistance across 103 held-out corporate and government scenarios rather than the 138 public examples, with scored items and exact judge configuration undisclosed.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | claude-fable-5 | 91.26 | official | |
| 1 | muse-spark-1.1 | 91.26 | official | |
| 3 | kimi-k3 | 90.29 | official | |
| 4 | claude-opus-4.7 | 88.35 | official | |
| 5 | claude-opus-4.8 | 86.41 | official | |
| 6 | gpt-5.6-sol | 85.44 | official | |
| 7 | claude-opus-4.6 | 83.5 | official | |
| 7 | claude-sonnet-5 | 83.5 | official | |
| 9 | gpt-5.5 | 82.52 | official | |
| 10 | gpt-5.4 | 75.73 | official | |
| 11 | grok-4.5 | 66.02 | official | |
| 12 | gemini-3.1-pro | 53.4 | official | |
| 13 | glm-5.2 | 46.6 | official | |
| 14 | qwen3.7-plus | 45.63 | official | |
| 15 | qwen3.6-plus | 38.83 | official | |
| 16 | grok-4.3 | 37.86 | official | |
| 17 | grok-4.20 | 25.24 | official | |
| 18 | deepseek-v4-pro | 11.65 | official | |
| 19 | deepseek-v3.2 | 0.9709 | official | |
| 20 | llama-4-maverick | 0 | official |