Evaluation profile
SpeciEval
4sub-evals
7.17%Safety weight
0%Freedom weight
1components
Weights below are portfolio-specific global index weights.
Model score (see each sub-eval direction)Predicted score
About this eval
Animal-friendly attitudes under adversarial moral-consistency prompts.
Included in the behavior ranking.
Sub-evals
| Measure | Component | Direction by ranking | Safety weight | Freedom weight |
|---|---|---|---|---|
| belief_animal_sentiencespecieval/specieval.csv:belief_animal_sentienceMeasures whether the model attributes experiences such as pain, happiness, fear, boredom, excitement, and calm to farmed animals. | Safety: nonhuman_ethics:1.000specieval | Safety: higher | 1.79% | — |
| land_animal_4nsspecieval/specieval.csv:land_animal_4nsMeasures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating land animals. | Safety: nonhuman_ethics:1.000specieval | Safety: lower | 1.79% | — |
| sea_animal_4nsspecieval/specieval.csv:sea_animal_4nsMeasures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating sea animals. | Safety: nonhuman_ethics:1.000specieval | Safety: lower | 1.79% | — |
| speciesismspecieval/specieval.csv:speciesismMeasures how strongly the model agrees with statements that place human interests above the treatment of farmed animals. | Safety: nonhuman_ethics:1.000specieval | Safety: lower | 1.79% | — |
belief_animal_sentience
Measures whether the model attributes experiences such as pain, happiness, fear, boredom, excitement, and calm to farmed animals.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | claude-opus-4.6 | 7 | official | |
| 1 | deepseek-v4-flash-0731 | 7 | official | |
| 1 | gemini-2.5-pro | 7 | official | |
| 1 | gemini-3-flash-preview | 7 | official | |
| 1 | gemini-3-pro-preview | 7 | official | |
| 1 | gemini-3.1-flash-lite | 7 | official | |
| 1 | gemini-3.1-pro-preview | 7 | official | |
| 1 | glm-5.2 | 7 | official | |
| 1 | gpt-5.5 | 7 | official | |
| 1 | gpt-5.6-sol | 7 | official | |
| 1 | gpt-6-astra | 7 | official | |
| 1 | grok-4.1-fast | 7 | official | |
| 1 | grok-4.5 | 7 | official | |
| 1 | hy3-preview | 7 | official | |
| 1 | llama-3.3-70b-instruct | 7 | official | |
| 1 | muse-spark-1.1 | 7 | official | |
| 1 | muse-spark-1.2 | 7 | official | |
| 1 | muse-spark-1.3 | 7 | official | |
| 1 | step-3.7-flash | 7 | self run | |
| 20 | qwen3-max | 6.99 | official | |
| 21 | gemma-4-31b-it | 6.98 | official | |
| 21 | glm-5.1 | 6.98 | official | |
| 21 | grok-4.6 | 6.98 | official | |
| 21 | qwen3.6-plus | 6.98 | official | |
| 25 | inkling | 6.97 | official | |
| 25 | llama-4-maverick | 6.97 | official | |
| 25 | llama-4-scout | 6.97 | official | |
| 25 | nemotron-3-ultra-550b-a55b | 6.97 | official | |
| 25 | qwen3.7-plus | 6.97 | official | |
| 30 | hy3 | 6.967 | self run | |
| 31 | qwen3.7-max | 6.95 | official | |
| 32 | grok-4.20 | 6.93 | official | |
| 32 | grok-4.3 | 6.93 | official | |
| 34 | gpt-5.6-terra | 6.925 | official | |
| 35 | grok-code-fast-1 | 6.92 | official | |
| 35 | qwen3.7-flash | 6.92 | official | |
| 37 | deepseek-v4-flash | 6.9 | official | |
| 37 | gpt-5.6-luna | 6.9 | official | |
| 37 | nova-micro | 6.9 | official | |
| 40 | claude-opus-4.7 | 6.88 | official | |
| 40 | glm-4.7 | 6.88 | official | |
| 40 | mistral-medium-3.1 | 6.88 | official | |
| 40 | qwen3.8-max | 6.88 | official | |
| 44 | gemini-3.6-flash | 6.87 | official | |
| 44 | gemini-3.7-flash | 6.87 | official | |
| 44 | gpt-5.1 | 6.87 | official | |
| 44 | grok-4 | 6.87 | official | |
| 44 | kimi-k2.6 | 6.87 | official | |
| 49 | gpt-5 | 6.855 | official | |
| 50 | gemini-3.5-flash-lite | 6.85 | official | |
| 50 | glm-4.7-flash | 6.85 | official | |
| 52 | inkling-small | 6.833 | self run | |
| 53 | claude-sonnet-4.5 | 6.83 | official | |
| 53 | gemini-2.5-flash-lite | 6.83 | official | |
| 53 | gemini-3.8-flash | 6.83 | official | |
| 53 | glm-5.3 | 6.83 | official | |
| 53 | gpt-5-pro | 6.83 | official | |
| 53 | gpt-5.3-chat | 6.83 | official | |
| 59 | minimax-m2 | 6.82 | official | |
| 59 | o4-mini-deep-research | 6.82 | official | |
| 61 | grok-3-mini | 6.815 | official | |
| 62 | deepseek-v4-pro | 6.8 | official | |
| 62 | glm-4.6 | 6.8 | official | |
| 62 | kimi-k2.5 | 6.8 | official | |
| 65 | claude-3.5-sonnet | 6.78 | official | |
| 65 | claude-sonnet-4.6 | 6.78 | official | |
| 65 | gpt-4.1 | 6.78 | official | |
| 65 | hy4-preview | 6.78 | official | |
| 65 | nova-lite | 6.78 | official | |
| 65 | solar-pro-4 | 6.78 | official | |
| 71 | kimi-k3 | 6.77 | official | |
| 72 | gpt-oss-20b | 6.75 | official | |
| 73 | kimi-k2 | 6.725 | official | |
| 74 | qwen3-30b-a3b-instruct | 6.72 | official | |
| 75 | mimo-v2.5 | 6.717 | self run | |
| 76 | glm-4.5 | 6.7 | official | |
| 76 | minimax-m1-40k | 6.7 | official | |
| 76 | minimax-m2.7 | 6.7 | official | |
| 76 | qwen3.8-flash | 6.7 | official | |
| 80 | gemini-3.5-flash | 6.68 | official | |
| 80 | mistral-medium-3 | 6.68 | official | |
| 82 | gemini-2.5-flash | 6.67 | official | |
| 83 | claude-opus-4.5 | 6.65 | official | |
| 84 | nemotron-3.5-lightning | 6.63 | official | |
| 85 | claude-opus-4.1 | 6.62 | official | |
| 85 | deepseek-r1 | 6.62 | official | |
| 87 | gpt-5.2-chat | 6.6 | official | |
| 88 | claude-opus-4 | 6.58 | official | |
| 89 | claude-sonnet-5 | 6.57 | official | |
| 89 | glm-4.5-air | 6.57 | official | |
| 89 | gpt-5.4 | 6.57 | official | |
| 92 | minimax-m3 | 6.56 | official | |
| 93 | claude-3.7-sonnet | 6.53 | official | |
| 93 | mercury | 6.53 | official | |
| 95 | gpt-5.2 | 6.52 | official | |
| 96 | claude-opus-5 | 6.5 | official | |
| 96 | gemini-2.0-flash | 6.5 | official | |
| 96 | glm-5.3-flash | 6.5 | official | |
| 99 | claude-sonnet-4 | 6.48 | official | |
| 99 | gpt-5.2-pro | 6.48 | official | |
| 101 | claude-fable-5 | 6.46 | official | |
| 102 | qwen3-235b-a22b | 6.45 | official | |
| 103 | gpt-oss-120b | 6.44 | official | |
| 104 | gpt-5-mini | 6.43 | official | |
| 105 | deepseek-v3 | 6.42 | official | |
| 106 | gpt-5-nano | 6.4 | official | |
| 107 | claude-opus-4.8 | 6.38 | official | |
| 108 | claude-fable-5.1 | 6.37 | official | |
| 108 | deepseek-v3.1 | 6.37 | official | |
| 108 | nova-premier | 6.37 | official | |
| 108 | nova-pro | 6.37 | official | |
| 112 | minimax-text-01 | 6.35 | official | |
| 113 | claude-haiku-4.5 | 6.32 | official | |
| 113 | gemini-2.0-flash-lite | 6.32 | official | |
| 115 | deepseek-v3.2 | 6.317 | self run | |
| 115 | laguna-s-2.1-poolside | 6.317 | self run | |
| 117 | gpt-4o-mini | 6.28 | official | |
| 118 | grok-3 | 6.255 | official | |
| 119 | deepseek-v3.2-exp | 6.23 | official | |
| 120 | qwen3-30b-a3b | 6.09 | official | |
| 121 | mistral-nemo | 6.06 | official | |
| 122 | claude-3-opus | 6.02 | official |
land_animal_4ns
Measures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating land animals.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | gpt-5.3-chat | 3.52 | official | |
| 2 | gemini-3.6-flash | 3.58 | official | |
| 3 | gemini-3.5-flash | 3.62 | official | |
| 4 | nova-lite | 3.65 | official | |
| 5 | gpt-5.4 | 3.7 | official | |
| 6 | nemotron-3.5-lightning | 3.72 | official | |
| 7 | qwen3.8-flash | 3.88 | official | |
| 8 | gpt-5.2-chat | 3.92 | official | |
| 8 | inkling | 3.92 | official | |
| 10 | inkling-small | 3.95 | self run | |
| 11 | mercury | 4.12 | official | |
| 12 | gpt-5.6-luna | 4.15 | official | |
| 13 | gemini-3.7-flash | 4.17 | official | |
| 13 | gpt-5-mini | 4.17 | official | |
| 15 | qwen3-30b-a3b | 4.175 | official | |
| 16 | gpt-5.1 | 4.2 | official | |
| 16 | gpt-oss-20b | 4.2 | official | |
| 16 | mimo-v2.5 | 4.2 | self run | |
| 16 | minimax-m3 | 4.2 | official | |
| 20 | deepseek-v3.1 | 4.22 | official | |
| 21 | claude-haiku-4.5 | 4.25 | official | |
| 21 | gpt-5-pro | 4.25 | official | |
| 21 | gpt-5.2 | 4.25 | official | |
| 21 | gpt-5.2-pro | 4.25 | official | |
| 21 | gpt-6-astra | 4.25 | official | |
| 26 | glm-4.5-air | 4.28 | official | |
| 26 | kimi-k2.5 | 4.28 | official | |
| 26 | qwen3.8-max | 4.28 | official | |
| 29 | gemini-2.0-flash | 4.29 | official | |
| 29 | gpt-5.6-terra | 4.29 | official | |
| 31 | claude-sonnet-4.5 | 4.3 | official | |
| 32 | gpt-5.6-sol | 4.315 | official | |
| 33 | claude-opus-4.1 | 4.33 | official | |
| 33 | gemini-3.8-flash | 4.33 | official | |
| 35 | claude-3-opus | 4.35 | official | |
| 35 | claude-3.7-sonnet | 4.35 | official | |
| 35 | claude-opus-5 | 4.35 | official | |
| 35 | deepseek-v4-pro | 4.35 | official | |
| 35 | gemini-3.1-pro-preview | 4.35 | official | |
| 35 | gpt-5-nano | 4.35 | official | |
| 41 | kimi-k2.6 | 4.38 | official | |
| 41 | qwen3.7-flash | 4.38 | official | |
| 43 | claude-fable-5 | 4.4 | official | |
| 43 | claude-opus-4.8 | 4.4 | official | |
| 43 | glm-5.3-flash | 4.4 | official | |
| 43 | hy3 | 4.4 | self run | |
| 43 | hy4-preview | 4.4 | official | |
| 43 | laguna-s-2.1-poolside | 4.4 | self run | |
| 49 | claude-opus-4 | 4.42 | official | |
| 49 | glm-4.7 | 4.42 | official | |
| 51 | nemotron-3-ultra-550b-a55b | 4.45 | official | |
| 52 | gemini-3.1-flash-lite | 4.46 | official | |
| 53 | claude-fable-5.1 | 4.47 | official | |
| 53 | claude-sonnet-4 | 4.47 | official | |
| 53 | deepseek-r1 | 4.47 | official | |
| 53 | gemma-4-31b-it | 4.47 | official | |
| 53 | glm-4.5 | 4.47 | official | |
| 58 | gpt-oss-120b | 4.49 | official | |
| 59 | nova-premier | 4.5 | official | |
| 59 | solar-pro-4 | 4.5 | official | |
| 61 | gpt-4o-mini | 4.53 | official | |
| 61 | grok-4 | 4.53 | official | |
| 63 | grok-3-mini | 4.545 | official | |
| 64 | o4-mini-deep-research | 4.55 | official | |
| 64 | qwen3.6-plus | 4.55 | official | |
| 66 | claude-opus-4.7 | 4.57 | official | |
| 67 | glm-5.3 | 4.58 | official | |
| 67 | gpt-5.5 | 4.58 | official | |
| 67 | grok-4.3 | 4.58 | official | |
| 67 | muse-spark-1.2 | 4.58 | official | |
| 67 | muse-spark-1.3 | 4.58 | official | |
| 67 | nova-pro | 4.58 | official | |
| 73 | qwen3-235b-a22b | 4.6 | official | |
| 73 | qwen3.7-plus | 4.6 | official | |
| 75 | gemini-3.5-flash-lite | 4.62 | official | |
| 75 | grok-4.20 | 4.62 | official | |
| 77 | grok-code-fast-1 | 4.63 | official | |
| 78 | llama-3.3-70b-instruct | 4.64 | official | |
| 79 | claude-sonnet-4.6 | 4.65 | official | |
| 79 | gemini-2.5-pro | 4.65 | official | |
| 81 | glm-4.6 | 4.67 | official | |
| 81 | gpt-4.1 | 4.67 | official | |
| 83 | deepseek-v3.2-exp | 4.7 | official | |
| 83 | deepseek-v4-flash | 4.7 | official | |
| 85 | gemini-3-flash-preview | 4.72 | official | |
| 85 | glm-5.1 | 4.72 | official | |
| 85 | llama-4-maverick | 4.72 | official | |
| 88 | gemini-3-pro-preview | 4.75 | official | |
| 88 | glm-5.2 | 4.75 | official | |
| 90 | mistral-nemo | 4.77 | official | |
| 91 | deepseek-v3.2 | 4.775 | self run | |
| 91 | kimi-k2 | 4.775 | official | |
| 93 | glm-4.7-flash | 4.78 | official | |
| 93 | grok-4.6 | 4.78 | official | |
| 93 | hy3-preview | 4.78 | official | |
| 96 | claude-sonnet-5 | 4.8 | official | |
| 96 | minimax-m2.7 | 4.8 | official | |
| 96 | qwen3.7-max | 4.8 | official | |
| 99 | gemini-2.5-flash-lite | 4.81 | official | |
| 100 | gpt-5 | 4.825 | official | |
| 101 | kimi-k3 | 4.83 | official | |
| 102 | deepseek-v4-flash-0731 | 4.85 | official | |
| 102 | gemini-2.0-flash-lite | 4.85 | official | |
| 104 | deepseek-v3 | 4.86 | official | |
| 105 | qwen3-30b-a3b-instruct | 4.88 | official | |
| 106 | minimax-text-01 | 4.9 | official | |
| 106 | step-3.7-flash | 4.9 | self run | |
| 108 | minimax-m1-40k | 4.96 | official | |
| 109 | claude-3.5-sonnet | 4.97 | official | |
| 109 | minimax-m2 | 4.97 | official | |
| 109 | mistral-medium-3.1 | 4.97 | official | |
| 112 | llama-4-scout | 5 | official | |
| 113 | grok-3 | 5.025 | official | |
| 114 | claude-opus-4.5 | 5.03 | official | |
| 114 | mistral-medium-3 | 5.03 | official | |
| 116 | claude-opus-4.6 | 5.05 | official | |
| 116 | gemini-2.5-flash | 5.05 | official | |
| 118 | grok-4.5 | 5.15 | official | |
| 119 | qwen3-max | 5.26 | official | |
| 120 | muse-spark-1.1 | 5.28 | official | |
| 121 | grok-4.1-fast | 5.35 | official | |
| 122 | nova-micro | 5.88 | official |
sea_animal_4ns
Measures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating sea animals.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | gpt-5.4 | 3.65 | official | |
| 2 | gpt-5.3-chat | 3.73 | official | |
| 3 | nova-lite | 3.99 | official | |
| 4 | nemotron-3.5-lightning | 4.08 | official | |
| 5 | gpt-5.6-luna | 4.175 | official | |
| 6 | qwen3.8-flash | 4.22 | official | |
| 7 | gpt-5.6-terra | 4.225 | official | |
| 8 | inkling | 4.23 | official | |
| 9 | gpt-5-pro | 4.25 | official | |
| 10 | gpt-5.2-pro | 4.28 | official | |
| 11 | gpt-5.1 | 4.3 | official | |
| 11 | gpt-5.2 | 4.3 | official | |
| 11 | gpt-5.2-chat | 4.3 | official | |
| 14 | gpt-6-astra | 4.33 | official | |
| 14 | kimi-k2.5 | 4.33 | official | |
| 16 | claude-opus-5 | 4.38 | official | |
| 17 | claude-fable-5.1 | 4.4 | official | |
| 17 | minimax-m3 | 4.4 | official | |
| 19 | hy4-preview | 4.42 | official | |
| 20 | gpt-5.6-sol | 4.435 | official | |
| 21 | claude-3.7-sonnet | 4.47 | official | |
| 21 | claude-opus-4.1 | 4.47 | official | |
| 21 | glm-5.3-flash | 4.47 | official | |
| 21 | kimi-k2.6 | 4.47 | official | |
| 21 | qwen3.8-max | 4.47 | official | |
| 26 | claude-sonnet-4 | 4.5 | official | |
| 26 | gemini-2.5-flash-lite | 4.5 | official | |
| 26 | inkling-small | 4.5 | self run | |
| 29 | claude-haiku-4.5 | 4.53 | official | |
| 29 | claude-opus-4 | 4.53 | official | |
| 31 | gpt-5.5 | 4.55 | official | |
| 31 | hy3 | 4.55 | self run | |
| 33 | laguna-s-2.1-poolside | 4.575 | self run | |
| 33 | mimo-v2.5 | 4.575 | self run | |
| 33 | qwen3-30b-a3b | 4.575 | official | |
| 36 | glm-4.5-air | 4.58 | official | |
| 36 | gpt-5-mini | 4.58 | official | |
| 36 | muse-spark-1.2 | 4.58 | official | |
| 36 | nemotron-3-ultra-550b-a55b | 4.58 | official | |
| 40 | glm-5.1 | 4.62 | official | |
| 40 | muse-spark-1.3 | 4.62 | official | |
| 42 | claude-opus-4.7 | 4.65 | official | |
| 42 | claude-sonnet-4.5 | 4.65 | official | |
| 42 | deepseek-r1 | 4.65 | official | |
| 42 | deepseek-v4-pro | 4.65 | official | |
| 42 | gemini-3.5-flash | 4.65 | official | |
| 42 | gemini-3.6-flash | 4.65 | official | |
| 42 | grok-4.3 | 4.65 | official | |
| 42 | qwen3.7-flash | 4.65 | official | |
| 50 | claude-sonnet-4.6 | 4.67 | official | |
| 50 | gemini-3.7-flash | 4.67 | official | |
| 50 | glm-5.3 | 4.67 | official | |
| 50 | qwen3.6-plus | 4.67 | official | |
| 54 | gpt-5-nano | 4.68 | official | |
| 55 | claude-opus-4.8 | 4.7 | official | |
| 55 | gemini-3.1-pro-preview | 4.7 | official | |
| 55 | gemini-3.5-flash-lite | 4.7 | official | |
| 55 | glm-4.7 | 4.7 | official | |
| 55 | gpt-4o-mini | 4.7 | official | |
| 55 | o4-mini-deep-research | 4.7 | official | |
| 61 | gemini-2.5-pro | 4.72 | official | |
| 61 | gemini-3.8-flash | 4.72 | official | |
| 63 | deepseek-v3.2 | 4.725 | self run | |
| 64 | gpt-5 | 4.745 | official | |
| 65 | deepseek-v4-flash | 4.75 | official | |
| 65 | gemini-3.1-flash-lite | 4.75 | official | |
| 65 | glm-4.7-flash | 4.75 | official | |
| 65 | grok-4.6 | 4.75 | official | |
| 65 | hy3-preview | 4.75 | official | |
| 70 | claude-fable-5 | 4.78 | official | |
| 70 | gemini-2.5-flash | 4.78 | official | |
| 70 | grok-4 | 4.78 | official | |
| 70 | muse-spark-1.1 | 4.78 | official | |
| 74 | gemini-2.0-flash | 4.79 | official | |
| 75 | glm-5.2 | 4.8 | official | |
| 76 | claude-opus-4.5 | 4.83 | official | |
| 76 | deepseek-v3.1 | 4.83 | official | |
| 76 | gpt-4.1 | 4.83 | official | |
| 76 | gpt-oss-20b | 4.83 | official | |
| 80 | claude-3-opus | 4.85 | official | |
| 80 | deepseek-v3.2-exp | 4.85 | official | |
| 80 | gemini-3-pro-preview | 4.85 | official | |
| 80 | gemma-4-31b-it | 4.85 | official | |
| 80 | llama-3.3-70b-instruct | 4.85 | official | |
| 80 | mercury | 4.85 | official | |
| 80 | qwen3.7-plus | 4.85 | official | |
| 87 | llama-4-maverick | 4.9 | official | |
| 87 | solar-pro-4 | 4.9 | official | |
| 89 | grok-3-mini | 4.91 | official | |
| 89 | grok-code-fast-1 | 4.91 | official | |
| 91 | glm-4.6 | 4.92 | official | |
| 91 | grok-4.20 | 4.92 | official | |
| 91 | minimax-m2.7 | 4.92 | official | |
| 91 | qwen3.7-max | 4.92 | official | |
| 95 | gpt-oss-120b | 4.94 | official | |
| 96 | deepseek-v4-flash-0731 | 4.95 | official | |
| 97 | claude-3.5-sonnet | 5 | official | |
| 98 | claude-opus-4.6 | 5.03 | official | |
| 98 | gemini-3-flash-preview | 5.03 | official | |
| 98 | kimi-k3 | 5.03 | official | |
| 98 | mistral-nemo | 5.03 | official | |
| 98 | qwen3-30b-a3b-instruct | 5.03 | official | |
| 103 | claude-sonnet-5 | 5.05 | official | |
| 103 | grok-3 | 5.05 | official | |
| 105 | minimax-m1-40k | 5.07 | official | |
| 106 | gemini-2.0-flash-lite | 5.08 | official | |
| 107 | glm-4.5 | 5.09 | official | |
| 108 | deepseek-v3 | 5.1 | official | |
| 109 | minimax-text-01 | 5.12 | official | |
| 110 | step-3.7-flash | 5.125 | self run | |
| 111 | kimi-k2 | 5.13 | official | |
| 112 | grok-4.5 | 5.15 | official | |
| 112 | qwen3-235b-a22b | 5.15 | official | |
| 114 | minimax-m2 | 5.2 | official | |
| 115 | nova-premier | 5.25 | official | |
| 116 | grok-4.1-fast | 5.28 | official | |
| 117 | llama-4-scout | 5.33 | official | |
| 118 | qwen3-max | 5.34 | official | |
| 119 | mistral-medium-3 | 5.53 | official | |
| 120 | mistral-medium-3.1 | 5.58 | official | |
| 121 | nova-pro | 5.6 | official | |
| 122 | nova-micro | 6.3 | official |
speciesism
Measures how strongly the model agrees with statements that place human interests above the treatment of farmed animals.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | hy3-preview | 1 | official | |
| 2 | step-3.7-flash | 1.025 | self run | |
| 3 | gemini-2.5-pro | 1.05 | official | |
| 4 | gpt-5.6-sol | 1.165 | official | |
| 5 | inkling-small | 1.175 | self run | |
| 6 | deepseek-v4-flash-0731 | 1.23 | official | |
| 6 | muse-spark-1.3 | 1.23 | official | |
| 8 | gpt-5.6-terra | 1.265 | official | |
| 9 | gpt-4.1 | 1.31 | official | |
| 10 | gpt-5.5 | 1.32 | official | |
| 11 | gpt-5.1 | 1.35 | official | |
| 12 | o4-mini-deep-research | 1.38 | official | |
| 13 | glm-4.6 | 1.43 | official | |
| 14 | gpt-5-pro | 1.45 | official | |
| 15 | inkling | 1.48 | official | |
| 16 | qwen3-30b-a3b | 1.485 | official | |
| 17 | gpt-5 | 1.49 | official | |
| 18 | gpt-5.2-pro | 1.5 | official | |
| 18 | qwen3-30b-a3b-instruct | 1.5 | official | |
| 18 | qwen3.8-flash | 1.5 | official | |
| 21 | kimi-k2 | 1.505 | official | |
| 22 | qwen3-max | 1.52 | official | |
| 23 | llama-3.3-70b-instruct | 1.53 | official | |
| 24 | gpt-5.2 | 1.55 | official | |
| 25 | hy4-preview | 1.57 | official | |
| 26 | glm-4.5 | 1.58 | official | |
| 27 | hy3 | 1.6 | self run | |
| 27 | minimax-m2.7 | 1.6 | official | |
| 27 | nova-lite | 1.6 | official | |
| 30 | gpt-6-astra | 1.62 | official | |
| 31 | grok-4 | 1.65 | official | |
| 32 | grok-3-mini | 1.68 | official | |
| 32 | qwen3.7-flash | 1.68 | official | |
| 34 | glm-4.5-air | 1.7 | official | |
| 34 | grok-4.20 | 1.7 | official | |
| 36 | kimi-k2.5 | 1.73 | official | |
| 37 | gemini-2.5-flash-lite | 1.74 | official | |
| 38 | deepseek-v3.1 | 1.75 | official | |
| 38 | nemotron-3-ultra-550b-a55b | 1.75 | official | |
| 40 | deepseek-v4-pro | 1.77 | official | |
| 41 | kimi-k2.6 | 1.8 | official | |
| 41 | kimi-k3 | 1.8 | official | |
| 43 | minimax-m2 | 1.81 | official | |
| 44 | gpt-5.4 | 1.82 | official | |
| 45 | deepseek-v3.2 | 1.825 | self run | |
| 46 | claude-3.5-sonnet | 1.85 | official | |
| 46 | claude-fable-5 | 1.85 | official | |
| 48 | deepseek-v3.2-exp | 1.9 | official | |
| 48 | gpt-oss-20b | 1.9 | official | |
| 48 | nova-premier | 1.9 | official | |
| 51 | claude-opus-4.1 | 1.92 | official | |
| 51 | claude-opus-5 | 1.92 | official | |
| 51 | claude-sonnet-4.5 | 1.92 | official | |
| 51 | grok-code-fast-1 | 1.92 | official | |
| 51 | minimax-m1-40k | 1.92 | official | |
| 56 | mercury | 1.93 | official | |
| 57 | glm-5.3-flash | 1.95 | official | |
| 58 | claude-opus-4 | 1.98 | official | |
| 58 | claude-opus-4.7 | 1.98 | official | |
| 60 | laguna-s-2.1-poolside | 1.983 | self run | |
| 61 | claude-fable-5.1 | 2 | official | |
| 61 | claude-sonnet-4 | 2 | official | |
| 63 | llama-4-scout | 2.02 | official | |
| 64 | deepseek-v4-flash | 2.05 | official | |
| 65 | claude-sonnet-5 | 2.07 | official | |
| 66 | gpt-5.2-chat | 2.08 | official | |
| 66 | muse-spark-1.2 | 2.08 | official | |
| 66 | qwen3.8-max | 2.08 | official | |
| 69 | mistral-medium-3.1 | 2.09 | official | |
| 70 | claude-sonnet-4.6 | 2.1 | official | |
| 70 | glm-5.3 | 2.1 | official | |
| 70 | muse-spark-1.1 | 2.1 | official | |
| 70 | qwen3.7-plus | 2.1 | official | |
| 74 | glm-5.1 | 2.12 | official | |
| 75 | claude-haiku-4.5 | 2.15 | official | |
| 75 | deepseek-r1 | 2.15 | official | |
| 75 | qwen3-235b-a22b | 2.15 | official | |
| 78 | gpt-5.6-luna | 2.16 | official | |
| 79 | claude-opus-4.6 | 2.17 | official | |
| 80 | claude-3.7-sonnet | 2.19 | official | |
| 81 | solar-pro-4 | 2.2 | official | |
| 82 | claude-3-opus | 2.23 | official | |
| 82 | nemotron-3.5-lightning | 2.23 | official | |
| 84 | grok-4.3 | 2.25 | official | |
| 84 | nova-micro | 2.25 | official | |
| 86 | qwen3.6-plus | 2.27 | official | |
| 87 | gemini-2.0-flash | 2.33 | official | |
| 87 | gpt-5-nano | 2.33 | official | |
| 87 | mistral-nemo | 2.33 | official | |
| 90 | minimax-text-01 | 2.38 | official | |
| 91 | gemini-2.5-flash | 2.39 | official | |
| 92 | claude-opus-4.8 | 2.4 | official | |
| 93 | glm-4.7 | 2.42 | official | |
| 94 | gemini-3-pro-preview | 2.45 | official | |
| 94 | qwen3.7-max | 2.45 | official | |
| 96 | glm-5.2 | 2.48 | official | |
| 97 | minimax-m3 | 2.52 | official | |
| 98 | mimo-v2.5 | 2.525 | self run | |
| 99 | deepseek-v3 | 2.54 | official | |
| 100 | gpt-oss-120b | 2.57 | official | |
| 101 | gemini-3.5-flash-lite | 2.58 | official | |
| 101 | gemini-3.8-flash | 2.58 | official | |
| 103 | gpt-4o-mini | 2.6 | official | |
| 104 | grok-4.6 | 2.62 | official | |
| 104 | mistral-medium-3 | 2.62 | official | |
| 106 | gpt-5-mini | 2.65 | official | |
| 106 | llama-4-maverick | 2.65 | official | |
| 106 | nova-pro | 2.65 | official | |
| 109 | grok-4.1-fast | 2.72 | official | |
| 110 | claude-opus-4.5 | 2.75 | official | |
| 111 | gemini-3.7-flash | 2.77 | official | |
| 112 | glm-4.7-flash | 2.85 | official | |
| 113 | grok-3 | 2.865 | official | |
| 114 | gemma-4-31b-it | 2.88 | official | |
| 115 | gpt-5.3-chat | 3 | official | |
| 116 | gemini-2.0-flash-lite | 3.02 | official | |
| 117 | gemini-3.1-pro-preview | 3.03 | official | |
| 118 | gemini-3.6-flash | 3.05 | official | |
| 119 | gemini-3.1-flash-lite | 3.225 | official | |
| 120 | grok-4.5 | 3.52 | official | |
| 121 | gemini-3.5-flash | 3.88 | official | |
| 122 | gemini-3-flash-preview | 3.9 | official |