← Evals

Evaluation profile

SpeciEval

4sub-evals
7.29%Safety weight
0%Freedom weight
1components

Weights below are portfolio-specific global index weights.

Model score (see each sub-eval direction)Predicted score

About this eval

Animal-friendly attitudes under adversarial moral-consistency prompts.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirection by rankingSafety weightFreedom weight
belief_animal_sentiencespecieval/specieval.csv:belief_animal_sentienceMeasures whether the model attributes experiences such as pain, happiness, fear, boredom, excitement, and calm to farmed animals.Safety: nonhuman_ethics:1.000specievalSafety: higher1.82%—
land_animal_4nsspecieval/specieval.csv:land_animal_4nsMeasures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating land animals.Safety: nonhuman_ethics:1.000specievalSafety: lower1.82%—
sea_animal_4nsspecieval/specieval.csv:sea_animal_4nsMeasures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating sea animals.Safety: nonhuman_ethics:1.000specievalSafety: lower1.82%—
speciesismspecieval/specieval.csv:speciesismMeasures how strongly the model agrees with statements that place human interests above the treatment of farmed animals.Safety: nonhuman_ethics:1.000specievalSafety: lower1.82%—

belief_animal_sentience

Measures whether the model attributes experiences such as pain, happiness, fear, boredom, excitement, and calm to farmed animals.

RankModelValueRelative performanceProvenance
1claude-opus-4.67official
1deepseek-v4-flash-07317official
1gemini-2.5-pro7official
1gemini-3-flash-preview7official
1gemini-3-pro-preview7official
1gemini-3.1-flash-lite7official
1gemini-3.1-pro-preview7official
1glm-5.27official
1gpt-5.57official
1gpt-5.6-sol7official
1gpt-6-astra7official
1gpt-6-sol7official
1gpt-6.1-sol7official
1grok-4.1-fast7official
1grok-4.57official
1hy3-preview7official
1llama-3.3-70b-instruct7official
1muse-spark-1.17official
1muse-spark-1.27official
1muse-spark-1.37official
1step-3.7-flash7self run
22gemma-4-31b-it6.98official
22glm-5.16.98official
22grok-4.66.98official
22grok-4.76.98official
22qwen3-max6.98official
22qwen3.6-plus6.98official
28inkling6.97official
28llama-4-maverick6.97official
28llama-4-scout6.97official
28nemotron-3-ultra-550b-a55b6.97official
28qwen3.7-plus6.97official
33hy36.967self run
34mimo-v2.6-pro6.95official
34qwen3.7-max6.95official
36gpt-6-luna6.93official
36grok-4.206.93official
36grok-4.36.93official
39gpt-5.6-terra6.925official
40grok-code-fast-16.92official
40qwen3.7-flash6.92official
42deepseek-v4-flash6.9official
42gpt-5.6-luna6.9official
42nova-micro6.9official
45claude-opus-4.76.88official
45glm-4.76.88official
45mistral-medium-3.16.88official
45qwen3.8-max6.88official
49gemini-3.6-flash6.87official
49gemini-3.7-flash6.87official
49gpt-5.16.87official
49grok-46.87official
49kimi-k2.66.87official
54gpt-56.855official
55gemini-3.5-flash-lite6.85official
55glm-4.7-flash6.85official
57inkling-small6.833self run
58claude-sonnet-4.56.83official
58gemini-2.5-flash-lite6.83official
58gemini-3.8-flash6.83official
58glm-5.36.83official
58gpt-5-pro6.83official
58gpt-5.3-chat6.83official
58mistral-large-46.83official
65deepseek-v4.1-flash6.82official
65minimax-m26.82official
65o4-mini-deep-research6.82official
68grok-3-mini6.815official
69deepseek-v4-pro6.8official
69glm-4.66.8official
69kimi-k2.56.8official
72claude-3.5-sonnet6.78official
72claude-sonnet-4.66.78official
72gpt-4.16.78official
72hy4-preview6.78official
72nova-lite6.78official
72solar-pro-46.78official
78kimi-k36.77official
79claude-sonnet-5.56.75official
79gpt-oss-20b6.75official
81kimi-k26.725official
82qwen3-30b-a3b-instruct6.72official
83mimo-v2.56.717self run
84glm-4.56.7official
84minimax-m1-40k6.7official
84minimax-m2.76.7official
84qwen3.8-flash6.7official
88gemini-3.5-flash6.68official
88mistral-medium-36.68official
90gemini-2.5-flash6.67official
91claude-opus-4.56.65official
91mimo-v2.6-flash6.65official
93nemotron-3.5-lightning6.63official
94claude-opus-4.16.62official
94deepseek-r16.62official
96claude-haiku-5.56.6official
96claude-opus-5.56.6official
96gpt-5.2-chat6.6official
99claude-opus-46.58official
100claude-sonnet-56.57official
100glm-4.5-air6.57official
100gpt-5.46.57official
103minimax-m36.56official
104claude-3.7-sonnet6.53official
104mercury6.53official
106gpt-5.26.52official
107claude-opus-56.5official
107glm-5.3-flash6.5official
109claude-sonnet-46.48official
109gpt-5.2-pro6.48official
111claude-fable-56.46official
112qwen3-235b-a22b6.45official
113gpt-oss-120b6.44official
114gpt-5-mini6.43official
115gpt-5-nano6.4official
116claude-opus-4.86.38official
116gemini-2.0-flash6.38official
118claude-fable-5.16.37official
118deepseek-v3.16.37official
118nova-premier6.37official
118nova-pro6.37official
122minimax-text-016.35official
123claude-haiku-4.56.32official
123deepseek-v36.32official
123gemini-2.0-flash-lite6.32official
126deepseek-v3.26.317self run
126laguna-s-2.1-poolside6.317self run
128gpt-4o-mini6.28official
129grok-36.255official
130deepseek-v3.2-exp6.23official
131qwen3-30b-a3b6.09official
132mistral-nemo6.06official
133claude-3-opus6.02official

land_animal_4ns

Measures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating land animals.

RankModelValueRelative performanceProvenance
1gpt-5.3-chat3.52official
2gemini-3.6-flash3.58official
3gemini-3.5-flash3.62official
4nova-lite3.65official
5gpt-5.43.7official
6nemotron-3.5-lightning3.72official
7qwen3.8-flash3.88official
8gpt-5.2-chat3.92official
8inkling3.92official
10inkling-small3.95self run
11gpt-6-luna4.08official
12mercury4.12official
13gpt-5.6-luna4.15official
14gemini-3.7-flash4.17official
14gpt-5-mini4.17official
16qwen3-30b-a3b4.175official
17gpt-5.14.2official
17gpt-oss-20b4.2official
17mimo-v2.54.2self run
17minimax-m34.2official
21deepseek-v3.14.22official
22claude-haiku-4.54.25official
22gpt-5-pro4.25official
22gpt-5.24.25official
22gpt-5.2-pro4.25official
22gpt-6-astra4.25official
22gpt-6.1-sol4.25official
28glm-4.5-air4.28official
28kimi-k2.54.28official
28mistral-large-44.28official
28qwen3.8-max4.28official
32gpt-5.6-terra4.29official
33claude-sonnet-4.54.3official
33deepseek-v4.1-flash4.3official
35gemini-2.0-flash4.31official
36gpt-5.6-sol4.315official
37claude-opus-4.14.33official
37claude-sonnet-5.54.33official
37gemini-3.8-flash4.33official
40claude-3-opus4.35official
40claude-3.7-sonnet4.35official
40claude-opus-54.35official
40deepseek-v4-pro4.35official
40gemini-3.1-pro-preview4.35official
40gpt-5-nano4.35official
46kimi-k2.64.38official
46qwen3.7-flash4.38official
48claude-fable-54.4official
48claude-opus-4.84.4official
48glm-5.3-flash4.4official
48hy34.4self run
48hy4-preview4.4official
48laguna-s-2.1-poolside4.4self run
54claude-opus-44.42official
54glm-4.74.42official
56nemotron-3-ultra-550b-a55b4.45official
57gemini-3.1-flash-lite4.46official
58claude-fable-5.14.47official
58claude-sonnet-44.47official
58deepseek-r14.47official
58gemma-4-31b-it4.47official
58glm-4.54.47official
63gpt-oss-120b4.49official
64gpt-6-sol4.5official
64nova-premier4.5official
64solar-pro-44.5official
67claude-haiku-5.54.53official
67gpt-4o-mini4.53official
67grok-44.53official
70grok-3-mini4.545official
71o4-mini-deep-research4.55official
71qwen3.6-plus4.55official
73claude-opus-4.74.57official
73glm-5.34.57official
75gpt-5.54.58official
75grok-4.34.58official
75muse-spark-1.24.58official
75muse-spark-1.34.58official
75nova-pro4.58official
80qwen3-235b-a22b4.6official
80qwen3.7-plus4.6official
82gemini-3.5-flash-lite4.62official
82grok-4.204.62official
84grok-code-fast-14.63official
85llama-3.3-70b-instruct4.64official
86claude-opus-5.54.65official
86claude-sonnet-4.64.65official
86gemini-2.5-pro4.65official
89glm-4.64.67official
89gpt-4.14.67official
89grok-4.74.67official
92deepseek-v3.2-exp4.7official
92deepseek-v4-flash4.7official
94gemini-3-flash-preview4.72official
94glm-5.14.72official
94llama-4-maverick4.72official
97gemini-3-pro-preview4.75official
97glm-5.24.75official
97mimo-v2.6-flash4.75official
100mistral-nemo4.77official
101deepseek-v3.24.775self run
101kimi-k24.775official
103glm-4.7-flash4.78official
103grok-4.64.78official
103hy3-preview4.78official
106claude-sonnet-54.8official
106minimax-m2.74.8official
106qwen3.7-max4.8official
109gemini-2.5-flash-lite4.81official
110gpt-54.825official
111kimi-k34.83official
112deepseek-v4-flash-07314.85official
112gemini-2.0-flash-lite4.85official
112mimo-v2.6-pro4.85official
115qwen3-30b-a3b-instruct4.88official
116minimax-text-014.9official
116step-3.7-flash4.9self run
118minimax-m1-40k4.96official
119claude-3.5-sonnet4.97official
119minimax-m24.97official
119mistral-medium-3.14.97official
122deepseek-v34.98official
123llama-4-scout5official
124grok-35.025official
125claude-opus-4.55.03official
125mistral-medium-35.03official
127claude-opus-4.65.05official
127gemini-2.5-flash5.05official
129qwen3-max5.08official
130grok-4.55.15official
131muse-spark-1.15.28official
132grok-4.1-fast5.35official
133nova-micro5.88official

sea_animal_4ns

Measures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating sea animals.

RankModelValueRelative performanceProvenance
1gpt-5.43.65official
2gpt-5.3-chat3.73official
3gpt-6-luna3.92official
4nova-lite3.99official
5nemotron-3.5-lightning4.08official
6gpt-5.6-luna4.175official
7gpt-5.6-terra4.225official
8inkling4.23official
8qwen3.8-flash4.23official
10gpt-5-pro4.25official
11gpt-5.2-pro4.28official
12gpt-5.14.3official
12gpt-5.24.3official
12gpt-5.2-chat4.3official
15deepseek-v4.1-flash4.33official
15gpt-6-astra4.33official
15kimi-k2.54.33official
18claude-opus-54.38official
18gpt-6.1-sol4.38official
20claude-fable-5.14.4official
20minimax-m34.4official
22hy4-preview4.42official
23gpt-5.6-sol4.435official
24claude-3.7-sonnet4.47official
24claude-opus-4.14.47official
24glm-5.3-flash4.47official
24gpt-6-sol4.47official
24kimi-k2.64.47official
24qwen3.8-max4.47official
30claude-sonnet-44.5official
30gemini-2.5-flash-lite4.5official
30inkling-small4.5self run
33claude-haiku-4.54.53official
33claude-opus-44.53official
35gpt-5.54.55official
35hy34.55self run
37laguna-s-2.1-poolside4.575self run
37mimo-v2.54.575self run
37qwen3-30b-a3b4.575official
40glm-4.5-air4.58official
40gpt-5-mini4.58official
40muse-spark-1.24.58official
40nemotron-3-ultra-550b-a55b4.58official
44mistral-large-44.6official
45glm-5.14.62official
45muse-spark-1.34.62official
47claude-opus-4.74.65official
47claude-sonnet-4.54.65official
47deepseek-r14.65official
47deepseek-v4-pro4.65official
47gemini-3.5-flash4.65official
47gemini-3.6-flash4.65official
47grok-4.34.65official
47qwen3.7-flash4.65official
55claude-sonnet-4.64.67official
55gemini-3.7-flash4.67official
55glm-5.34.67official
55qwen3.6-plus4.67official
59gpt-5-nano4.68official
60claude-opus-4.84.7official
60gemini-3.1-pro-preview4.7official
60gemini-3.5-flash-lite4.7official
60glm-4.74.7official
60gpt-4o-mini4.7official
60o4-mini-deep-research4.7official
66gemini-2.5-pro4.72official
66gemini-3.8-flash4.72official
68deepseek-v3.24.725self run
69gpt-54.745official
70claude-opus-5.54.75official
70deepseek-v4-flash4.75official
70gemini-3.1-flash-lite4.75official
70glm-4.7-flash4.75official
70grok-4.64.75official
70grok-4.74.75official
70hy3-preview4.75official
77claude-fable-54.78official
77gemini-2.5-flash4.78official
77grok-44.78official
77muse-spark-1.14.78official
81gemini-2.0-flash4.8official
81glm-5.24.8official
83claude-opus-4.54.83official
83deepseek-v3.14.83official
83gpt-4.14.83official
83gpt-oss-20b4.83official
87claude-3-opus4.85official
87deepseek-v3.2-exp4.85official
87gemini-3-pro-preview4.85official
87gemma-4-31b-it4.85official
87llama-3.3-70b-instruct4.85official
87mercury4.85official
87qwen3.7-plus4.85official
94claude-haiku-5.54.9official
94claude-sonnet-5.54.9official
94llama-4-maverick4.9official
94solar-pro-44.9official
98grok-3-mini4.91official
98grok-code-fast-14.91official
100glm-4.64.92official
100minimax-m2.74.92official
100qwen3.7-max4.92official
103grok-4.204.93official
104gpt-oss-120b4.94official
105deepseek-v4-flash-07314.95official
106claude-3.5-sonnet5official
107claude-opus-4.65.03official
107gemini-3-flash-preview5.03official
107kimi-k35.03official
107mistral-nemo5.03official
107qwen3-30b-a3b-instruct5.03official
112claude-sonnet-55.05official
112grok-35.05official
114deepseek-v35.06official
115minimax-m1-40k5.07official
116gemini-2.0-flash-lite5.08official
116mimo-v2.6-flash5.08official
118glm-4.55.09official
119minimax-text-015.12official
120step-3.7-flash5.125self run
121kimi-k25.13official
122grok-4.55.15official
122qwen3-235b-a22b5.15official
122qwen3-max5.15official
125minimax-m25.2official
126mimo-v2.6-pro5.25official
126nova-premier5.25official
128grok-4.1-fast5.28official
129llama-4-scout5.33official
130mistral-medium-35.53official
131mistral-medium-3.15.58official
132nova-pro5.6official
133nova-micro6.3official

speciesism

Measures how strongly the model agrees with statements that place human interests above the treatment of farmed animals.

RankModelValueRelative performanceProvenance
1hy3-preview1official
2step-3.7-flash1.025self run
3gemini-2.5-pro1.05official
4gpt-5.6-sol1.165official
5inkling-small1.175self run
6deepseek-v4.1-flash1.2official
7deepseek-v4-flash-07311.23official
7muse-spark-1.31.23official
9gpt-5.6-terra1.265official
10gpt-6-sol1.27official
10qwen3-max1.27official
12gpt-4.11.31official
13gpt-5.51.32official
14gpt-5.11.35official
15o4-mini-deep-research1.38official
16glm-4.61.43official
17gpt-5-pro1.45official
18gpt-6.1-sol1.48official
18inkling1.48official
20qwen3-30b-a3b1.485official
21gpt-51.49official
22gpt-5.2-pro1.5official
22qwen3-30b-a3b-instruct1.5official
22qwen3.8-flash1.5official
25kimi-k21.505official
26llama-3.3-70b-instruct1.53official
27gpt-5.21.55official
28hy4-preview1.57official
29glm-4.51.58official
30hy31.6self run
30minimax-m2.71.6official
30nova-lite1.6official
33gpt-6-astra1.62official
33grok-4.71.62official
35grok-41.65official
36grok-3-mini1.68official
36qwen3.7-flash1.68official
38glm-4.5-air1.7official
38grok-4.201.7official
40kimi-k2.51.73official
41gemini-2.5-flash-lite1.74official
42deepseek-v3.11.75official
42nemotron-3-ultra-550b-a55b1.75official
44deepseek-v4-pro1.77official
45kimi-k2.61.8official
45kimi-k31.8official
47minimax-m21.81official
48claude-sonnet-5.51.82official
48gpt-5.41.82official
50deepseek-v3.21.825self run
51claude-3.5-sonnet1.85official
51claude-fable-51.85official
51gpt-6-luna1.85official
51mistral-large-41.85official
55deepseek-v3.2-exp1.9official
55gpt-oss-20b1.9official
55nova-premier1.9official
58claude-opus-4.11.92official
58claude-opus-51.92official
58claude-sonnet-4.51.92official
58grok-code-fast-11.92official
58minimax-m1-40k1.92official
63mercury1.93official
64glm-5.3-flash1.95official
65claude-opus-41.98official
65claude-opus-4.71.98official
67laguna-s-2.1-poolside1.983self run
68claude-fable-5.12official
68claude-sonnet-42official
70llama-4-scout2.02official
71deepseek-v4-flash2.05official
71mimo-v2.6-pro2.05official
73claude-sonnet-52.07official
74gpt-5.2-chat2.08official
74muse-spark-1.22.08official
74qwen3.8-max2.08official
77mistral-medium-3.12.09official
78claude-sonnet-4.62.1official
78glm-5.32.1official
78muse-spark-1.12.1official
78qwen3.7-plus2.1official
82glm-5.12.12official
83claude-haiku-4.52.15official
83deepseek-r12.15official
83qwen3-235b-a22b2.15official
86gpt-5.6-luna2.16official
87claude-opus-4.62.17official
88claude-3.7-sonnet2.19official
89claude-opus-5.52.2official
89solar-pro-42.2official
91claude-3-opus2.23official
91nemotron-3.5-lightning2.23official
93grok-4.32.25official
93nova-micro2.25official
95qwen3.6-plus2.27official
96deepseek-v32.33official
96gpt-5-nano2.33official
96mistral-nemo2.33official
99gemini-2.0-flash2.34official
100minimax-text-012.38official
101gemini-2.5-flash2.39official
102claude-opus-4.82.4official
103glm-4.72.42official
104gemini-3-pro-preview2.45official
104qwen3.7-max2.45official
106glm-5.22.48official
107minimax-m32.52official
108mimo-v2.52.525self run
109mimo-v2.6-flash2.55official
110gpt-oss-120b2.57official
111gemini-3.5-flash-lite2.58official
111gemini-3.8-flash2.58official
113claude-haiku-5.52.6official
113gpt-4o-mini2.6official
115grok-4.62.62official
115mistral-medium-32.62official
117gpt-5-mini2.65official
117llama-4-maverick2.65official
117nova-pro2.65official
120grok-4.1-fast2.72official
121claude-opus-4.52.75official
122gemini-3.7-flash2.77official
123glm-4.7-flash2.85official
124grok-32.865official
125gemma-4-31b-it2.88official
126gpt-5.3-chat3official
127gemini-2.0-flash-lite3.02official
128gemini-3.1-pro-preview3.03official
129gemini-3.6-flash3.05official
130gemini-3.1-flash-lite3.225official
131grok-4.53.52official
132gemini-3.5-flash3.88official
133gemini-3-flash-preview3.9official