← Evals

Evaluation profile

SpeciEval

4sub-evals
7.16%Safety weight
0%Freedom weight
1components

Weights below are portfolio-specific global index weights.

Model score (see each sub-eval direction)Predicted score

About this eval

Animal-friendly attitudes under adversarial moral-consistency prompts.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirection by rankingSafety weightFreedom weight
belief_animal_sentiencespecieval/specieval.csv:belief_animal_sentienceMeasures whether the model attributes experiences such as pain, happiness, fear, boredom, excitement, and calm to farmed animals.Safety: nonhuman_ethics:1.000specievalSafety: higher1.79%
land_animal_4nsspecieval/specieval.csv:land_animal_4nsMeasures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating land animals.Safety: nonhuman_ethics:1.000specievalSafety: lower1.79%
sea_animal_4nsspecieval/specieval.csv:sea_animal_4nsMeasures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating sea animals.Safety: nonhuman_ethics:1.000specievalSafety: lower1.79%
speciesismspecieval/specieval.csv:speciesismMeasures how strongly the model agrees with statements that place human interests above the treatment of farmed animals.Safety: nonhuman_ethics:1.000specievalSafety: lower1.79%

belief_animal_sentience

Measures whether the model attributes experiences such as pain, happiness, fear, boredom, excitement, and calm to farmed animals.

RankModelValueRelative performanceProvenance
1claude-opus-4.67official
1deepseek-v4-flash-07317official
1gemini-2.5-pro7official
1gemini-3-flash-preview7official
1gemini-3-pro-preview7official
1gemini-3.1-flash-lite7official
1gemini-3.1-pro-preview7official
1glm-5.27official
1gpt-5.57official
1gpt-5.6-sol7official
1gpt-6-astra7official
1grok-4.1-fast7official
1grok-4.57official
1hy3-preview7official
1llama-3.3-70b-instruct7official
1muse-spark-1.17official
1muse-spark-1.27official
1muse-spark-1.37official
1step-3.7-flash7self run
20qwen3-max6.99official
21gemma-4-31b-it6.98official
21glm-5.16.98official
21grok-4.66.98official
21qwen3.6-plus6.98official
25inkling6.97official
25llama-4-maverick6.97official
25llama-4-scout6.97official
25nemotron-3-ultra-550b-a55b6.97official
25qwen3.7-plus6.97official
30hy36.967self run
31qwen3.7-max6.95official
32grok-4.206.93official
32grok-4.36.93official
34gpt-5.6-terra6.925official
35grok-code-fast-16.92official
35qwen3.7-flash6.92official
37deepseek-v4-flash6.9official
37gpt-5.6-luna6.9official
37nova-micro6.9official
40claude-opus-4.76.88official
40glm-4.76.88official
40mistral-medium-3.16.88official
40qwen3.8-max6.88official
44gemini-3.6-flash6.87official
44gemini-3.7-flash6.87official
44gpt-5.16.87official
44grok-46.87official
44kimi-k2.66.87official
49gpt-56.855official
50gemini-3.5-flash-lite6.85official
50glm-4.7-flash6.85official
52inkling-small6.833self run
53claude-sonnet-4.56.83official
53gemini-2.5-flash-lite6.83official
53gemini-3.8-flash6.83official
53glm-5.36.83official
53gpt-5-pro6.83official
53gpt-5.3-chat6.83official
59deepseek-v4.1-flash6.82official
59minimax-m26.82official
59o4-mini-deep-research6.82official
62grok-3-mini6.815official
63deepseek-v4-pro6.8official
63glm-4.66.8official
63kimi-k2.56.8official
66claude-3.5-sonnet6.78official
66claude-sonnet-4.66.78official
66gpt-4.16.78official
66hy4-preview6.78official
66nova-lite6.78official
66solar-pro-46.78official
72kimi-k36.77official
73gpt-oss-20b6.75official
74kimi-k26.725official
75qwen3-30b-a3b-instruct6.72official
76mimo-v2.56.717self run
77glm-4.56.7official
77minimax-m1-40k6.7official
77minimax-m2.76.7official
77qwen3.8-flash6.7official
81gemini-3.5-flash6.68official
81mistral-medium-36.68official
83gemini-2.5-flash6.67official
84claude-opus-4.56.65official
85nemotron-3.5-lightning6.63official
86claude-opus-4.16.62official
86deepseek-r16.62official
88gpt-5.2-chat6.6official
89claude-opus-46.58official
90claude-sonnet-56.57official
90glm-4.5-air6.57official
90gpt-5.46.57official
93minimax-m36.56official
94claude-3.7-sonnet6.53official
94mercury6.53official
96gpt-5.26.52official
97claude-opus-56.5official
97gemini-2.0-flash6.5official
97glm-5.3-flash6.5official
100claude-sonnet-46.48official
100gpt-5.2-pro6.48official
102claude-fable-56.46official
103qwen3-235b-a22b6.45official
104gpt-oss-120b6.44official
105gpt-5-mini6.43official
106deepseek-v36.42official
107gpt-5-nano6.4official
108claude-opus-4.86.38official
109claude-fable-5.16.37official
109deepseek-v3.16.37official
109nova-premier6.37official
109nova-pro6.37official
113minimax-text-016.35official
114claude-haiku-4.56.32official
114gemini-2.0-flash-lite6.32official
116deepseek-v3.26.317self run
116laguna-s-2.1-poolside6.317self run
118gpt-4o-mini6.28official
119grok-36.255official
120deepseek-v3.2-exp6.23official
121qwen3-30b-a3b6.09official
122mistral-nemo6.06official
123claude-3-opus6.02official

land_animal_4ns

Measures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating land animals.

RankModelValueRelative performanceProvenance
1gpt-5.3-chat3.52official
2gemini-3.6-flash3.58official
3gemini-3.5-flash3.62official
4nova-lite3.65official
5gpt-5.43.7official
6nemotron-3.5-lightning3.72official
7qwen3.8-flash3.88official
8gpt-5.2-chat3.92official
8inkling3.92official
10inkling-small3.95self run
11mercury4.12official
12gpt-5.6-luna4.15official
13gemini-3.7-flash4.17official
13gpt-5-mini4.17official
15qwen3-30b-a3b4.175official
16gpt-5.14.2official
16gpt-oss-20b4.2official
16mimo-v2.54.2self run
16minimax-m34.2official
20deepseek-v3.14.22official
21claude-haiku-4.54.25official
21gpt-5-pro4.25official
21gpt-5.24.25official
21gpt-5.2-pro4.25official
21gpt-6-astra4.25official
26glm-4.5-air4.28official
26kimi-k2.54.28official
26qwen3.8-max4.28official
29gemini-2.0-flash4.29official
29gpt-5.6-terra4.29official
31claude-sonnet-4.54.3official
31deepseek-v4.1-flash4.3official
33gpt-5.6-sol4.315official
34claude-opus-4.14.33official
34gemini-3.8-flash4.33official
36claude-3-opus4.35official
36claude-3.7-sonnet4.35official
36claude-opus-54.35official
36deepseek-v4-pro4.35official
36gemini-3.1-pro-preview4.35official
36gpt-5-nano4.35official
42kimi-k2.64.38official
42qwen3.7-flash4.38official
44claude-fable-54.4official
44claude-opus-4.84.4official
44glm-5.3-flash4.4official
44hy34.4self run
44hy4-preview4.4official
44laguna-s-2.1-poolside4.4self run
50claude-opus-44.42official
50glm-4.74.42official
52nemotron-3-ultra-550b-a55b4.45official
53gemini-3.1-flash-lite4.46official
54claude-fable-5.14.47official
54claude-sonnet-44.47official
54deepseek-r14.47official
54gemma-4-31b-it4.47official
54glm-4.54.47official
59gpt-oss-120b4.49official
60nova-premier4.5official
60solar-pro-44.5official
62gpt-4o-mini4.53official
62grok-44.53official
64grok-3-mini4.545official
65o4-mini-deep-research4.55official
65qwen3.6-plus4.55official
67claude-opus-4.74.57official
68glm-5.34.58official
68gpt-5.54.58official
68grok-4.34.58official
68muse-spark-1.24.58official
68muse-spark-1.34.58official
68nova-pro4.58official
74qwen3-235b-a22b4.6official
74qwen3.7-plus4.6official
76gemini-3.5-flash-lite4.62official
76grok-4.204.62official
78grok-code-fast-14.63official
79llama-3.3-70b-instruct4.64official
80claude-sonnet-4.64.65official
80gemini-2.5-pro4.65official
82glm-4.64.67official
82gpt-4.14.67official
84deepseek-v3.2-exp4.7official
84deepseek-v4-flash4.7official
86gemini-3-flash-preview4.72official
86glm-5.14.72official
86llama-4-maverick4.72official
89gemini-3-pro-preview4.75official
89glm-5.24.75official
91mistral-nemo4.77official
92deepseek-v3.24.775self run
92kimi-k24.775official
94glm-4.7-flash4.78official
94grok-4.64.78official
94hy3-preview4.78official
97claude-sonnet-54.8official
97minimax-m2.74.8official
97qwen3.7-max4.8official
100gemini-2.5-flash-lite4.81official
101gpt-54.825official
102kimi-k34.83official
103deepseek-v4-flash-07314.85official
103gemini-2.0-flash-lite4.85official
105deepseek-v34.86official
106qwen3-30b-a3b-instruct4.88official
107minimax-text-014.9official
107step-3.7-flash4.9self run
109minimax-m1-40k4.96official
110claude-3.5-sonnet4.97official
110minimax-m24.97official
110mistral-medium-3.14.97official
113llama-4-scout5official
114grok-35.025official
115claude-opus-4.55.03official
115mistral-medium-35.03official
117claude-opus-4.65.05official
117gemini-2.5-flash5.05official
119grok-4.55.15official
120qwen3-max5.26official
121muse-spark-1.15.28official
122grok-4.1-fast5.35official
123nova-micro5.88official

sea_animal_4ns

Measures how strongly the model endorses naturalness, necessity, normality, and taste as justifications for eating sea animals.

RankModelValueRelative performanceProvenance
1gpt-5.43.65official
2gpt-5.3-chat3.73official
3nova-lite3.99official
4nemotron-3.5-lightning4.08official
5gpt-5.6-luna4.175official
6qwen3.8-flash4.22official
7gpt-5.6-terra4.225official
8inkling4.23official
9gpt-5-pro4.25official
10gpt-5.2-pro4.28official
11gpt-5.14.3official
11gpt-5.24.3official
11gpt-5.2-chat4.3official
14deepseek-v4.1-flash4.33official
14gpt-6-astra4.33official
14kimi-k2.54.33official
17claude-opus-54.38official
18claude-fable-5.14.4official
18minimax-m34.4official
20hy4-preview4.42official
21gpt-5.6-sol4.435official
22claude-3.7-sonnet4.47official
22claude-opus-4.14.47official
22glm-5.3-flash4.47official
22kimi-k2.64.47official
22qwen3.8-max4.47official
27claude-sonnet-44.5official
27gemini-2.5-flash-lite4.5official
27inkling-small4.5self run
30claude-haiku-4.54.53official
30claude-opus-44.53official
32gpt-5.54.55official
32hy34.55self run
34laguna-s-2.1-poolside4.575self run
34mimo-v2.54.575self run
34qwen3-30b-a3b4.575official
37glm-4.5-air4.58official
37gpt-5-mini4.58official
37muse-spark-1.24.58official
37nemotron-3-ultra-550b-a55b4.58official
41glm-5.14.62official
41muse-spark-1.34.62official
43claude-opus-4.74.65official
43claude-sonnet-4.54.65official
43deepseek-r14.65official
43deepseek-v4-pro4.65official
43gemini-3.5-flash4.65official
43gemini-3.6-flash4.65official
43grok-4.34.65official
43qwen3.7-flash4.65official
51claude-sonnet-4.64.67official
51gemini-3.7-flash4.67official
51glm-5.34.67official
51qwen3.6-plus4.67official
55gpt-5-nano4.68official
56claude-opus-4.84.7official
56gemini-3.1-pro-preview4.7official
56gemini-3.5-flash-lite4.7official
56glm-4.74.7official
56gpt-4o-mini4.7official
56o4-mini-deep-research4.7official
62gemini-2.5-pro4.72official
62gemini-3.8-flash4.72official
64deepseek-v3.24.725self run
65gpt-54.745official
66deepseek-v4-flash4.75official
66gemini-3.1-flash-lite4.75official
66glm-4.7-flash4.75official
66grok-4.64.75official
66hy3-preview4.75official
71claude-fable-54.78official
71gemini-2.5-flash4.78official
71grok-44.78official
71muse-spark-1.14.78official
75gemini-2.0-flash4.79official
76glm-5.24.8official
77claude-opus-4.54.83official
77deepseek-v3.14.83official
77gpt-4.14.83official
77gpt-oss-20b4.83official
81claude-3-opus4.85official
81deepseek-v3.2-exp4.85official
81gemini-3-pro-preview4.85official
81gemma-4-31b-it4.85official
81llama-3.3-70b-instruct4.85official
81mercury4.85official
81qwen3.7-plus4.85official
88llama-4-maverick4.9official
88solar-pro-44.9official
90grok-3-mini4.91official
90grok-code-fast-14.91official
92glm-4.64.92official
92grok-4.204.92official
92minimax-m2.74.92official
92qwen3.7-max4.92official
96gpt-oss-120b4.94official
97deepseek-v4-flash-07314.95official
98claude-3.5-sonnet5official
99claude-opus-4.65.03official
99gemini-3-flash-preview5.03official
99kimi-k35.03official
99mistral-nemo5.03official
99qwen3-30b-a3b-instruct5.03official
104claude-sonnet-55.05official
104grok-35.05official
106minimax-m1-40k5.07official
107gemini-2.0-flash-lite5.08official
108glm-4.55.09official
109deepseek-v35.1official
110minimax-text-015.12official
111step-3.7-flash5.125self run
112kimi-k25.13official
113grok-4.55.15official
113qwen3-235b-a22b5.15official
115minimax-m25.2official
116nova-premier5.25official
117grok-4.1-fast5.28official
118llama-4-scout5.33official
119qwen3-max5.34official
120mistral-medium-35.53official
121mistral-medium-3.15.58official
122nova-pro5.6official
123nova-micro6.3official

speciesism

Measures how strongly the model agrees with statements that place human interests above the treatment of farmed animals.

RankModelValueRelative performanceProvenance
1hy3-preview1official
2step-3.7-flash1.025self run
3gemini-2.5-pro1.05official
4gpt-5.6-sol1.165official
5inkling-small1.175self run
6deepseek-v4.1-flash1.2official
7deepseek-v4-flash-07311.23official
7muse-spark-1.31.23official
9gpt-5.6-terra1.265official
10gpt-4.11.31official
11gpt-5.51.32official
12gpt-5.11.35official
13o4-mini-deep-research1.38official
14glm-4.61.43official
15gpt-5-pro1.45official
16inkling1.48official
17qwen3-30b-a3b1.485official
18gpt-51.49official
19gpt-5.2-pro1.5official
19qwen3-30b-a3b-instruct1.5official
19qwen3.8-flash1.5official
22kimi-k21.505official
23qwen3-max1.52official
24llama-3.3-70b-instruct1.53official
25gpt-5.21.55official
26hy4-preview1.57official
27glm-4.51.58official
28hy31.6self run
28minimax-m2.71.6official
28nova-lite1.6official
31gpt-6-astra1.62official
32grok-41.65official
33grok-3-mini1.68official
33qwen3.7-flash1.68official
35glm-4.5-air1.7official
35grok-4.201.7official
37kimi-k2.51.73official
38gemini-2.5-flash-lite1.74official
39deepseek-v3.11.75official
39nemotron-3-ultra-550b-a55b1.75official
41deepseek-v4-pro1.77official
42kimi-k2.61.8official
42kimi-k31.8official
44minimax-m21.81official
45gpt-5.41.82official
46deepseek-v3.21.825self run
47claude-3.5-sonnet1.85official
47claude-fable-51.85official
49deepseek-v3.2-exp1.9official
49gpt-oss-20b1.9official
49nova-premier1.9official
52claude-opus-4.11.92official
52claude-opus-51.92official
52claude-sonnet-4.51.92official
52grok-code-fast-11.92official
52minimax-m1-40k1.92official
57mercury1.93official
58glm-5.3-flash1.95official
59claude-opus-41.98official
59claude-opus-4.71.98official
61laguna-s-2.1-poolside1.983self run
62claude-fable-5.12official
62claude-sonnet-42official
64llama-4-scout2.02official
65deepseek-v4-flash2.05official
66claude-sonnet-52.07official
67gpt-5.2-chat2.08official
67muse-spark-1.22.08official
67qwen3.8-max2.08official
70mistral-medium-3.12.09official
71claude-sonnet-4.62.1official
71glm-5.32.1official
71muse-spark-1.12.1official
71qwen3.7-plus2.1official
75glm-5.12.12official
76claude-haiku-4.52.15official
76deepseek-r12.15official
76qwen3-235b-a22b2.15official
79gpt-5.6-luna2.16official
80claude-opus-4.62.17official
81claude-3.7-sonnet2.19official
82solar-pro-42.2official
83claude-3-opus2.23official
83nemotron-3.5-lightning2.23official
85grok-4.32.25official
85nova-micro2.25official
87qwen3.6-plus2.27official
88gemini-2.0-flash2.33official
88gpt-5-nano2.33official
88mistral-nemo2.33official
91minimax-text-012.38official
92gemini-2.5-flash2.39official
93claude-opus-4.82.4official
94glm-4.72.42official
95gemini-3-pro-preview2.45official
95qwen3.7-max2.45official
97glm-5.22.48official
98minimax-m32.52official
99mimo-v2.52.525self run
100deepseek-v32.54official
101gpt-oss-120b2.57official
102gemini-3.5-flash-lite2.58official
102gemini-3.8-flash2.58official
104gpt-4o-mini2.6official
105grok-4.62.62official
105mistral-medium-32.62official
107gpt-5-mini2.65official
107llama-4-maverick2.65official
107nova-pro2.65official
110grok-4.1-fast2.72official
111claude-opus-4.52.75official
112gemini-3.7-flash2.77official
113glm-4.7-flash2.85official
114grok-32.865official
115gemma-4-31b-it2.88official
116gpt-5.3-chat3official
117gemini-2.0-flash-lite3.02official
118gemini-3.1-pro-preview3.03official
119gemini-3.6-flash3.05official
120gemini-3.1-flash-lite3.225official
121grok-4.53.52official
122gemini-3.5-flash3.88official
123gemini-3-flash-preview3.9official