← Evals

Evaluation profile

Enkrypt AI Safety Leaderboard

4sub-evals
2.41%Safety weight
5.82%Freedom weight
3components

Weights below are portfolio-specific global index weights.

Model score (higher is better)Predicted score

About this eval

Resistance to Enkrypt bias, CBRN, harmful-content, and toxicity red-team tests.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirection by rankingSafety weightFreedom weight
bias_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:bias_attack_non_success_rateMeasures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.Safety: human_rights_systemic_harm:0.800|ordinary_harm_misuse_resistance:0.200enkrypt-aiSafety: higher1.02%
cbrn_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:cbrn_attack_non_success_rateMeasures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.Safety: ordinary_harm_misuse_resistance:0.400|responsible_agency_control:0.600 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.426%1.94%
harmful_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:harmful_attack_non_success_rateMeasures how often Enkrypt's harmful-content attacks do not succeed.Safety: human_rights_systemic_harm:0.150|ordinary_harm_misuse_resistance:0.700|responsible_agency_control:0.150 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.41%1.94%
toxicity_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:toxicity_attack_non_success_rateMeasures how often Enkrypt's toxicity-generation attacks do not succeed.Safety: human_rights_systemic_harm:0.350|ordinary_harm_misuse_resistance:0.650 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.556%1.94%

bias_attack_non_success_rate

Measures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2mistral-nemo-minitron-8b-instruct92.51official
3mistral-7b86.56official
4smollm-360m-instruct76.23official
5claude-3-opus74.42official
6claude-sonnet-570.54official
7komodo-7b-base65.63official
8mistral-large-latest60.47official
9gpt-559.95official
10claude-3.5-haiku56.59official
11minimax-m2.754.52official
12llama-3.1-nemotron-instruct-70b54.26official
13llama-3.2-90b-vision-instruct52.2official
14claude-opus-4.851.94official
14minimax-m251.94official
16claude-3.5-sonnet51.68official
17qwen3.5-397b-a17b50.39official
18muse-spark-1.149.87official
19claude-sonnet-4.547.55official
19sarvam-147.55official
21open-codestral-mamba46.51official
22hy343.93official
23gpt-5.143.67official
24claude-opus-443.41official
25claude-sonnet-442.89official
26dolphin-2.5-mixtral-8x7b41.6official
26gpt-5.241.6official
28gpt-5-mini41.09official
29qwen3.5-122b-a10b40.31official
30gpt-oss-120b39.79official
31qwen3.5-27b39.53official
32gpt-5.6-terra39.28official
33gpt-5-nano39.02official
33inkling39.02official
35gemini-2.5-pro38.85official
36qwen2.5-72b-instruct38.63official
37gpt-5.538.5official
38powerlm-3b37.47official
39mistral-7b-instruct36.61official
40qwen2.5-7b-instruct35.53official
41claude-haiku-4.535.14official
42smollm2-360m-instruct33.59official
43gemma-2-27b-it31.78official
44lfm2.1-2b31.52official
44phi-231.52official
46glm-4.530.49official
47powermoe-3b29.2official
48kimi-k228.81official
49foundation-sec-8b-instruct28.68official
50gpt-5.6-sol27.91official
51gpt-oss-20b27.65official
52qwen3-vl-235b-a22b-instruct27.39official
53qwen3.5-35b-a3b26.61official
54gpt-4-turbo26.36official
54lfm2-700m26.36official
54sea-lion-v1-7b-it26.36official
57apriel-v1.5-15b-thinker26.1official
58gemma-2-2b-it25.84official
59gpt-oss-safeguard-20b25.58official
60deepseek-r125.06official
61gemini-2.5-flash24.84official
62cogito-v2.124.55official
63rakutenai-7b-chat24.29official
64claude-opus-4.723.51official
64glm-5.123.51official
64o1-preview23.51official
67deepseek-v3.2-exp23official
67jamba-1.7-large23official
67nexusraven-v2-13b23official
67nova-premier23official
67o323official
72claude-opus-4.622.74official
73qwen2-57b-a14b-instruct22.22official
73qwen3-235b-a22b-instruct22.22official
73smaug-llama-3-70b-instruct22.22official
76gpt-5.6-luna21.96official
77claude-3-sonnet21.71official
78deepseek-v3.121.19official
78starling-lm-7b-beta21.19official
80gpt-4o20.67official
80hunyuan-a13b-instruct20.67official
82gemma-7b-it20.41official
82internlm2-chat-20b20.41official
84o4-mini20.16official
85qwen2-7b-instruct19.64official
86grok-319.38official
86lfm2-350m19.38official
88apertus-8b-instruct19.12official
88o1-mini19.12official
88qwen1.5-14b-chat19.12official
88reflection-llama-3.1-70b19.12official
92claude-sonnet-4.618.86official
93granite-4.0-h-small18.6official
93llama-2-7b-chat18.6official
93llama-3-8b-instruct-rr18.6official
96glm-4-9b-chat18.35official
96llama-3.1-8b-instruct18.35official
98apertus-70b-instruct18.09official
98jamba-1.7-mini18.09official
98o3-mini18.09official
101gpt-4.117.83official
101longwriter-glm4-9b17.83official
101o117.83official
104llama-3-8b-instruct17.19official
105gemma-3-27b-it17.05official
106aya-23-35b16.8official
106olmo-7b-instruct-hf16.8official
106phi-416.8official
109falcon-h1-0.5b-instruct16.54official
109llama-3-8b-instruct-mopeymule16.54official
111magistral-small16.54official
112jamba-large-1.616.28official
112kimi-k2.516.28official
112meta-secalign-8b16.28official
112qwen2.5-max16.28official
116llama-3-70b-instruct16.02official
117claude-3.7-sonnet16.02official
117gemma-2-9b-it16.02official
117gemma-3-4b16.02official
117qwen2.5-14b-instruct-1m16.02official
121magistral-medium15.76official
121qwen2-72b-instruct15.76official
123gpt-4.1-mini15.5official
123zephyr-7b-beta15.5official
125c4ai-aya-expanse-32b15.25official
125gpt-415.25official
125mistral-small-315.25official
125nova-pro15.25official
129aya-expanse-8b14.99official
129granite-4.0-h-tiny14.99official
129granite-4.0-micro14.99official
129nova-lite14.99official
129olmoe-1b-7b-instruct14.99official
129phi-3.5-moe-instruct14.99official
135deepseek-chat14.73official
135deepseek-v4-flash14.73official
135deepseek-v4-pro14.73official
135gemini-1.5-pro14.73official
135qwen2-vl-72b-instruct14.73official
135yi-1.5-9b-chat14.73official
141falcon-mamba-7b-instruct14.47official
141qwen2.5-32b-instruct14.47official
143mistral-small-latest14.21official
144ai21-jamba-1.5-large-v1.013.95official
144gemini-2.0-flash-lite-preview13.95official
144gemma-sea-lion-v3-9b-it13.95official
144granite-4.0-h-micro13.95official
144llama-4-scout13.95official
149gemini-2.0-flash13.7official
149gpt-4o-mini13.7official
149llama-3.1-70b-instruct13.7official
149phi-3-mini-128k-instruct13.7official
149phi-3-small-128k-instruct13.7official
149phi-4-mini13.7official
155deepseek-v313.18official
155gemma-3-12b13.18official
155granite-3.2-2b-instruct13.18official
155krutrim-2-instruct13.18official
155llama-3.2-instruct-11b-vision13.18official
155phi-3-mini-4k-instruct13.18official
155qwen2.5-7b-instruct-1m13.18official
155rakutenai-7b-instruct13.18official
155wizardlm-2-8x22b13.18official
164claude-3-haiku12.92official
164gemma-4-26b-a4b-it12.92official
164gpt-4.1-nano12.92official
164gpt-5.412.92official
164grok-4.312.92official
164llama-3.1-405b-instruct12.92official
164nova-micro12.92official
164qwen2.5-14b-instruct12.92official
172glm-4.612.66official
172granite-3.0-8b-instruct12.66official
172jamba-mini-1.612.66official
172k2-chat12.66official
172phi-3-medium-4k-instruct12.66official
172qwq-32b-preview12.66official
178granite-3.2-8b-instruct12.4official
178grok-412.4official
178llama-2-70b-chat12.4official
181granite-3.2-8b-instruct-preview12.27official
182ai21-jamba-1.5-mini-v1.012.14official
182gemini-1.5-flash12.14official
182grok-4.1-fast12.14official
182phi-3-small-8k-instruct12.14official
186dbrx-instruct11.89official
186glm-5-turbo11.89official
186granite-3.1-8b-instruct11.89official
186mixtral-8x22b-instruct11.89official
186phi-3-medium-128k-instruct11.89official
191seallm-7b-v211.63official
192mixtral-8x7b-instruct11.37official
192phi-3.5-mini-instruct11.37official
194llama-2-13b-chat11.11official
194llama-3.2-3b-instruct11.11official
194llama-3.3-70b-instruct11.11official
194nous-hermes-2-mixtral-8x7b-dpo11.11official
194seallms-v3-7b-chat11.11official
199llama-3.1-tulu-3-8b10.85official
200granite-3.0-3b-a800m-instruct10.59official
200olmo-2-7b-instruct10.59official
200qwen2.5-3b-instruct10.59official
203gemma-4-12b10.34official
203granite-3.1-2b-instruct10.34official
203llama-4-maverick10.34official
206deepseek-r1-distill-qwen-7b10.08official
206gpt-3.5-turbo10.08official
208amazon-titan-text-express-v19.82official
208llama-3.1-tulu-3-8b-dpo9.82official
208llama-3.1-tulu-3-8b-sft9.82official
211aya-23-8b9.56official
211deepseek-llm-67b-chat9.56official
211granite-3.0-2b-instruct9.56official
214ai21-jamba-instruct-v1.09.3official
214qwen3-235b-a22b9.3official
216sarvam-105b9.04official
217gemma-4-31b-it8.53official
217qwen3-30b-a3b8.53official
219deepseek-r1-distill-llama-8b8.27official
219granite-3.1-3b-a800m-instruct8.27official
221qwen2.5-1.5b-instruct8.01official
222h2o-danube3-500m-chat7.49official
223h2o-danube3-4b-chat6.98official
223qwq-32b6.98official
225codellama-7b-instruct-hf6.72official
226gemma-4-e4b6.2official
227granite-3.0-1b-a400m-instruct5.43official
228sarvam-30b4.39official
228smollm2-1.7b-instruct4.39official
230foundation-sec-8b4.13official
230gemma-2b-it4.13official
230llama-3.2-1b-instruct4.13official
233qwen2.5-0.5b-instruct3.88official
233smollm-1.7b-instruct3.88official
235qwen3-8b2.33official
236command-a1.81official
237gemma-4-e2b1.55official
238command-r-plus1.16official
239command-r7b0.52official

cbrn_attack_non_success_rate

Measures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2hy399.5official
3claude-3.5-sonnet98.17official
4gpt-5-nano98official
5llama-3-8b-instruct-mopeymule97.33official
6meta-secalign-8b97.17official
7claude-3.5-haiku97official
8gpt-5-mini96.83official
9claude-3-sonnet96.33official
9claude-opus-4.796.33official
9o196.33official
12claude-3-opus95.67official
12komodo-7b-base95.67official
14o1-preview95.5official
14qwq-32b-preview95.5official
16llama-3-8b-instruct-rr95.33official
17aya-expanse-8b95.17official
17claude-3.7-sonnet95.17official
17gemma-2-9b-it95.17official
20phi-495official
21gpt-4-turbo94.67official
21sea-lion-v1-7b-it94.67official
23amazon-titan-text-express-v194.5official
23apriel-v1.5-15b-thinker94.5official
23nova-pro94.5official
26c4ai-aya-expanse-32b94.33official
26gemma-2b-it94.33official
26longwriter-glm4-9b94.33official
29gpt-4o93.83official
29krutrim-2-instruct93.83official
31dolphin-2.5-mixtral-8x7b93.67official
31muse-spark-1.193.67official
33gpt-5.193.5official
33wizardlm-2-8x22b93.5official
35gemini-2.0-flash93.33official
35internlm2-chat-20b93.33official
35mistral-nemo-minitron-8b-instruct93.33official
38qwq-32b93official
39gpt-592.89official
40claude-3-haiku92.67official
40nova-lite92.67official
40o1-mini92.67official
43claude-sonnet-592.5official
43deepseek-r1-distill-qwen-7b92.5official
45qwen2.5-max92.33official
46llama-3.1-tulu-3-8b-dpo92.17official
47claude-opus-4.892official
47gpt-4o-mini92official
47llama-3.1-tulu-3-8b92official
47phi-3.5-mini-instruct92official
51hunyuan-a13b-instruct91.83official
51llama-2-13b-chat91.83official
53aya-23-35b91.67official
53llama-3.2-90b-vision-instruct91.67official
53o3-mini91.67official
56nova-premier91.5official
56smaug-llama-3-70b-instruct91.5official
58claude-opus-4.691.33official
58gemini-2.0-flash-lite-preview91.33official
58gpt-491.33official
58inkling91.33official
62deepseek-chat91.17official
62jamba-mini-1.691.17official
62llama-4-maverick91.17official
62zephyr-7b-beta91.17official
66ai21-jamba-1.5-large-v1.091official
67apertus-70b-instruct90.83official
67aya-23-8b90.83official
67deepseek-r1-distill-llama-8b90.83official
67llama-3.1-nemotron-instruct-70b90.83official
67llama-3.2-instruct-11b-vision90.83official
72gemma-3-12b90.67official
72mistral-small-390.67official
72mixtral-8x22b-instruct90.67official
75nexusraven-v2-13b90.5official
75sarvam-105b90.5official
77foundation-sec-8b-instruct90.33official
77gemma-3-27b-it90.33official
77granite-3.1-8b-instruct90.33official
77nova-micro90.33official
77o390.33official
77qwen2-72b-instruct90.33official
83gemini-1.5-pro90.17official
83granite-4.0-micro90.17official
83llama-3.1-405b-instruct90.17official
83mistral-large-latest90.17official
87granite-3.2-8b-instruct-preview90.09official
88gpt-4.190official
88phi-3-mini-128k-instruct90official
90gpt-5.289.83official
90llama-2-7b-chat89.83official
90mistral-7b89.83official
93gemma-2-27b-it89.67official
93h2o-danube3-4b-chat89.67official
93olmo-2-7b-instruct89.67official
93phi-3-medium-4k-instruct89.67official
93qwen2.5-72b-instruct89.67official
98claude-haiku-4.589.5official
98gpt-4.1-nano89.5official
98phi-3-mini-4k-instruct89.5official
101granite-3.1-3b-a800m-instruct89.33official
101qwen2.5-32b-instruct89.33official
101sarvam-30b89.33official
104gemma-sea-lion-v3-9b-it89.17official
104qwen2.5-14b-instruct89.17official
106ai21-jamba-instruct-v1.089official
107starling-lm-7b-beta88.83official
107yi-1.5-9b-chat88.83official
109gpt-4.1-mini88.67official
109granite-3.2-8b-instruct88.67official
109granite-4.0-h-small88.67official
109seallm-7b-v288.67official
113gemma-3-4b88.5official
113llama-2-70b-chat88.5official
113llama-3.1-tulu-3-8b-sft88.5official
113sarvam-188.5official
113smollm2-360m-instruct88.5official
118cogito-v2.188.33official
118granite-3.1-2b-instruct88.33official
118jamba-large-1.688.33official
118llama-3.2-1b-instruct88.33official
118rakutenai-7b-instruct88.33official
123mistral-small-latest88.17official
123nous-hermes-2-mixtral-8x7b-dpo88.17official
125grok-388official
126llama-3-70b-instruct87.83official
126llama-3.3-70b-instruct87.83official
126llama-4-scout87.83official
129granite-3.2-2b-instruct87.5official
129granite-4.0-h-micro87.5official
129phi-3-small-8k-instruct87.5official
129smollm-360m-instruct87.5official
133deepseek-v387.33official
133granite-4.0-h-tiny87.33official
133o4-mini87.33official
133phi-3-medium-128k-instruct87.33official
133phi-3.5-moe-instruct87.33official
138gpt-3.5-turbo87.17official
138phi-3-small-128k-instruct87.17official
140claude-sonnet-4.587official
140k2-chat87official
140qwen2.5-3b-instruct87official
140qwen2.5-7b-instruct-1m87official
140reflection-llama-3.1-70b87official
145granite-3.0-8b-instruct86.83official
146gemini-1.5-flash86.67official
146h2o-danube3-500m-chat86.67official
146mixtral-8x7b-instruct86.67official
149llama-3.1-70b-instruct86.5official
149qwen1.5-14b-chat86.5official
151mistral-7b-instruct86.39official
152phi-4-mini86.33official
152qwen2-57b-a14b-instruct86.33official
154gpt-oss-120b86.17official
155ai21-jamba-1.5-mini-v1.086official
155gemma-2-2b-it86official
155minimax-m286official
158apertus-8b-instruct85.83official
158llama-3-8b-instruct85.83official
160llama-3.2-3b-instruct85.67official
161phi-285.33official
162dbrx-instruct85.17official
162qwen2.5-1.5b-instruct85.17official
162qwen2.5-14b-instruct-1m85.17official
165minimax-m2.785official
166claude-sonnet-4.684.67official
166qwen2-vl-72b-instruct84.67official
166qwen3-235b-a22b-instruct84.67official
166seallms-v3-7b-chat84.67official
170olmoe-1b-7b-instruct84.5official
171gemini-2.5-flash84.17official
172llama-3.1-8b-instruct83.91official
173falcon-mamba-7b-instruct83.83official
173granite-3.0-1b-a400m-instruct83.83official
175rakutenai-7b-chat83.67official
176deepseek-llm-67b-chat83.5official
176qwen2-7b-instruct83.5official
176qwen2.5-7b-instruct83.5official
179gpt-5.483.33official
180magistral-medium83.17official
181command-r-plus83.16official
182deepseek-v4-pro82.67official
183qwen3-vl-235b-a22b-instruct82.5official
184glm-4-9b-chat82.33official
185granite-3.0-2b-instruct82.17official
186gpt-oss-safeguard-20b82official
186granite-3.0-3b-a800m-instruct82official
188deepseek-v3.181.67official
189deepseek-v3.2-exp81.5official
190kimi-k281.44official
191open-codestral-mamba81.33official
191qwen2.5-0.5b-instruct81.33official
193gpt-oss-20b81official
194gpt-5.6-sol80.83official
194powerlm-3b80.83official
194smollm-1.7b-instruct80.83official
197magistral-small80.34official
198gpt-5.6-terra80official
199lfm2.1-2b79.5official
200gpt-5.579.33official
201falcon-h1-0.5b-instruct79.17official
201gemini-2.5-pro79.17official
203glm-5.179official
203lfm2-700m79official
203olmo-7b-instruct-hf79official
206gemma-7b-it78.83official
207smollm2-1.7b-instruct78.5official
208gpt-5.6-luna77.83official
209glm-4.577.67official
210foundation-sec-8b77.33official
211grok-476.83official
212glm-5-turbo76official
213qwen3.5-397b-a17b75.5official
214jamba-1.7-mini75.33official
215claude-opus-475official
216glm-4.674.67official
217jamba-1.7-large73.17official
217qwen3.5-35b-a3b73.17official
219command-a72.67official
220powermoe-3b72.33official
221grok-4.1-fast71.83official
222command-r7b71.33official
223qwen3.5-27b71.17official
224codellama-7b-instruct-hf70.5official
225deepseek-v4-flash70.33official
226qwen3.5-122b-a10b70.17official
227lfm2-350m69.67official
228gemma-4-e2b68official
229qwen3-8b67official
230gemma-4-e4b66.83official
230kimi-k2.566.83official
232gemma-4-31b-it66.67official
233gemma-4-12b65.5official
234grok-4.365.17official
235claude-sonnet-463official
235gemma-4-26b-a4b-it63official
237deepseek-r146.5official
238qwen3-30b-a3b44.33official
239qwen3-235b-a22b43.33official

harmful_attack_non_success_rate

Measures how often Enkrypt's harmful-content attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1claude-sonnet-5100official
1gpt-5.4100official
1gpt-5.6-luna100official
1muse-spark-1.1100official
6claude-opus-4.699.44official
6claude-opus-4.799.44official
6claude-opus-4.899.44official
6claude-sonnet-499.44official
6claude-sonnet-4.599.44official
6claude-sonnet-4.699.44official
6gpt-5.599.44official
6gpt-5.6-sol99.44official
14claude-haiku-4.598.89official
14claude-opus-498.89official
14qwen3.5-27b98.89official
17claude-3.7-sonnet98.33official
17o1-preview98.33official
17qwen3.5-35b-a3b98.33official
20gpt-5.6-terra97.78official
20inkling97.78official
20minimax-m2.797.78official
20qwen3.5-122b-a10b97.78official
24claude-3.5-sonnet97.5official
25qwen3.5-397b-a17b97.22official
26phi-496.67official
27o196.11official
27sarvam-105b96.11official
29gemma-4-12b95.56official
30gemma-4-26b-a4b-it95official
30grok-4.395official
32claude-3.5-haiku94.44official
32kimi-k2.594.44official
32meta-secalign-8b94.44official
35gemma-4-31b-it93.89official
35o393.89official
37claude-3-sonnet93.33official
37gpt-593.33official
39gpt-5-nano92.78official
39hy392.78official
39o1-mini92.78official
42claude-3-opus92.22official
42llama-3-8b-instruct-mopeymule92.22official
44gpt-5.291.67official
44granite-4.0-h-tiny91.67official
46glm-5.191.11official
46gpt-5-mini91.11official
46llama-3.2-1b-instruct91.11official
49minimax-m289.44official
50llama-3-8b-instruct89.16official
51glm-5-turbo88.89official
51granite-4.0-micro88.89official
53cogito-v2.188.33official
53llama-2-13b-chat88.33official
55llama-2-70b-chat87.78official
55llama-3-70b-instruct87.78official
57claude-3-haiku87.22official
57qwen2-72b-instruct87.22official
59foundation-sec-8b-instruct86.67official
59gemma-4-e2b86.67official
59olmo-2-7b-instruct86.67official
62krutrim-2-instruct86.11official
62llama-3.1-tulu-3-8b-sft86.11official
64gemma-4-e4b85.56official
64gpt-oss-120b85.56official
64granite-4.0-h-small85.56official
64llama-2-7b-chat85.56official
64llama-3.2-instruct-11b-vision85.56official
69llama-3.2-3b-instruct85official
69o4-mini85official
71nova-lite84.44official
71o3-mini84.44official
73gpt-5.183.89official
73sarvam-30b83.89official
75llama-3-8b-instruct-rr83.33official
76llama-3.1-tulu-3-8b82.78official
77llama-4-maverick82.22official
77nova-pro82.22official
79k2-chat81.67official
79llama-3.1-tulu-3-8b-dpo81.67official
81gemma-2-9b-it81.11official
82gpt-480.56official
82gpt-oss-20b80.56official
82nova-premier80.56official
85qwen3-235b-a22b-instruct80official
86nova-micro79.44official
86phi-3.5-mini-instruct79.44official
88kimi-k279.16official
89amazon-titan-text-express-v178.89official
89apriel-v1.5-15b-thinker78.89official
89granite-4.0-h-micro78.89official
92deepseek-v4-pro77.78official
93gemma-2b-it77.22official
94deepseek-v4-flash76.67official
95gpt-4-turbo76.11official
95granite-3.1-3b-a800m-instruct76.11official
95phi-3.5-moe-instruct76.11official
98phi-3-mini-4k-instruct75.56official
99gpt-4.175official
99granite-3.0-8b-instruct75official
99llama-3.2-90b-vision-instruct75official
99qwq-32b-preview75official
103gemma-2-2b-it74.44official
103gpt-oss-safeguard-20b74.44official
105gemma-2-27b-it73.89official
105phi-3-medium-128k-instruct73.89official
107qwen2.5-72b-instruct73.62official
108apertus-70b-instruct73.33official
108codellama-7b-instruct-hf73.33official
108llama-3.1-405b-instruct73.33official
108llama-3.1-8b-instruct73.33official
112llama-3.1-nemotron-instruct-70b72.22official
112phi-3-mini-128k-instruct72.22official
114granite-3.1-8b-instruct71.67official
114internlm2-chat-20b71.67official
114reflection-llama-3.1-70b71.67official
117phi-3-small-8k-instruct71.11official
118komodo-7b-base70.56official
118qwen3-vl-235b-a22b-instruct70.56official
120qwen2.5-14b-instruct69.44official
120smaug-llama-3-70b-instruct69.44official
122c4ai-aya-expanse-32b68.89official
123gemini-1.5-pro68.33official
123llama-4-scout68.33official
125gpt-4o67.78official
125phi-3-small-128k-instruct67.78official
127aya-expanse-8b67.22official
127qwen2.5-max67.22official
129llama-3.3-70b-instruct66.11official
130phi-3-medium-4k-instruct64.44official
131gemini-2.0-flash63.89official
132grok-4.1-fast63.33official
133llama-3.1-70b-instruct62.78official
134qwen2-7b-instruct62.22official
134qwen3-8b62.22official
136granite-3.0-2b-instruct61.67official
136qwen2.5-14b-instruct-1m61.67official
136seallm-7b-v261.67official
136seallms-v3-7b-chat61.67official
140gpt-4o-mini60.56official
140phi-4-mini60.56official
142gpt-4.1-nano60official
142qwen2.5-32b-instruct60official
144granite-3.0-1b-a400m-instruct59.44official
145deepseek-v3.158.89official
145granite-3.0-3b-a800m-instruct58.89official
147deepseek-chat58.33official
147gpt-4.1-mini58.33official
147qwen2-vl-72b-instruct58.33official
150longwriter-glm4-9b57.78official
150qwen1.5-14b-chat57.78official
150wizardlm-2-8x22b57.78official
153gemma-3-27b-it56.11official
154gemini-1.5-flash55.56official
154gemma-sea-lion-v3-9b-it55.56official
154lfm2-700m55.56official
154lfm2.1-2b55.56official
154qwen2-57b-a14b-instruct55.56official
154sea-lion-v1-7b-it55.56official
160glm-4.655official
160granite-3.1-2b-instruct55official
160granite-3.2-2b-instruct55official
163gemini-2.5-flash54.63official
164gemma-7b-it54.44official
164mistral-nemo-minitron-8b-instruct54.44official
164qwen2.5-1.5b-instruct54.44official
164smollm2-1.7b-instruct54.44official
168gemini-2.0-flash-lite-preview53.89official
168mixtral-8x22b-instruct53.89official
170apertus-8b-instruct53.33official
171gemma-3-12b52.78official
172deepseek-v352.22official
172glm-4.552.22official
172qwen2.5-7b-instruct-1m52.22official
175nexusraven-v2-13b50.56official
176granite-3.2-8b-instruct50official
177granite-3.2-8b-instruct-preview49.45official
178jamba-large-1.649.44official
179command-a48.89official
179gemma-3-4b48.89official
181glm-4-9b-chat48.33official
181smollm-1.7b-instruct48.33official
183starling-lm-7b-beta47.78official
184deepseek-v3.2-exp46.67official
184qwen3-235b-a22b46.67official
186aya-23-35b46.11official
186jamba-1.7-large46.11official
188falcon-mamba-7b-instruct45.56official
188mistral-small-345.56official
190gemini-2.5-pro45.37official
191qwen2.5-7b-instruct45.27official
192command-r7b45official
193ai21-jamba-1.5-large-v1.043.89official
193ai21-jamba-instruct-v1.043.89official
193h2o-danube3-4b-chat43.89official
193lfm2-350m43.89official
197deepseek-r142.22official
197jamba-1.7-mini42.22official
199qwen2.5-3b-instruct41.67official
200aya-23-8b41.11official
200hunyuan-a13b-instruct41.11official
202grok-340.56official
202yi-1.5-9b-chat40.56official
204rakutenai-7b-instruct40official
205command-r-plus39.72official
206mistral-small-latest39.44official
206sarvam-139.44official
208mistral-large-latest38.89official
209ai21-jamba-1.5-mini-v1.038.33official
209deepseek-llm-67b-chat38.33official
209jamba-mini-1.638.33official
209mixtral-8x7b-instruct38.33official
209qwen3-30b-a3b38.33official
214gpt-3.5-turbo37.22official
215mistral-7b36.67official
216magistral-small34.72official
217dbrx-instruct34.44official
217falcon-h1-0.5b-instruct34.44official
219grok-433.89official
219qwq-32b33.89official
221magistral-medium33.33official
221smollm2-360m-instruct33.33official
223dolphin-2.5-mixtral-8x7b32.22official
224open-codestral-mamba31.67official
224powerlm-3b31.67official
226mistral-7b-instruct31.3official
227olmoe-1b-7b-instruct31.11official
227qwen2.5-0.5b-instruct31.11official
229smollm-360m-instruct28.89official
230powermoe-3b28.33official
231h2o-danube3-500m-chat27.22official
232deepseek-r1-distill-qwen-7b25.56official
232olmo-7b-instruct-hf25.56official
234rakutenai-7b-chat24.44official
235deepseek-r1-distill-llama-8b22.78official
236foundation-sec-8b22.22official
237phi-221.67official
238zephyr-7b-beta20official
239nous-hermes-2-mixtral-8x7b-dpo18.89official

toxicity_attack_non_success_rate

Measures how often Enkrypt's toxicity-generation attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1dolphin-2.5-mixtral-8x7b100official
1gemma-2-27b-it100official
1mistral-nemo-minitron-8b-instruct100official
1smaug-llama-3-70b-instruct100official
6claude-3.5-sonnet99.95official
7claude-3-opus99.91official
7granite-3.0-3b-a800m-instruct99.91official
9apriel-v1.5-15b-thinker99.82official
9claude-sonnet-599.82official
9granite-3.1-2b-instruct99.82official
9granite-3.2-2b-instruct99.82official
13claude-sonnet-499.77official
13granite-3.1-3b-a800m-instruct99.77official
15granite-3.1-8b-instruct99.68official
16claude-3-sonnet99.64official
16granite-4.0-h-small99.64official
16granite-4.0-h-tiny99.64official
16llama-2-70b-chat99.64official
20foundation-sec-8b-instruct99.55official
20granite-3.2-8b-instruct99.55official
20llama-2-13b-chat99.55official
23granite-3.0-2b-instruct99.5official
23llama-2-7b-chat99.5official
25claude-3-haiku99.45official
25granite-4.0-micro99.45official
25seallm-7b-v299.45official
28apertus-70b-instruct99.36official
28claude-3.5-haiku99.36official
28qwen2-72b-instruct99.36official
31claude-3.7-sonnet99.32official
32claude-opus-4.899.27official
32cogito-v2.199.27official
34claude-opus-499.18official
34phi-499.18official
36granite-4.0-h-micro99.09official
36minimax-m299.09official
38llama-3.1-nemotron-instruct-70b99.05official
38llama-3.1-tulu-3-8b-dpo99.05official
40granite-3.2-8b-instruct-preview99official
40yi-1.5-9b-chat99official
42llama-3-70b-instruct98.95official
43aya-expanse-8b98.95official
44apertus-8b-instruct98.91official
44claude-haiku-4.598.91official
44qwen2.5-72b-instruct98.91official
47llama-3.2-1b-instruct98.82official
48claude-sonnet-4.598.73official
49qwq-32b-preview98.68official
50claude-opus-4.798.55official
50llama-3.2-instruct-11b-vision98.55official
52starling-lm-7b-beta98.48official
53gpt-4o98.41official
53meta-secalign-8b98.41official
55c4ai-aya-expanse-32b98.36official
55qwen3.5-35b-a3b98.36official
55sarvam-105b98.36official
58gpt-4-turbo98.32official
58phi-3.5-moe-instruct98.32official
58qwen2-57b-a14b-instruct98.32official
61reflection-llama-3.1-70b98.2official
62llama-3.1-tulu-3-8b98.18official
62minimax-m2.798.18official
62phi-3-small-8k-instruct98.18official
62qwen3-8b98.18official
66qwen3-235b-a22b98.14official
67deepseek-r1-distill-llama-8b98.09official
67qwen2.5-max98.09official
69gemma-3-12b98.05official
69llama-4-scout98.05official
71gemma-4-e4b98official
71gpt-4o-mini98official
71inkling98official
74amazon-titan-text-express-v197.95official
74deepseek-r1-distill-qwen-7b97.95official
74llama-3-8b-instruct-rr97.95official
77deepseek-r197.91official
77qwen3-30b-a3b97.91official
79llama-3.2-90b-vision-instruct97.86official
79phi-3-medium-4k-instruct97.86official
79qwen2.5-32b-instruct97.86official
82llama-4-maverick97.82official
82olmo-2-7b-instruct97.82official
84granite-3.0-8b-instruct97.77official
85qwen2.5-14b-instruct97.73official
86o1-preview97.64official
87qwen2-vl-72b-instruct97.59official
88llama-3.1-tulu-3-8b-sft97.45official
88mixtral-8x22b-instruct97.45official
88phi-3.5-mini-instruct97.45official
88qwen3.5-397b-a17b97.45official
92o197.41official
93gemma-3-27b-it97.36official
94gpt-5.497.27official
94nova-premier97.27official
94o1-mini97.27official
97llama-3.3-70b-instruct97.18official
98lfm2-350m97.12official
98lfm2.1-2b97.12official
100gemma-4-26b-a4b-it97.09official
100gpt-597.09official
102nova-micro97.05official
102phi-3-medium-128k-instruct97.05official
104gemma-4-12b96.91official
104gpt-5-nano96.91official
104gpt-oss-safeguard-20b96.91official
104hy396.91official
108qwq-32b96.86official
109gpt-5.296.73official
109phi-3-small-128k-instruct96.73official
109sarvam-30b96.73official
112mistral-small-396.55official
113llama-3-8b-instruct96.45official
114phi-4-mini96.45official
114qwen2.5-14b-instruct-1m96.45official
116internlm2-chat-20b96.41official
117gemma-4-e2b96.36official
117kimi-k2.596.36official
117qwen2.5-1.5b-instruct96.36official
117qwen3.5-122b-a10b96.36official
117qwen3.5-27b96.36official
122lfm2-700m96.21official
123wizardlm-2-8x22b96.18official
124gpt-4.1-nano96.14official
125command-a96.05official
125llama-3.1-405b-instruct96.05official
125phi-3-mini-128k-instruct96.05official
128gemini-2.5-pro96.02official
129qwen3-235b-a22b-instruct95.91official
130gemma-sea-lion-v3-9b-it95.86official
131nova-lite95.82official
131nova-pro95.82official
133phi-3-mini-4k-instruct95.77official
134glm-4.595.76official
135gemma-4-31b-it95.64official
135glm-5.195.64official
135gpt-5.195.64official
135llama-3.1-70b-instruct95.64official
135muse-spark-1.195.64official
140command-r7b95.55official
141llama-3.2-3b-instruct95.5official
142glm-4.695.45official
142glm-5-turbo95.45official
142grok-495.45official
145gemini-1.5-pro95.41official
145granite-3.0-1b-a400m-instruct95.41official
147o3-mini95.36official
148gpt-4.1-mini95.23official
149gpt-5-mini95.2official
150mixtral-8x7b-instruct95.18official
151qwen2.5-3b-instruct95.09official
152gemma-3-4b95.05official
152o395.05official
154llama-3-8b-instruct-mopeymule94.7official
155mistral-7b-instruct94.65official
156deepseek-v3.2-exp94.55official
156gpt-4.194.55official
156mistral-small-latest94.55official
156qwen3-vl-235b-a22b-instruct94.55official
160ai21-jamba-instruct-v1.094.45official
161k2-chat94.41official
162krutrim-2-instruct94.36official
163qwen2.5-7b-instruct-1m94.18official
164h2o-danube3-4b-chat94.09official
165zephyr-7b-beta93.94official
166gpt-5.6-luna93.82official
166hunyuan-a13b-instruct93.82official
166seallms-v3-7b-chat93.82official
169gemini-2.0-flash93.64official
170deepseek-chat93.55official
171deepseek-v3.193.45official
172qwen2.5-0.5b-instruct93.36official
173o4-mini93.27official
174deepseek-llm-67b-chat93.14official
174jamba-large-1.693.14official
176gpt-493.09official
177open-codestral-mamba92.91official
178sarvam-192.88official
179deepseek-v4-pro92.55official
180gpt-5.6-terra92.36official
181mistral-large-latest92.27official
182falcon-h1-0.5b-instruct92.14official
183llama-3.1-8b-instruct92.07official
184gpt-5.592official
185jamba-1.7-large91.82official
185magistral-medium91.82official
187deepseek-v4-flash91.64official
188gemini-2.5-flash91.48official
189grok-4.391.45official
190longwriter-glm4-9b91.36official
191dbrx-instruct91.23official
191jamba-mini-1.691.23official
193gpt-5.6-sol91.09official
194kimi-k290.97official
195gemini-2.0-flash-lite-preview90.73official
196gemini-1.5-flash90.59official
197jamba-1.7-mini90.5official
198smollm-360m-instruct90official
199ai21-jamba-1.5-large-v1.089.64official
199deepseek-v389.64official
201magistral-small89.59official
202gpt-3.5-turbo89.18official
203gpt-oss-120b89.09official
204command-r-plus88.8official
205nexusraven-v2-13b88.64official
206aya-23-8b86.64official
207nous-hermes-2-mixtral-8x7b-dpo86.59official
208ai21-jamba-1.5-mini-v1.086.36official
209codellama-7b-instruct-hf84.82official
210grok-4.1-fast84.18official
211gemma-2-2b-it84.14official
212aya-23-35b83.18official
213smollm2-1.7b-instruct82.77official
214h2o-danube3-500m-chat82.5official
215foundation-sec-8b82.05official
216smollm2-360m-instruct81.52official
217qwen1.5-14b-chat80.95official
218gpt-oss-20b80official
219rakutenai-7b-instruct79.24official
220qwen2.5-7b-instruct78.73official
221mistral-7b78.18official
222gemma-7b-it77.05official
222smollm-1.7b-instruct77.05official
224komodo-7b-base76.21official
225glm-4-9b-chat75.41official
226sea-lion-v1-7b-it72.58official
227falcon-mamba-7b-instruct71.09official
228gemma-2b-it70.45official
229gemma-2-9b-it70official
230qwen2-7b-instruct66.32official
231olmoe-1b-7b-instruct64.09official
232grok-361.75official
233olmo-7b-instruct-hf59.55official
234powerlm-3b57.27official
235phi-256.36official
236powermoe-3b55official
237rakutenai-7b-chat50.91official