← Evals

Evaluation profile

Enkrypt AI Safety Leaderboard

4sub-evals
2.27%Safety weight
5.61%Freedom weight
3components

Weights below are portfolio-specific global index weights.

Model score (higher is better)Predicted score

About this eval

Resistance to Enkrypt bias, CBRN, harmful-content, and toxicity red-team tests.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirection by rankingSafety weightFreedom weight
bias_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:bias_attack_non_success_rateMeasures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.Safety: human_rights_systemic_harm:0.800|ordinary_harm_misuse_resistance:0.200enkrypt-aiSafety: higher0.949%
cbrn_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:cbrn_attack_non_success_rateMeasures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.Safety: ordinary_harm_misuse_resistance:0.400|responsible_agency_control:0.600 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.411%1.87%
harmful_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:harmful_attack_non_success_rateMeasures how often Enkrypt's harmful-content attacks do not succeed.Safety: human_rights_systemic_harm:0.150|ordinary_harm_misuse_resistance:0.700|responsible_agency_control:0.150 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.391%1.87%
toxicity_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:toxicity_attack_non_success_rateMeasures how often Enkrypt's toxicity-generation attacks do not succeed.Safety: human_rights_systemic_harm:0.350|ordinary_harm_misuse_resistance:0.650 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.523%1.87%

bias_attack_non_success_rate

Measures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2mistral-nemo-minitron-8b-instruct92.51official
3mistral-7b86.56official
4smollm-360m-instruct76.23official
5claude-3-opus74.42official
6claude-sonnet-570.54official
7komodo-7b-base65.63official
8grok-4.664.86official
9mistral-large-latest60.47official
10gpt-559.95official
11claude-3.5-haiku56.59official
12minimax-m2.754.52official
13llama-3.1-nemotron-instruct-70b54.26official
14llama-3.2-90b-vision-instruct52.2official
15claude-opus-4.851.94official
15minimax-m251.94official
17claude-3.5-sonnet51.68official
18qwen3.5-397b-a17b50.39official
19muse-spark-1.149.87official
20claude-sonnet-4.547.55official
20sarvam-147.55official
22open-codestral-mamba46.51official
23hy343.93official
24gpt-5.143.67official
25claude-opus-443.41official
26claude-sonnet-442.89official
27dolphin-2.5-mixtral-8x7b41.6official
27gpt-5.241.6official
29gpt-5-mini41.09official
30qwen3.5-122b-a10b40.31official
31gpt-oss-120b39.79official
32qwen3.5-27b39.53official
33gpt-5.6-terra39.28official
34gpt-5-nano39.02official
34inkling39.02official
36gemini-2.5-pro38.85official
37qwen2.5-72b-instruct38.63official
38gpt-5.538.5official
39powerlm-3b37.47official
40mistral-7b-instruct36.61official
41qwen2.5-7b-instruct35.53official
42claude-haiku-4.535.14official
43grok-4.533.59official
43smollm2-360m-instruct33.59official
45gemma-2-27b-it31.78official
46lfm2.1-2b31.52official
46phi-231.52official
48glm-4.530.49official
49powermoe-3b29.2official
50mimo-v2.5-pro28.94official
51kimi-k228.81official
52foundation-sec-8b-instruct28.68official
52kimi-k2.628.68official
54gpt-5.6-sol27.91official
55gpt-oss-20b27.65official
56qwen3-vl-235b-a22b-instruct27.39official
57qwen3.5-35b-a3b26.61official
58gpt-4-turbo26.36official
58lfm2-700m26.36official
58sea-lion-v1-7b-it26.36official
61apriel-v1.5-15b-thinker26.1official
62gemma-2-2b-it25.84official
63gpt-oss-safeguard-20b25.58official
64deepseek-r125.06official
65gemini-2.5-flash24.84official
66cogito-v2.124.55official
67rakutenai-7b-chat24.29official
68claude-opus-4.723.51official
68glm-5.123.51official
68o1-preview23.51official
71deepseek-v3.2-exp23official
71jamba-1.7-large23official
71nexusraven-v2-13b23official
71nova-premier23official
71o323official
76claude-opus-4.622.74official
77qwen2-57b-a14b-instruct22.22official
77qwen3-235b-a22b-instruct22.22official
77smaug-llama-3-70b-instruct22.22official
80gpt-5.6-luna21.96official
81claude-3-sonnet21.71official
82deepseek-v3.121.19official
82starling-lm-7b-beta21.19official
84gpt-4o20.67official
84hunyuan-a13b-instruct20.67official
86gemma-7b-it20.41official
86internlm2-chat-20b20.41official
88o4-mini20.16official
89gemini-3.5-flash19.64official
89qwen2-7b-instruct19.64official
91grok-319.38official
91lfm2-350m19.38official
93apertus-8b-instruct19.12official
93o1-mini19.12official
93qwen1.5-14b-chat19.12official
93reflection-llama-3.1-70b19.12official
97claude-sonnet-4.618.86official
98granite-4.0-h-small18.6official
98llama-2-7b-chat18.6official
98llama-3-8b-instruct-rr18.6official
101glm-4-9b-chat18.35official
101llama-3.1-8b-instruct18.35official
103apertus-70b-instruct18.09official
103jamba-1.7-mini18.09official
103o3-mini18.09official
106gpt-4.117.83official
106longwriter-glm4-9b17.83official
106o117.83official
109llama-3-8b-instruct17.19official
110gemma-3-27b-it17.05official
111aya-23-35b16.8official
111olmo-7b-instruct-hf16.8official
111phi-416.8official
114falcon-h1-0.5b-instruct16.54official
114llama-3-8b-instruct-mopeymule16.54official
116magistral-small16.54official
117gemini-3.6-flash16.28official
117jamba-large-1.616.28official
117kimi-k2.516.28official
117meta-secalign-8b16.28official
117qwen2.5-max16.28official
122llama-3-70b-instruct16.02official
123claude-3.7-sonnet16.02official
123gemma-2-9b-it16.02official
123gemma-3-4b16.02official
123qwen2.5-14b-instruct-1m16.02official
127magistral-medium15.76official
127qwen2-72b-instruct15.76official
129gpt-4.1-mini15.5official
129zephyr-7b-beta15.5official
131c4ai-aya-expanse-32b15.25official
131gpt-415.25official
131mistral-small-315.25official
131nova-pro15.25official
135aya-expanse-8b14.99official
135granite-4.0-h-tiny14.99official
135granite-4.0-micro14.99official
135nova-lite14.99official
135olmoe-1b-7b-instruct14.99official
135phi-3.5-moe-instruct14.99official
141deepseek-chat14.73official
141deepseek-v4-flash14.73official
141deepseek-v4-pro14.73official
141gemini-1.5-pro14.73official
141nemotron-3-super-120b-a12b14.73official
141qwen2-vl-72b-instruct14.73official
141yi-1.5-9b-chat14.73official
148falcon-mamba-7b-instruct14.47official
148qwen2.5-32b-instruct14.47official
150mistral-small-latest14.21official
151ai21-jamba-1.5-large-v1.013.95official
151gemini-2.0-flash-lite-preview13.95official
151gemma-sea-lion-v3-9b-it13.95official
151granite-4.0-h-micro13.95official
151llama-4-scout13.95official
156gemini-2.0-flash13.7official
156glm-5.213.7official
156gpt-4o-mini13.7official
156llama-3.1-70b-instruct13.7official
156phi-3-mini-128k-instruct13.7official
156phi-3-small-128k-instruct13.7official
156phi-4-mini13.7official
163deepseek-v313.18official
163gemma-3-12b13.18official
163granite-3.2-2b-instruct13.18official
163krutrim-2-instruct13.18official
163llama-3.2-instruct-11b-vision13.18official
163phi-3-mini-4k-instruct13.18official
163qwen2.5-7b-instruct-1m13.18official
163rakutenai-7b-instruct13.18official
163wizardlm-2-8x22b13.18official
172claude-3-haiku12.92official
172gemma-4-26b-a4b-it12.92official
172gpt-4.1-nano12.92official
172gpt-5.412.92official
172grok-4.312.92official
172llama-3.1-405b-instruct12.92official
172nova-micro12.92official
172qwen2.5-14b-instruct12.92official
180glm-4.612.66official
180granite-3.0-8b-instruct12.66official
180jamba-mini-1.612.66official
180k2-chat12.66official
180nemotron-3-ultra-550b-a55b12.66official
180phi-3-medium-4k-instruct12.66official
180qwq-32b-preview12.66official
187granite-3.2-8b-instruct12.4official
187grok-412.4official
187llama-2-70b-chat12.4official
190granite-3.2-8b-instruct-preview12.27official
191ai21-jamba-1.5-mini-v1.012.14official
191gemini-1.5-flash12.14official
191grok-4.1-fast12.14official
191phi-3-small-8k-instruct12.14official
195dbrx-instruct11.89official
195glm-5-turbo11.89official
195granite-3.1-8b-instruct11.89official
195mixtral-8x22b-instruct11.89official
195phi-3-medium-128k-instruct11.89official
200seallm-7b-v211.63official
201mixtral-8x7b-instruct11.37official
201phi-3.5-mini-instruct11.37official
203llama-2-13b-chat11.11official
203llama-3.2-3b-instruct11.11official
203llama-3.3-70b-instruct11.11official
203nous-hermes-2-mixtral-8x7b-dpo11.11official
203seallms-v3-7b-chat11.11official
208llama-3.1-tulu-3-8b10.85official
209granite-3.0-3b-a800m-instruct10.59official
209olmo-2-7b-instruct10.59official
209qwen2.5-3b-instruct10.59official
212gemma-4-12b10.34official
212granite-3.1-2b-instruct10.34official
212llama-4-maverick10.34official
215deepseek-r1-distill-qwen-7b10.08official
215gpt-3.5-turbo10.08official
217amazon-titan-text-express-v19.82official
217llama-3.1-tulu-3-8b-dpo9.82official
217llama-3.1-tulu-3-8b-sft9.82official
220aya-23-8b9.56official
220deepseek-llm-67b-chat9.56official
220granite-3.0-2b-instruct9.56official
223ai21-jamba-instruct-v1.09.3official
223qwen3-235b-a22b9.3official
225sarvam-105b9.04official
226gemma-4-31b-it8.53official
226qwen3-30b-a3b8.53official
228deepseek-r1-distill-llama-8b8.27official
228granite-3.1-3b-a800m-instruct8.27official
230qwen2.5-1.5b-instruct8.01official
231h2o-danube3-500m-chat7.49official
232h2o-danube3-4b-chat6.98official
232qwq-32b6.98official
234codellama-7b-instruct-hf6.72official
235gemma-4-e4b6.2official
236granite-3.0-1b-a400m-instruct5.43official
237sarvam-30b4.39official
237smollm2-1.7b-instruct4.39official
239foundation-sec-8b4.13official
239gemma-2b-it4.13official
239llama-3.2-1b-instruct4.13official
242qwen2.5-0.5b-instruct3.88official
242smollm-1.7b-instruct3.88official
244qwen3-8b2.33official
245command-a1.81official
246gemma-4-e2b1.55official
247command-r-plus1.16official
248command-r7b0.52official

cbrn_attack_non_success_rate

Measures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2hy399.5official
3claude-3.5-sonnet98.17official
4gpt-5-nano98official
5llama-3-8b-instruct-mopeymule97.33official
6meta-secalign-8b97.17official
7claude-3.5-haiku97official
8gpt-5-mini96.83official
9claude-3-sonnet96.33official
9claude-opus-4.796.33official
9o196.33official
12claude-3-opus95.67official
12komodo-7b-base95.67official
14o1-preview95.5official
14qwq-32b-preview95.5official
16llama-3-8b-instruct-rr95.33official
17aya-expanse-8b95.17official
17claude-3.7-sonnet95.17official
17gemma-2-9b-it95.17official
20phi-495official
21gpt-4-turbo94.67official
21sea-lion-v1-7b-it94.67official
23amazon-titan-text-express-v194.5official
23apriel-v1.5-15b-thinker94.5official
23nova-pro94.5official
26c4ai-aya-expanse-32b94.33official
26gemma-2b-it94.33official
26longwriter-glm4-9b94.33official
29gpt-4o93.83official
29krutrim-2-instruct93.83official
31dolphin-2.5-mixtral-8x7b93.67official
31muse-spark-1.193.67official
33gpt-5.193.5official
33wizardlm-2-8x22b93.5official
35gemini-2.0-flash93.33official
35internlm2-chat-20b93.33official
35mistral-nemo-minitron-8b-instruct93.33official
38qwq-32b93official
39gpt-592.89official
40claude-3-haiku92.67official
40nova-lite92.67official
40o1-mini92.67official
43claude-sonnet-592.5official
43deepseek-r1-distill-qwen-7b92.5official
45qwen2.5-max92.33official
46llama-3.1-tulu-3-8b-dpo92.17official
47claude-opus-4.892official
47gpt-4o-mini92official
47llama-3.1-tulu-3-8b92official
47phi-3.5-mini-instruct92official
51hunyuan-a13b-instruct91.83official
51llama-2-13b-chat91.83official
53aya-23-35b91.67official
53llama-3.2-90b-vision-instruct91.67official
53o3-mini91.67official
56nova-premier91.5official
56smaug-llama-3-70b-instruct91.5official
58claude-opus-4.691.33official
58gemini-2.0-flash-lite-preview91.33official
58gpt-491.33official
58inkling91.33official
62deepseek-chat91.17official
62jamba-mini-1.691.17official
62llama-4-maverick91.17official
62zephyr-7b-beta91.17official
66ai21-jamba-1.5-large-v1.091official
67apertus-70b-instruct90.83official
67aya-23-8b90.83official
67deepseek-r1-distill-llama-8b90.83official
67llama-3.1-nemotron-instruct-70b90.83official
67llama-3.2-instruct-11b-vision90.83official
72gemma-3-12b90.67official
72mistral-small-390.67official
72mixtral-8x22b-instruct90.67official
75nexusraven-v2-13b90.5official
75sarvam-105b90.5official
77foundation-sec-8b-instruct90.33official
77gemma-3-27b-it90.33official
77granite-3.1-8b-instruct90.33official
77nova-micro90.33official
77o390.33official
77qwen2-72b-instruct90.33official
83gemini-1.5-pro90.17official
83granite-4.0-micro90.17official
83llama-3.1-405b-instruct90.17official
83mistral-large-latest90.17official
87granite-3.2-8b-instruct-preview90.09official
88gpt-4.190official
88phi-3-mini-128k-instruct90official
90gpt-5.289.83official
90llama-2-7b-chat89.83official
90mistral-7b89.83official
93gemma-2-27b-it89.67official
93h2o-danube3-4b-chat89.67official
93olmo-2-7b-instruct89.67official
93phi-3-medium-4k-instruct89.67official
93qwen2.5-72b-instruct89.67official
98claude-haiku-4.589.5official
98gpt-4.1-nano89.5official
98phi-3-mini-4k-instruct89.5official
101granite-3.1-3b-a800m-instruct89.33official
101qwen2.5-32b-instruct89.33official
101sarvam-30b89.33official
104gemma-sea-lion-v3-9b-it89.17official
104qwen2.5-14b-instruct89.17official
106ai21-jamba-instruct-v1.089official
107starling-lm-7b-beta88.83official
107yi-1.5-9b-chat88.83official
109gpt-4.1-mini88.67official
109granite-3.2-8b-instruct88.67official
109granite-4.0-h-small88.67official
109seallm-7b-v288.67official
113gemma-3-4b88.5official
113llama-2-70b-chat88.5official
113llama-3.1-tulu-3-8b-sft88.5official
113sarvam-188.5official
113smollm2-360m-instruct88.5official
118cogito-v2.188.33official
118granite-3.1-2b-instruct88.33official
118jamba-large-1.688.33official
118llama-3.2-1b-instruct88.33official
118rakutenai-7b-instruct88.33official
123mistral-small-latest88.17official
123nous-hermes-2-mixtral-8x7b-dpo88.17official
125grok-388official
126llama-3-70b-instruct87.83official
126llama-3.3-70b-instruct87.83official
126llama-4-scout87.83official
129granite-3.2-2b-instruct87.5official
129granite-4.0-h-micro87.5official
129phi-3-small-8k-instruct87.5official
129smollm-360m-instruct87.5official
133deepseek-v387.33official
133granite-4.0-h-tiny87.33official
133o4-mini87.33official
133phi-3-medium-128k-instruct87.33official
133phi-3.5-moe-instruct87.33official
138gpt-3.5-turbo87.17official
138phi-3-small-128k-instruct87.17official
140claude-sonnet-4.587official
140k2-chat87official
140qwen2.5-3b-instruct87official
140qwen2.5-7b-instruct-1m87official
140reflection-llama-3.1-70b87official
145granite-3.0-8b-instruct86.83official
146gemini-1.5-flash86.67official
146h2o-danube3-500m-chat86.67official
146mixtral-8x7b-instruct86.67official
149llama-3.1-70b-instruct86.5official
149qwen1.5-14b-chat86.5official
151mistral-7b-instruct86.39official
152phi-4-mini86.33official
152qwen2-57b-a14b-instruct86.33official
154gpt-oss-120b86.17official
155ai21-jamba-1.5-mini-v1.086official
155gemma-2-2b-it86official
155minimax-m286official
158apertus-8b-instruct85.83official
158llama-3-8b-instruct85.83official
160llama-3.2-3b-instruct85.67official
161phi-285.33official
162dbrx-instruct85.17official
162qwen2.5-1.5b-instruct85.17official
162qwen2.5-14b-instruct-1m85.17official
165minimax-m2.785official
166claude-sonnet-4.684.67official
166qwen2-vl-72b-instruct84.67official
166qwen3-235b-a22b-instruct84.67official
166seallms-v3-7b-chat84.67official
170olmoe-1b-7b-instruct84.5official
171gemini-2.5-flash84.17official
172llama-3.1-8b-instruct83.91official
173falcon-mamba-7b-instruct83.83official
173granite-3.0-1b-a400m-instruct83.83official
175rakutenai-7b-chat83.67official
176deepseek-llm-67b-chat83.5official
176qwen2-7b-instruct83.5official
176qwen2.5-7b-instruct83.5official
179gpt-5.483.33official
180magistral-medium83.17official
181command-r-plus83.16official
182deepseek-v4-pro82.67official
183qwen3-vl-235b-a22b-instruct82.5official
184glm-4-9b-chat82.33official
185granite-3.0-2b-instruct82.17official
186gpt-oss-safeguard-20b82official
186granite-3.0-3b-a800m-instruct82official
188deepseek-v3.181.67official
189deepseek-v3.2-exp81.5official
190kimi-k281.44official
191open-codestral-mamba81.33official
191qwen2.5-0.5b-instruct81.33official
193gpt-oss-20b81official
194gpt-5.6-sol80.83official
194powerlm-3b80.83official
194smollm-1.7b-instruct80.83official
197magistral-small80.34official
198gpt-5.6-terra80official
199lfm2.1-2b79.5official
200gpt-5.579.33official
201falcon-h1-0.5b-instruct79.17official
201gemini-2.5-pro79.17official
203glm-5.179official
203lfm2-700m79official
203olmo-7b-instruct-hf79official
206gemma-7b-it78.83official
207smollm2-1.7b-instruct78.5official
208gpt-5.6-luna77.83official
209glm-4.577.67official
210foundation-sec-8b77.33official
211grok-476.83official
212glm-5-turbo76official
212grok-4.676official
214qwen3.5-397b-a17b75.5official
215jamba-1.7-mini75.33official
216claude-opus-475official
217glm-4.674.67official
217grok-4.574.67official
219jamba-1.7-large73.17official
219qwen3.5-35b-a3b73.17official
221command-a72.67official
222powermoe-3b72.33official
223grok-4.1-fast71.83official
224command-r7b71.33official
225qwen3.5-27b71.17official
226codellama-7b-instruct-hf70.5official
227deepseek-v4-flash70.33official
228qwen3.5-122b-a10b70.17official
229lfm2-350m69.67official
230gemma-4-e2b68official
231qwen3-8b67official
232gemma-4-e4b66.83official
232kimi-k2.566.83official
234gemma-4-31b-it66.67official
235gemma-4-12b65.5official
236grok-4.365.17official
237claude-sonnet-463official
237gemma-4-26b-a4b-it63official
239mimo-v2.5-pro53official
240kimi-k2.651.5official
241nemotron-3-super-120b-a12b50.83official
242glm-5.249.33official
243gemini-3.5-flash48official
244nemotron-3-ultra-550b-a55b47.33official
245gemini-3.6-flash47.17official
246deepseek-r146.5official
247qwen3-30b-a3b44.33official
248qwen3-235b-a22b43.33official

harmful_attack_non_success_rate

Measures how often Enkrypt's harmful-content attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1claude-sonnet-5100official
1gpt-5.4100official
1gpt-5.6-luna100official
1grok-4.5100official
1muse-spark-1.1100official
7claude-opus-4.699.44official
7claude-opus-4.799.44official
7claude-opus-4.899.44official
7claude-sonnet-499.44official
7claude-sonnet-4.599.44official
7claude-sonnet-4.699.44official
7gpt-5.599.44official
7gpt-5.6-sol99.44official
7grok-4.699.44official
16claude-haiku-4.598.89official
16claude-opus-498.89official
16qwen3.5-27b98.89official
19claude-3.7-sonnet98.33official
19o1-preview98.33official
19qwen3.5-35b-a3b98.33official
22gpt-5.6-terra97.78official
22inkling97.78official
22mimo-v2.5-pro97.78official
22minimax-m2.797.78official
22qwen3.5-122b-a10b97.78official
27claude-3.5-sonnet97.5official
28qwen3.5-397b-a17b97.22official
29phi-496.67official
30o196.11official
30sarvam-105b96.11official
32gemma-4-12b95.56official
33gemma-4-26b-a4b-it95official
33grok-4.395official
35claude-3.5-haiku94.44official
35kimi-k2.594.44official
35meta-secalign-8b94.44official
38gemma-4-31b-it93.89official
38o393.89official
40claude-3-sonnet93.33official
40gpt-593.33official
42gpt-5-nano92.78official
42hy392.78official
42o1-mini92.78official
45claude-3-opus92.22official
45llama-3-8b-instruct-mopeymule92.22official
45nemotron-3-super-120b-a12b92.22official
48gpt-5.291.67official
48granite-4.0-h-tiny91.67official
50gemini-3.6-flash91.11official
50glm-5.191.11official
50gpt-5-mini91.11official
50llama-3.2-1b-instruct91.11official
54glm-5.290.56official
54kimi-k2.690.56official
54nemotron-3-ultra-550b-a55b90.56official
57minimax-m289.44official
58llama-3-8b-instruct89.16official
59glm-5-turbo88.89official
59granite-4.0-micro88.89official
61cogito-v2.188.33official
61llama-2-13b-chat88.33official
63llama-2-70b-chat87.78official
63llama-3-70b-instruct87.78official
65claude-3-haiku87.22official
65qwen2-72b-instruct87.22official
67foundation-sec-8b-instruct86.67official
67gemma-4-e2b86.67official
67olmo-2-7b-instruct86.67official
70krutrim-2-instruct86.11official
70llama-3.1-tulu-3-8b-sft86.11official
72gemma-4-e4b85.56official
72gpt-oss-120b85.56official
72granite-4.0-h-small85.56official
72llama-2-7b-chat85.56official
72llama-3.2-instruct-11b-vision85.56official
77gemini-3.5-flash85official
77llama-3.2-3b-instruct85official
77o4-mini85official
80nova-lite84.44official
80o3-mini84.44official
82gpt-5.183.89official
82sarvam-30b83.89official
84llama-3-8b-instruct-rr83.33official
85llama-3.1-tulu-3-8b82.78official
86llama-4-maverick82.22official
86nova-pro82.22official
88k2-chat81.67official
88llama-3.1-tulu-3-8b-dpo81.67official
90gemma-2-9b-it81.11official
91gpt-480.56official
91gpt-oss-20b80.56official
91nova-premier80.56official
94qwen3-235b-a22b-instruct80official
95nova-micro79.44official
95phi-3.5-mini-instruct79.44official
97kimi-k279.16official
98amazon-titan-text-express-v178.89official
98apriel-v1.5-15b-thinker78.89official
98granite-4.0-h-micro78.89official
101deepseek-v4-pro77.78official
102gemma-2b-it77.22official
103deepseek-v4-flash76.67official
104gpt-4-turbo76.11official
104granite-3.1-3b-a800m-instruct76.11official
104phi-3.5-moe-instruct76.11official
107phi-3-mini-4k-instruct75.56official
108gpt-4.175official
108granite-3.0-8b-instruct75official
108llama-3.2-90b-vision-instruct75official
108qwq-32b-preview75official
112gemma-2-2b-it74.44official
112gpt-oss-safeguard-20b74.44official
114gemma-2-27b-it73.89official
114phi-3-medium-128k-instruct73.89official
116qwen2.5-72b-instruct73.62official
117apertus-70b-instruct73.33official
117codellama-7b-instruct-hf73.33official
117llama-3.1-405b-instruct73.33official
117llama-3.1-8b-instruct73.33official
121llama-3.1-nemotron-instruct-70b72.22official
121phi-3-mini-128k-instruct72.22official
123granite-3.1-8b-instruct71.67official
123internlm2-chat-20b71.67official
123reflection-llama-3.1-70b71.67official
126phi-3-small-8k-instruct71.11official
127komodo-7b-base70.56official
127qwen3-vl-235b-a22b-instruct70.56official
129qwen2.5-14b-instruct69.44official
129smaug-llama-3-70b-instruct69.44official
131c4ai-aya-expanse-32b68.89official
132gemini-1.5-pro68.33official
132llama-4-scout68.33official
134gpt-4o67.78official
134phi-3-small-128k-instruct67.78official
136aya-expanse-8b67.22official
136qwen2.5-max67.22official
138llama-3.3-70b-instruct66.11official
139phi-3-medium-4k-instruct64.44official
140gemini-2.0-flash63.89official
141grok-4.1-fast63.33official
142llama-3.1-70b-instruct62.78official
143qwen2-7b-instruct62.22official
143qwen3-8b62.22official
145granite-3.0-2b-instruct61.67official
145qwen2.5-14b-instruct-1m61.67official
145seallm-7b-v261.67official
145seallms-v3-7b-chat61.67official
149gpt-4o-mini60.56official
149phi-4-mini60.56official
151gpt-4.1-nano60official
151qwen2.5-32b-instruct60official
153granite-3.0-1b-a400m-instruct59.44official
154deepseek-v3.158.89official
154granite-3.0-3b-a800m-instruct58.89official
156deepseek-chat58.33official
156gpt-4.1-mini58.33official
156qwen2-vl-72b-instruct58.33official
159longwriter-glm4-9b57.78official
159qwen1.5-14b-chat57.78official
159wizardlm-2-8x22b57.78official
162gemma-3-27b-it56.11official
163gemini-1.5-flash55.56official
163gemma-sea-lion-v3-9b-it55.56official
163lfm2-700m55.56official
163lfm2.1-2b55.56official
163qwen2-57b-a14b-instruct55.56official
163sea-lion-v1-7b-it55.56official
169glm-4.655official
169granite-3.1-2b-instruct55official
169granite-3.2-2b-instruct55official
172gemini-2.5-flash54.63official
173gemma-7b-it54.44official
173mistral-nemo-minitron-8b-instruct54.44official
173qwen2.5-1.5b-instruct54.44official
173smollm2-1.7b-instruct54.44official
177gemini-2.0-flash-lite-preview53.89official
177mixtral-8x22b-instruct53.89official
179apertus-8b-instruct53.33official
180gemma-3-12b52.78official
181deepseek-v352.22official
181glm-4.552.22official
181qwen2.5-7b-instruct-1m52.22official
184nexusraven-v2-13b50.56official
185granite-3.2-8b-instruct50official
186granite-3.2-8b-instruct-preview49.45official
187jamba-large-1.649.44official
188command-a48.89official
188gemma-3-4b48.89official
190glm-4-9b-chat48.33official
190smollm-1.7b-instruct48.33official
192starling-lm-7b-beta47.78official
193deepseek-v3.2-exp46.67official
193qwen3-235b-a22b46.67official
195aya-23-35b46.11official
195jamba-1.7-large46.11official
197falcon-mamba-7b-instruct45.56official
197mistral-small-345.56official
199gemini-2.5-pro45.37official
200qwen2.5-7b-instruct45.27official
201command-r7b45official
202ai21-jamba-1.5-large-v1.043.89official
202ai21-jamba-instruct-v1.043.89official
202h2o-danube3-4b-chat43.89official
202lfm2-350m43.89official
206deepseek-r142.22official
206jamba-1.7-mini42.22official
208qwen2.5-3b-instruct41.67official
209aya-23-8b41.11official
209hunyuan-a13b-instruct41.11official
211grok-340.56official
211yi-1.5-9b-chat40.56official
213rakutenai-7b-instruct40official
214command-r-plus39.72official
215mistral-small-latest39.44official
215sarvam-139.44official
217mistral-large-latest38.89official
218ai21-jamba-1.5-mini-v1.038.33official
218deepseek-llm-67b-chat38.33official
218jamba-mini-1.638.33official
218mixtral-8x7b-instruct38.33official
218qwen3-30b-a3b38.33official
223gpt-3.5-turbo37.22official
224mistral-7b36.67official
225magistral-small34.72official
226dbrx-instruct34.44official
226falcon-h1-0.5b-instruct34.44official
228grok-433.89official
228qwq-32b33.89official
230magistral-medium33.33official
230smollm2-360m-instruct33.33official
232dolphin-2.5-mixtral-8x7b32.22official
233open-codestral-mamba31.67official
233powerlm-3b31.67official
235mistral-7b-instruct31.3official
236olmoe-1b-7b-instruct31.11official
236qwen2.5-0.5b-instruct31.11official
238smollm-360m-instruct28.89official
239powermoe-3b28.33official
240h2o-danube3-500m-chat27.22official
241deepseek-r1-distill-qwen-7b25.56official
241olmo-7b-instruct-hf25.56official
243rakutenai-7b-chat24.44official
244deepseek-r1-distill-llama-8b22.78official
245foundation-sec-8b22.22official
246phi-221.67official
247zephyr-7b-beta20official
248nous-hermes-2-mixtral-8x7b-dpo18.89official

toxicity_attack_non_success_rate

Measures how often Enkrypt's toxicity-generation attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1dolphin-2.5-mixtral-8x7b100official
1gemma-2-27b-it100official
1mistral-nemo-minitron-8b-instruct100official
1smaug-llama-3-70b-instruct100official
6claude-3.5-sonnet99.95official
7claude-3-opus99.91official
7granite-3.0-3b-a800m-instruct99.91official
9apriel-v1.5-15b-thinker99.82official
9claude-sonnet-599.82official
9granite-3.1-2b-instruct99.82official
9granite-3.2-2b-instruct99.82official
13claude-sonnet-499.77official
13granite-3.1-3b-a800m-instruct99.77official
15granite-3.1-8b-instruct99.68official
16claude-3-sonnet99.64official
16granite-4.0-h-small99.64official
16granite-4.0-h-tiny99.64official
16llama-2-70b-chat99.64official
20foundation-sec-8b-instruct99.55official
20granite-3.2-8b-instruct99.55official
20llama-2-13b-chat99.55official
23granite-3.0-2b-instruct99.5official
23llama-2-7b-chat99.5official
25claude-3-haiku99.45official
25granite-4.0-micro99.45official
25seallm-7b-v299.45official
28apertus-70b-instruct99.36official
28claude-3.5-haiku99.36official
28qwen2-72b-instruct99.36official
31claude-3.7-sonnet99.32official
32claude-opus-4.899.27official
32cogito-v2.199.27official
34claude-opus-499.18official
34phi-499.18official
36granite-4.0-h-micro99.09official
36minimax-m299.09official
38llama-3.1-nemotron-instruct-70b99.05official
38llama-3.1-tulu-3-8b-dpo99.05official
40granite-3.2-8b-instruct-preview99official
40yi-1.5-9b-chat99official
42llama-3-70b-instruct98.95official
43aya-expanse-8b98.95official
44apertus-8b-instruct98.91official
44claude-haiku-4.598.91official
44qwen2.5-72b-instruct98.91official
47llama-3.2-1b-instruct98.82official
48claude-sonnet-4.598.73official
49qwq-32b-preview98.68official
50claude-opus-4.798.55official
50llama-3.2-instruct-11b-vision98.55official
52starling-lm-7b-beta98.48official
53gpt-4o98.41official
53meta-secalign-8b98.41official
55c4ai-aya-expanse-32b98.36official
55qwen3.5-35b-a3b98.36official
55sarvam-105b98.36official
58gpt-4-turbo98.32official
58phi-3.5-moe-instruct98.32official
58qwen2-57b-a14b-instruct98.32official
61reflection-llama-3.1-70b98.2official
62llama-3.1-tulu-3-8b98.18official
62mimo-v2.5-pro98.18official
62minimax-m2.798.18official
62nemotron-3-super-120b-a12b98.18official
62phi-3-small-8k-instruct98.18official
62qwen3-8b98.18official
68qwen3-235b-a22b98.14official
69deepseek-r1-distill-llama-8b98.09official
69qwen2.5-max98.09official
71gemma-3-12b98.05official
71llama-4-scout98.05official
73gemma-4-e4b98official
73gpt-4o-mini98official
73inkling98official
76amazon-titan-text-express-v197.95official
76deepseek-r1-distill-qwen-7b97.95official
76llama-3-8b-instruct-rr97.95official
79deepseek-r197.91official
79qwen3-30b-a3b97.91official
81llama-3.2-90b-vision-instruct97.86official
81phi-3-medium-4k-instruct97.86official
81qwen2.5-32b-instruct97.86official
84llama-4-maverick97.82official
84olmo-2-7b-instruct97.82official
86granite-3.0-8b-instruct97.77official
87qwen2.5-14b-instruct97.73official
88o1-preview97.64official
89qwen2-vl-72b-instruct97.59official
90llama-3.1-tulu-3-8b-sft97.45official
90mixtral-8x22b-instruct97.45official
90phi-3.5-mini-instruct97.45official
90qwen3.5-397b-a17b97.45official
94o197.41official
95gemma-3-27b-it97.36official
96gemini-3.5-flash97.27official
96glm-5.297.27official
96gpt-5.497.27official
96nova-premier97.27official
96o1-mini97.27official
101llama-3.3-70b-instruct97.18official
102lfm2-350m97.12official
102lfm2.1-2b97.12official
104gemma-4-26b-a4b-it97.09official
104gpt-597.09official
106nova-micro97.05official
106phi-3-medium-128k-instruct97.05official
108gemma-4-12b96.91official
108gpt-5-nano96.91official
108gpt-oss-safeguard-20b96.91official
108hy396.91official
112qwq-32b96.86official
113gpt-5.296.73official
113grok-4.696.73official
113phi-3-small-128k-instruct96.73official
113sarvam-30b96.73official
117mistral-small-396.55official
118llama-3-8b-instruct96.45official
119phi-4-mini96.45official
119qwen2.5-14b-instruct-1m96.45official
121internlm2-chat-20b96.41official
122gemma-4-e2b96.36official
122kimi-k2.596.36official
122qwen2.5-1.5b-instruct96.36official
122qwen3.5-122b-a10b96.36official
122qwen3.5-27b96.36official
127lfm2-700m96.21official
128wizardlm-2-8x22b96.18official
129gpt-4.1-nano96.14official
130command-a96.05official
130llama-3.1-405b-instruct96.05official
130phi-3-mini-128k-instruct96.05official
133gemini-2.5-pro96.02official
134qwen3-235b-a22b-instruct95.91official
135gemma-sea-lion-v3-9b-it95.86official
136nova-lite95.82official
136nova-pro95.82official
138phi-3-mini-4k-instruct95.77official
139glm-4.595.76official
140gemma-4-31b-it95.64official
140glm-5.195.64official
140gpt-5.195.64official
140llama-3.1-70b-instruct95.64official
140muse-spark-1.195.64official
145command-r7b95.55official
146llama-3.2-3b-instruct95.5official
147gemini-3.6-flash95.45official
147glm-4.695.45official
147glm-5-turbo95.45official
147grok-495.45official
147nemotron-3-ultra-550b-a55b95.45official
152gemini-1.5-pro95.41official
152granite-3.0-1b-a400m-instruct95.41official
154o3-mini95.36official
155kimi-k2.695.27official
156gpt-4.1-mini95.23official
157gpt-5-mini95.2official
158mixtral-8x7b-instruct95.18official
159qwen2.5-3b-instruct95.09official
160gemma-3-4b95.05official
160o395.05official
162llama-3-8b-instruct-mopeymule94.7official
163mistral-7b-instruct94.65official
164deepseek-v3.2-exp94.55official
164gpt-4.194.55official
164mistral-small-latest94.55official
164qwen3-vl-235b-a22b-instruct94.55official
168ai21-jamba-instruct-v1.094.45official
169k2-chat94.41official
170grok-4.594.36official
170krutrim-2-instruct94.36official
172qwen2.5-7b-instruct-1m94.18official
173h2o-danube3-4b-chat94.09official
174zephyr-7b-beta93.94official
175gpt-5.6-luna93.82official
175hunyuan-a13b-instruct93.82official
175seallms-v3-7b-chat93.82official
178gemini-2.0-flash93.64official
179deepseek-chat93.55official
180deepseek-v3.193.45official
181qwen2.5-0.5b-instruct93.36official
182o4-mini93.27official
183deepseek-llm-67b-chat93.14official
183jamba-large-1.693.14official
185gpt-493.09official
186open-codestral-mamba92.91official
187sarvam-192.88official
188deepseek-v4-pro92.55official
189gpt-5.6-terra92.36official
190mistral-large-latest92.27official
191falcon-h1-0.5b-instruct92.14official
192llama-3.1-8b-instruct92.07official
193gpt-5.592official
194jamba-1.7-large91.82official
194magistral-medium91.82official
196deepseek-v4-flash91.64official
197gemini-2.5-flash91.48official
198grok-4.391.45official
199longwriter-glm4-9b91.36official
200dbrx-instruct91.23official
200jamba-mini-1.691.23official
202gpt-5.6-sol91.09official
203kimi-k290.97official
204gemini-2.0-flash-lite-preview90.73official
205gemini-1.5-flash90.59official
206jamba-1.7-mini90.5official
207smollm-360m-instruct90official
208ai21-jamba-1.5-large-v1.089.64official
208deepseek-v389.64official
210magistral-small89.59official
211gpt-3.5-turbo89.18official
212gpt-oss-120b89.09official
213command-r-plus88.8official
214nexusraven-v2-13b88.64official
215aya-23-8b86.64official
216nous-hermes-2-mixtral-8x7b-dpo86.59official
217ai21-jamba-1.5-mini-v1.086.36official
218codellama-7b-instruct-hf84.82official
219grok-4.1-fast84.18official
220gemma-2-2b-it84.14official
221aya-23-35b83.18official
222smollm2-1.7b-instruct82.77official
223h2o-danube3-500m-chat82.5official
224foundation-sec-8b82.05official
225smollm2-360m-instruct81.52official
226qwen1.5-14b-chat80.95official
227gpt-oss-20b80official
228rakutenai-7b-instruct79.24official
229qwen2.5-7b-instruct78.73official
230mistral-7b78.18official
231gemma-7b-it77.05official
231smollm-1.7b-instruct77.05official
233komodo-7b-base76.21official
234glm-4-9b-chat75.41official
235sea-lion-v1-7b-it72.58official
236falcon-mamba-7b-instruct71.09official
237gemma-2b-it70.45official
238gemma-2-9b-it70official
239qwen2-7b-instruct66.32official
240olmoe-1b-7b-instruct64.09official
241grok-361.75official
242olmo-7b-instruct-hf59.55official
243powerlm-3b57.27official
244phi-256.36official
245powermoe-3b55official
246rakutenai-7b-chat50.91official