← Evals

Evaluation profile

Enkrypt AI Safety Leaderboard

4sub-evals
2.34%Safety weight
5.7%Freedom weight
3components

Weights below are portfolio-specific global index weights.

Model score (higher is better)Predicted score

About this eval

Resistance to Enkrypt bias, CBRN, harmful-content, and toxicity red-team tests.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirection by rankingSafety weightFreedom weight
bias_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:bias_attack_non_success_rateMeasures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.Safety: human_rights_systemic_harm:0.800|ordinary_harm_misuse_resistance:0.200enkrypt-aiSafety: higher0.975%—
cbrn_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:cbrn_attack_non_success_rateMeasures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.Safety: ordinary_harm_misuse_resistance:0.400|responsible_agency_control:0.600 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.425%1.9%
harmful_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:harmful_attack_non_success_rateMeasures how often Enkrypt's harmful-content attacks do not succeed.Safety: human_rights_systemic_harm:0.150|ordinary_harm_misuse_resistance:0.700|responsible_agency_control:0.150 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.401%1.9%
toxicity_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:toxicity_attack_non_success_rateMeasures how often Enkrypt's toxicity-generation attacks do not succeed.Safety: human_rights_systemic_harm:0.350|ordinary_harm_misuse_resistance:0.650 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.537%1.9%

bias_attack_non_success_rate

Measures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2mistral-nemo-minitron-8b-instruct92.51official
3mistral-7b86.56official
4smollm-360m-instruct76.23official
5claude-3-opus74.42official
5claude-opus-5.574.42official
7grok-4.773.39official
8claude-sonnet-570.54official
9komodo-7b-base65.63official
10grok-4.664.86official
11mistral-large-latest60.47official
12gpt-559.95official
13claude-opus-559.17official
14claude-3.5-haiku56.59official
15minimax-m2.754.52official
16llama-3.1-nemotron-instruct-70b54.26official
17llama-3.2-90b-vision-instruct52.2official
18claude-opus-4.851.94official
18minimax-m251.94official
20claude-3.5-sonnet51.68official
21qwen3.5-397b-a17b50.39official
22muse-spark-1.149.87official
23claude-sonnet-4.547.55official
23glm-5.3-flash47.55official
23sarvam-147.55official
26open-codestral-mamba46.51official
27hy343.93official
28gpt-5.143.67official
29claude-opus-443.41official
30claude-sonnet-442.89official
31fugu-ultra-v241.86official
32dolphin-2.5-mixtral-8x7b41.6official
32gpt-5.241.6official
34gpt-5-mini41.09official
35qwen3.5-122b-a10b40.31official
36gpt-oss-120b39.79official
37qwen3.5-27b39.53official
38gpt-5.6-terra39.28official
39gpt-5-nano39.02official
39inkling39.02official
41gemini-2.5-pro38.85official
42qwen2.5-72b-instruct38.63official
43gpt-5.538.5official
44gpt-6-luna37.98official
45powerlm-3b37.47official
46mistral-7b-instruct36.61official
47qwen2.5-7b-instruct35.53official
48claude-haiku-4.535.14official
48gpt-6-astra35.14official
50grok-4.533.59official
50smollm2-360m-instruct33.59official
52gemini-3.8-flash32.3official
53gemma-2-27b-it31.78official
54lfm2.1-2b31.52official
54phi-231.52official
56mistral-large-430.75official
57glm-4.530.49official
57mercury-230.49official
59powermoe-3b29.2official
60mimo-v2.5-pro28.94official
61kimi-k228.81official
62foundation-sec-8b-instruct28.68official
62kimi-k2.628.68official
64gpt-6-sol28.42official
65gpt-5.6-sol27.91official
66gpt-oss-20b27.65official
67qwen3-vl-235b-a22b-instruct27.39official
68qwen3.5-35b-a3b26.61official
69gpt-4-turbo26.36official
69lfm2-700m26.36official
69sea-lion-v1-7b-it26.36official
72apriel-v1.5-15b-thinker26.1official
73gemma-2-2b-it25.84official
74gpt-oss-safeguard-20b25.58official
74qwen3.7-max25.58official
76deepseek-r125.06official
77gemini-2.5-flash24.84official
78cogito-v2.124.55official
79rakutenai-7b-chat24.29official
80claude-opus-4.723.51official
80glm-5.123.51official
80o1-preview23.51official
83deepseek-v3.2-exp23official
83jamba-1.7-large23official
83nexusraven-v2-13b23official
83nova-premier23official
83o323official
88claude-opus-4.622.74official
89qwen2-57b-a14b-instruct22.22official
89qwen3-235b-a22b-instruct22.22official
89smaug-llama-3-70b-instruct22.22official
92gpt-5.6-luna21.96official
93claude-3-sonnet21.71official
94deepseek-v3.121.19official
94fugu-max21.19official
94starling-lm-7b-beta21.19official
97gpt-4o20.67official
97hunyuan-a13b-instruct20.67official
99gemma-7b-it20.41official
99internlm2-chat-20b20.41official
99minimax-m320.41official
102o4-mini20.16official
103gemini-3.5-flash19.64official
103qwen2-7b-instruct19.64official
103qwen3.8-max19.64official
106grok-319.38official
106lfm2-350m19.38official
108apertus-8b-instruct19.12official
108o1-mini19.12official
108qwen1.5-14b-chat19.12official
108reflection-llama-3.1-70b19.12official
112claude-sonnet-4.618.86official
113granite-4.0-h-small18.6official
113llama-2-7b-chat18.6official
113llama-3-8b-instruct-rr18.6official
116glm-4-9b-chat18.35official
116llama-3.1-8b-instruct18.35official
118apertus-70b-instruct18.09official
118jamba-1.7-mini18.09official
118o3-mini18.09official
121gpt-4.117.83official
121longwriter-glm4-9b17.83official
121o117.83official
124llama-3-8b-instruct17.19official
125gemma-3-27b-it17.05official
126aya-23-35b16.8official
126olmo-7b-instruct-hf16.8official
126phi-416.8official
129falcon-h1-0.5b-instruct16.54official
129llama-3-8b-instruct-mopeymule16.54official
131magistral-small16.54official
132gemini-3.6-flash16.28official
132jamba-large-1.616.28official
132kimi-k2.516.28official
132meta-secalign-8b16.28official
132qwen2.5-max16.28official
137llama-3-70b-instruct16.02official
138claude-3.7-sonnet16.02official
138gemma-2-9b-it16.02official
138gemma-3-4b16.02official
138mimo-v2.6-pro16.02official
138qwen2.5-14b-instruct-1m16.02official
143kimi-k2.7-code15.76official
143magistral-medium15.76official
143qwen2-72b-instruct15.76official
146gpt-4.1-mini15.5official
146mimo-v2.6-pro-ultraspeed15.5official
146zephyr-7b-beta15.5official
149c4ai-aya-expanse-32b15.25official
149gpt-415.25official
149grok-build-0.115.25official
149mistral-small-315.25official
149nova-pro15.25official
154aya-expanse-8b14.99official
154granite-4.0-h-tiny14.99official
154granite-4.0-micro14.99official
154nova-lite14.99official
154olmoe-1b-7b-instruct14.99official
154phi-3.5-moe-instruct14.99official
160deepseek-chat14.73official
160deepseek-v4-flash14.73official
160deepseek-v4-pro14.73official
160gemini-1.5-pro14.73official
160nemotron-3-super-120b-a12b14.73official
160qwen2-vl-72b-instruct14.73official
160yi-1.5-9b-chat14.73official
167falcon-mamba-7b-instruct14.47official
167qwen2.5-32b-instruct14.47official
169mistral-small-latest14.21official
170ai21-jamba-1.5-large-v1.013.95official
170gemini-2.0-flash-lite-preview13.95official
170gemma-sea-lion-v3-9b-it13.95official
170granite-4.0-h-micro13.95official
170llama-4-scout13.95official
175gemini-2.0-flash13.7official
175glm-5.213.7official
175gpt-4o-mini13.7official
175llama-3.1-70b-instruct13.7official
175phi-3-mini-128k-instruct13.7official
175phi-3-small-128k-instruct13.7official
175phi-4-mini13.7official
182deepseek-v313.18official
182gemma-3-12b13.18official
182granite-3.2-2b-instruct13.18official
182krutrim-2-instruct13.18official
182llama-3.2-instruct-11b-vision13.18official
182phi-3-mini-4k-instruct13.18official
182qwen2.5-7b-instruct-1m13.18official
182rakutenai-7b-instruct13.18official
182wizardlm-2-8x22b13.18official
191claude-3-haiku12.92official
191gemma-4-26b-a4b-it12.92official
191gpt-4.1-nano12.92official
191gpt-5.412.92official
191grok-4.312.92official
191llama-3.1-405b-instruct12.92official
191nova-micro12.92official
191qwen2.5-14b-instruct12.92official
199glm-4.612.66official
199granite-3.0-8b-instruct12.66official
199jamba-mini-1.612.66official
199k2-chat12.66official
199laguna-s-2.1-poolside12.66official
199laguna-xs-2.1-poolside12.66official
199nemotron-3-ultra-550b-a55b12.66official
199phi-3-medium-4k-instruct12.66official
199qwq-32b-preview12.66official
208granite-3.2-8b-instruct12.4official
208grok-412.4official
208llama-2-70b-chat12.4official
211granite-3.2-8b-instruct-preview12.27official
212ai21-jamba-1.5-mini-v1.012.14official
212gemini-1.5-flash12.14official
212grok-4.1-fast12.14official
212phi-3-small-8k-instruct12.14official
216dbrx-instruct11.89official
216glm-5-turbo11.89official
216granite-3.1-8b-instruct11.89official
216ling-3.0-flash11.89official
216mixtral-8x22b-instruct11.89official
216phi-3-medium-128k-instruct11.89official
222seallm-7b-v211.63official
223mixtral-8x7b-instruct11.37official
223phi-3.5-mini-instruct11.37official
225llama-2-13b-chat11.11official
225llama-3.2-3b-instruct11.11official
225llama-3.3-70b-instruct11.11official
225nous-hermes-2-mixtral-8x7b-dpo11.11official
225seallms-v3-7b-chat11.11official
230llama-3.1-tulu-3-8b10.85official
231granite-3.0-3b-a800m-instruct10.59official
231mimo-v2.6-flash10.59official
231olmo-2-7b-instruct10.59official
231qwen2.5-3b-instruct10.59official
235gemma-4-12b10.34official
235granite-3.1-2b-instruct10.34official
235llama-4-maverick10.34official
238deepseek-r1-distill-qwen-7b10.08official
238gpt-3.5-turbo10.08official
240amazon-titan-text-express-v19.82official
240llama-3.1-tulu-3-8b-dpo9.82official
240llama-3.1-tulu-3-8b-sft9.82official
243aya-23-8b9.56official
243deepseek-llm-67b-chat9.56official
243granite-3.0-2b-instruct9.56official
243ling-3.0-flash-vl9.56official
247ai21-jamba-instruct-v1.09.3official
247qwen3-235b-a22b9.3official
249sarvam-105b9.04official
250gemma-4-31b-it8.53official
250qwen3-30b-a3b8.53official
252deepseek-r1-distill-llama-8b8.27official
252granite-3.1-3b-a800m-instruct8.27official
254qwen2.5-1.5b-instruct8.01official
255h2o-danube3-500m-chat7.49official
256h2o-danube3-4b-chat6.98official
256qwq-32b6.98official
258codellama-7b-instruct-hf6.72official
259gemma-4-e4b6.2official
260granite-3.0-1b-a400m-instruct5.43official
261sarvam-30b4.39official
261smollm2-1.7b-instruct4.39official
263foundation-sec-8b4.13official
263gemma-2b-it4.13official
263llama-3.2-1b-instruct4.13official
266qwen2.5-0.5b-instruct3.88official
266smollm-1.7b-instruct3.88official
268qwen3-8b2.33official
269command-a1.81official
270gemma-4-e2b1.55official
271command-r-plus1.16official
272command-r7b0.52official

cbrn_attack_non_success_rate

Measures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2hy399.5official
3claude-3.5-sonnet98.17official
4gpt-5-nano98official
5llama-3-8b-instruct-mopeymule97.33official
6meta-secalign-8b97.17official
7claude-3.5-haiku97official
8gpt-5-mini96.83official
9claude-3-sonnet96.33official
9claude-opus-4.796.33official
9o196.33official
12claude-3-opus95.67official
12komodo-7b-base95.67official
14o1-preview95.5official
14qwq-32b-preview95.5official
16llama-3-8b-instruct-rr95.33official
17aya-expanse-8b95.17official
17claude-3.7-sonnet95.17official
17gemma-2-9b-it95.17official
20phi-495official
21gpt-4-turbo94.67official
21sea-lion-v1-7b-it94.67official
23amazon-titan-text-express-v194.5official
23apriel-v1.5-15b-thinker94.5official
23nova-pro94.5official
26c4ai-aya-expanse-32b94.33official
26gemma-2b-it94.33official
26longwriter-glm4-9b94.33official
29gpt-4o93.83official
29krutrim-2-instruct93.83official
31dolphin-2.5-mixtral-8x7b93.67official
31muse-spark-1.193.67official
33gpt-5.193.5official
33wizardlm-2-8x22b93.5official
35gemini-2.0-flash93.33official
35internlm2-chat-20b93.33official
35mistral-nemo-minitron-8b-instruct93.33official
38qwq-32b93official
39gpt-592.89official
40claude-3-haiku92.67official
40nova-lite92.67official
40o1-mini92.67official
43claude-sonnet-592.5official
43deepseek-r1-distill-qwen-7b92.5official
45qwen2.5-max92.33official
46llama-3.1-tulu-3-8b-dpo92.17official
47claude-opus-4.892official
47gpt-4o-mini92official
47llama-3.1-tulu-3-8b92official
47phi-3.5-mini-instruct92official
51hunyuan-a13b-instruct91.83official
51llama-2-13b-chat91.83official
53aya-23-35b91.67official
53llama-3.2-90b-vision-instruct91.67official
53o3-mini91.67official
56nova-premier91.5official
56smaug-llama-3-70b-instruct91.5official
58claude-opus-4.691.33official
58gemini-2.0-flash-lite-preview91.33official
58gpt-491.33official
58inkling91.33official
62deepseek-chat91.17official
62jamba-mini-1.691.17official
62llama-4-maverick91.17official
62zephyr-7b-beta91.17official
66ai21-jamba-1.5-large-v1.091official
67apertus-70b-instruct90.83official
67aya-23-8b90.83official
67deepseek-r1-distill-llama-8b90.83official
67llama-3.1-nemotron-instruct-70b90.83official
67llama-3.2-instruct-11b-vision90.83official
72gemma-3-12b90.67official
72mistral-small-390.67official
72mixtral-8x22b-instruct90.67official
75nexusraven-v2-13b90.5official
75sarvam-105b90.5official
77foundation-sec-8b-instruct90.33official
77gemma-3-27b-it90.33official
77granite-3.1-8b-instruct90.33official
77nova-micro90.33official
77o390.33official
77qwen2-72b-instruct90.33official
83gemini-1.5-pro90.17official
83granite-4.0-micro90.17official
83llama-3.1-405b-instruct90.17official
83mistral-large-latest90.17official
87granite-3.2-8b-instruct-preview90.09official
88gpt-4.190official
88phi-3-mini-128k-instruct90official
90claude-opus-5.589.83official
90gpt-5.289.83official
90llama-2-7b-chat89.83official
90mistral-7b89.83official
94gemma-2-27b-it89.67official
94h2o-danube3-4b-chat89.67official
94olmo-2-7b-instruct89.67official
94phi-3-medium-4k-instruct89.67official
94qwen2.5-72b-instruct89.67official
99claude-haiku-4.589.5official
99gpt-4.1-nano89.5official
99phi-3-mini-4k-instruct89.5official
102granite-3.1-3b-a800m-instruct89.33official
102qwen2.5-32b-instruct89.33official
102sarvam-30b89.33official
105gemma-sea-lion-v3-9b-it89.17official
105qwen2.5-14b-instruct89.17official
107ai21-jamba-instruct-v1.089official
108starling-lm-7b-beta88.83official
108yi-1.5-9b-chat88.83official
110gpt-4.1-mini88.67official
110granite-3.2-8b-instruct88.67official
110granite-4.0-h-small88.67official
110seallm-7b-v288.67official
114gemma-3-4b88.5official
114llama-2-70b-chat88.5official
114llama-3.1-tulu-3-8b-sft88.5official
114sarvam-188.5official
114smollm2-360m-instruct88.5official
119cogito-v2.188.33official
119granite-3.1-2b-instruct88.33official
119jamba-large-1.688.33official
119llama-3.2-1b-instruct88.33official
119rakutenai-7b-instruct88.33official
124mistral-small-latest88.17official
124nous-hermes-2-mixtral-8x7b-dpo88.17official
126grok-388official
127llama-3-70b-instruct87.83official
127llama-3.3-70b-instruct87.83official
127llama-4-scout87.83official
130granite-3.2-2b-instruct87.5official
130granite-4.0-h-micro87.5official
130phi-3-small-8k-instruct87.5official
130smollm-360m-instruct87.5official
134deepseek-v387.33official
134granite-4.0-h-tiny87.33official
134o4-mini87.33official
134phi-3-medium-128k-instruct87.33official
134phi-3.5-moe-instruct87.33official
139gpt-3.5-turbo87.17official
139phi-3-small-128k-instruct87.17official
141claude-sonnet-4.587official
141k2-chat87official
141qwen2.5-3b-instruct87official
141qwen2.5-7b-instruct-1m87official
141reflection-llama-3.1-70b87official
146granite-3.0-8b-instruct86.83official
147gemini-1.5-flash86.67official
147h2o-danube3-500m-chat86.67official
147mixtral-8x7b-instruct86.67official
150llama-3.1-70b-instruct86.5official
150qwen1.5-14b-chat86.5official
152mistral-7b-instruct86.39official
153phi-4-mini86.33official
153qwen2-57b-a14b-instruct86.33official
155gpt-oss-120b86.17official
156ai21-jamba-1.5-mini-v1.086official
156gemma-2-2b-it86official
156minimax-m286official
159apertus-8b-instruct85.83official
159llama-3-8b-instruct85.83official
161llama-3.2-3b-instruct85.67official
162phi-285.33official
163dbrx-instruct85.17official
163qwen2.5-1.5b-instruct85.17official
163qwen2.5-14b-instruct-1m85.17official
166minimax-m2.785official
167claude-sonnet-4.684.67official
167qwen2-vl-72b-instruct84.67official
167qwen3-235b-a22b-instruct84.67official
167seallms-v3-7b-chat84.67official
171olmoe-1b-7b-instruct84.5official
172gemini-2.5-flash84.17official
173llama-3.1-8b-instruct83.91official
174falcon-mamba-7b-instruct83.83official
174granite-3.0-1b-a400m-instruct83.83official
176rakutenai-7b-chat83.67official
177deepseek-llm-67b-chat83.5official
177qwen2-7b-instruct83.5official
177qwen2.5-7b-instruct83.5official
180gpt-5.483.33official
181magistral-medium83.17official
182command-r-plus83.16official
183deepseek-v4-pro82.67official
184qwen3-vl-235b-a22b-instruct82.5official
185glm-4-9b-chat82.33official
186granite-3.0-2b-instruct82.17official
187gpt-oss-safeguard-20b82official
187granite-3.0-3b-a800m-instruct82official
189deepseek-v3.181.67official
189grok-4.781.67official
191deepseek-v3.2-exp81.5official
192kimi-k281.44official
193open-codestral-mamba81.33official
193qwen2.5-0.5b-instruct81.33official
195gpt-oss-20b81official
196gpt-5.6-sol80.83official
196powerlm-3b80.83official
196smollm-1.7b-instruct80.83official
199magistral-small80.34official
200gpt-5.6-terra80official
201lfm2.1-2b79.5official
202gpt-5.579.33official
203falcon-h1-0.5b-instruct79.17official
203gemini-2.5-pro79.17official
205glm-5.179official
205lfm2-700m79official
205olmo-7b-instruct-hf79official
208gemma-7b-it78.83official
209smollm2-1.7b-instruct78.5official
210gpt-5.6-luna77.83official
211glm-4.577.67official
212foundation-sec-8b77.33official
213grok-476.83official
214glm-5-turbo76official
214grok-4.676official
216qwen3.5-397b-a17b75.5official
217jamba-1.7-mini75.33official
218claude-opus-475official
219claude-opus-574.83official
220glm-4.674.67official
220grok-4.574.67official
222qwen3.8-max74official
223jamba-1.7-large73.17official
223qwen3.5-35b-a3b73.17official
225command-a72.67official
226powermoe-3b72.33official
227grok-4.1-fast71.83official
228mimo-v2.6-pro71.67official
229command-r7b71.33official
230qwen3.5-27b71.17official
231codellama-7b-instruct-hf70.5official
232deepseek-v4-flash70.33official
233qwen3.5-122b-a10b70.17official
234lfm2-350m69.67official
235fugu-ultra-v269official
236gpt-6-sol68.17official
237gemma-4-e2b68official
238gpt-6-luna67official
238qwen3-8b67official
240gemma-4-e4b66.83official
240kimi-k2.566.83official
242gemma-4-31b-it66.67official
243gpt-6-astra65.67official
244gemma-4-12b65.5official
245grok-4.365.17official
246gemini-3.8-flash63.83official
247claude-sonnet-463official
247gemma-4-26b-a4b-it63official
249kimi-k2.7-code58official
250fugu-max55.17official
251mimo-v2.6-pro-ultraspeed53.67official
252grok-build-0.153.5official
253mimo-v2.5-pro53official
254glm-5.3-flash52.83official
255mercury-252.67official
256laguna-s-2.1-poolside52.17official
257kimi-k2.651.5official
258minimax-m350.83official
258nemotron-3-super-120b-a12b50.83official
260mistral-large-450.67official
261qwen3.7-max50.17official
262glm-5.249.33official
263mimo-v2.6-flash48.33official
264gemini-3.5-flash48official
265laguna-xs-2.1-poolside47.83official
265ling-3.0-flash-vl47.83official
267ling-3.0-flash47.33official
267nemotron-3-ultra-550b-a55b47.33official
269gemini-3.6-flash47.17official
270deepseek-r146.5official
271qwen3-30b-a3b44.33official
272qwen3-235b-a22b43.33official

harmful_attack_non_success_rate

Measures how often Enkrypt's harmful-content attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1claude-sonnet-5100official
1gpt-5.4100official
1gpt-5.6-luna100official
1gpt-6-luna100official
1gpt-6-sol100official
1grok-4.5100official
1grok-4.7100official
1muse-spark-1.1100official
10claude-opus-4.699.44official
10claude-opus-4.799.44official
10claude-opus-4.899.44official
10claude-opus-599.44official
10claude-sonnet-499.44official
10claude-sonnet-4.599.44official
10claude-sonnet-4.699.44official
10gpt-5.599.44official
10gpt-5.6-sol99.44official
10grok-4.699.44official
10qwen3.8-max99.44official
21claude-haiku-4.598.89official
21claude-opus-498.89official
21mercury-298.89official
21mistral-large-498.89official
21qwen3.5-27b98.89official
26claude-3.7-sonnet98.33official
26claude-opus-5.598.33official
26fugu-ultra-v298.33official
26kimi-k2.7-code98.33official
26mimo-v2.6-pro-ultraspeed98.33official
26o1-preview98.33official
26qwen3.5-35b-a3b98.33official
33fugu-max97.78official
33glm-5.3-flash97.78official
33gpt-5.6-terra97.78official
33inkling97.78official
33mimo-v2.5-pro97.78official
33mimo-v2.6-flash97.78official
33mimo-v2.6-pro97.78official
33minimax-m2.797.78official
33qwen3.5-122b-a10b97.78official
42claude-3.5-sonnet97.5official
43gpt-6-astra97.22official
43qwen3.5-397b-a17b97.22official
45phi-496.67official
46gemini-3.8-flash96.11official
46o196.11official
46sarvam-105b96.11official
49gemma-4-12b95.56official
50gemma-4-26b-a4b-it95official
50grok-4.395official
52claude-3.5-haiku94.44official
52kimi-k2.594.44official
52ling-3.0-flash-vl94.44official
52meta-secalign-8b94.44official
52minimax-m394.44official
57gemma-4-31b-it93.89official
57ling-3.0-flash93.89official
57o393.89official
60claude-3-sonnet93.33official
60gpt-593.33official
62gpt-5-nano92.78official
62hy392.78official
62o1-mini92.78official
65claude-3-opus92.22official
65llama-3-8b-instruct-mopeymule92.22official
65nemotron-3-super-120b-a12b92.22official
68gpt-5.291.67official
68granite-4.0-h-tiny91.67official
70gemini-3.6-flash91.11official
70glm-5.191.11official
70gpt-5-mini91.11official
70llama-3.2-1b-instruct91.11official
70qwen3.7-max91.11official
75glm-5.290.56official
75kimi-k2.690.56official
75nemotron-3-ultra-550b-a55b90.56official
78minimax-m289.44official
79llama-3-8b-instruct89.16official
80glm-5-turbo88.89official
80granite-4.0-micro88.89official
82cogito-v2.188.33official
82llama-2-13b-chat88.33official
84llama-2-70b-chat87.78official
84llama-3-70b-instruct87.78official
86claude-3-haiku87.22official
86qwen2-72b-instruct87.22official
88foundation-sec-8b-instruct86.67official
88gemma-4-e2b86.67official
88grok-build-0.186.67official
88olmo-2-7b-instruct86.67official
92krutrim-2-instruct86.11official
92llama-3.1-tulu-3-8b-sft86.11official
94gemma-4-e4b85.56official
94gpt-oss-120b85.56official
94granite-4.0-h-small85.56official
94llama-2-7b-chat85.56official
94llama-3.2-instruct-11b-vision85.56official
99gemini-3.5-flash85official
99llama-3.2-3b-instruct85official
99o4-mini85official
102nova-lite84.44official
102o3-mini84.44official
104gpt-5.183.89official
104sarvam-30b83.89official
106llama-3-8b-instruct-rr83.33official
107llama-3.1-tulu-3-8b82.78official
108llama-4-maverick82.22official
108nova-pro82.22official
110k2-chat81.67official
110llama-3.1-tulu-3-8b-dpo81.67official
112gemma-2-9b-it81.11official
113gpt-480.56official
113gpt-oss-20b80.56official
113nova-premier80.56official
116qwen3-235b-a22b-instruct80official
117nova-micro79.44official
117phi-3.5-mini-instruct79.44official
119kimi-k279.16official
120amazon-titan-text-express-v178.89official
120apriel-v1.5-15b-thinker78.89official
120granite-4.0-h-micro78.89official
123deepseek-v4-pro77.78official
124gemma-2b-it77.22official
125deepseek-v4-flash76.67official
126gpt-4-turbo76.11official
126granite-3.1-3b-a800m-instruct76.11official
126phi-3.5-moe-instruct76.11official
129phi-3-mini-4k-instruct75.56official
130gpt-4.175official
130granite-3.0-8b-instruct75official
130laguna-s-2.1-poolside75official
130llama-3.2-90b-vision-instruct75official
130qwq-32b-preview75official
135gemma-2-2b-it74.44official
135gpt-oss-safeguard-20b74.44official
137gemma-2-27b-it73.89official
137phi-3-medium-128k-instruct73.89official
139qwen2.5-72b-instruct73.62official
140apertus-70b-instruct73.33official
140codellama-7b-instruct-hf73.33official
140llama-3.1-405b-instruct73.33official
140llama-3.1-8b-instruct73.33official
144llama-3.1-nemotron-instruct-70b72.22official
144phi-3-mini-128k-instruct72.22official
146granite-3.1-8b-instruct71.67official
146internlm2-chat-20b71.67official
146reflection-llama-3.1-70b71.67official
149phi-3-small-8k-instruct71.11official
150komodo-7b-base70.56official
150qwen3-vl-235b-a22b-instruct70.56official
152qwen2.5-14b-instruct69.44official
152smaug-llama-3-70b-instruct69.44official
154c4ai-aya-expanse-32b68.89official
155gemini-1.5-pro68.33official
155llama-4-scout68.33official
157gpt-4o67.78official
157phi-3-small-128k-instruct67.78official
159aya-expanse-8b67.22official
159qwen2.5-max67.22official
161llama-3.3-70b-instruct66.11official
162phi-3-medium-4k-instruct64.44official
163gemini-2.0-flash63.89official
164grok-4.1-fast63.33official
165llama-3.1-70b-instruct62.78official
166qwen2-7b-instruct62.22official
166qwen3-8b62.22official
168granite-3.0-2b-instruct61.67official
168qwen2.5-14b-instruct-1m61.67official
168seallm-7b-v261.67official
168seallms-v3-7b-chat61.67official
172gpt-4o-mini60.56official
172phi-4-mini60.56official
174gpt-4.1-nano60official
174qwen2.5-32b-instruct60official
176granite-3.0-1b-a400m-instruct59.44official
177deepseek-v3.158.89official
177granite-3.0-3b-a800m-instruct58.89official
179deepseek-chat58.33official
179gpt-4.1-mini58.33official
179qwen2-vl-72b-instruct58.33official
182longwriter-glm4-9b57.78official
182qwen1.5-14b-chat57.78official
182wizardlm-2-8x22b57.78official
185gemma-3-27b-it56.11official
186gemini-1.5-flash55.56official
186gemma-sea-lion-v3-9b-it55.56official
186lfm2-700m55.56official
186lfm2.1-2b55.56official
186qwen2-57b-a14b-instruct55.56official
186sea-lion-v1-7b-it55.56official
192glm-4.655official
192granite-3.1-2b-instruct55official
192granite-3.2-2b-instruct55official
195gemini-2.5-flash54.63official
196gemma-7b-it54.44official
196laguna-xs-2.1-poolside54.44official
196mistral-nemo-minitron-8b-instruct54.44official
196qwen2.5-1.5b-instruct54.44official
196smollm2-1.7b-instruct54.44official
201gemini-2.0-flash-lite-preview53.89official
201mixtral-8x22b-instruct53.89official
203apertus-8b-instruct53.33official
204gemma-3-12b52.78official
205deepseek-v352.22official
205glm-4.552.22official
205qwen2.5-7b-instruct-1m52.22official
208nexusraven-v2-13b50.56official
209granite-3.2-8b-instruct50official
210granite-3.2-8b-instruct-preview49.45official
211jamba-large-1.649.44official
212command-a48.89official
212gemma-3-4b48.89official
214glm-4-9b-chat48.33official
214smollm-1.7b-instruct48.33official
216starling-lm-7b-beta47.78official
217deepseek-v3.2-exp46.67official
217qwen3-235b-a22b46.67official
219aya-23-35b46.11official
219jamba-1.7-large46.11official
221falcon-mamba-7b-instruct45.56official
221mistral-small-345.56official
223gemini-2.5-pro45.37official
224qwen2.5-7b-instruct45.27official
225command-r7b45official
226ai21-jamba-1.5-large-v1.043.89official
226ai21-jamba-instruct-v1.043.89official
226h2o-danube3-4b-chat43.89official
226lfm2-350m43.89official
230deepseek-r142.22official
230jamba-1.7-mini42.22official
232qwen2.5-3b-instruct41.67official
233aya-23-8b41.11official
233hunyuan-a13b-instruct41.11official
235grok-340.56official
235yi-1.5-9b-chat40.56official
237rakutenai-7b-instruct40official
238command-r-plus39.72official
239mistral-small-latest39.44official
239sarvam-139.44official
241mistral-large-latest38.89official
242ai21-jamba-1.5-mini-v1.038.33official
242deepseek-llm-67b-chat38.33official
242jamba-mini-1.638.33official
242mixtral-8x7b-instruct38.33official
242qwen3-30b-a3b38.33official
247gpt-3.5-turbo37.22official
248mistral-7b36.67official
249magistral-small34.72official
250dbrx-instruct34.44official
250falcon-h1-0.5b-instruct34.44official
252grok-433.89official
252qwq-32b33.89official
254magistral-medium33.33official
254smollm2-360m-instruct33.33official
256dolphin-2.5-mixtral-8x7b32.22official
257open-codestral-mamba31.67official
257powerlm-3b31.67official
259mistral-7b-instruct31.3official
260olmoe-1b-7b-instruct31.11official
260qwen2.5-0.5b-instruct31.11official
262smollm-360m-instruct28.89official
263powermoe-3b28.33official
264h2o-danube3-500m-chat27.22official
265deepseek-r1-distill-qwen-7b25.56official
265olmo-7b-instruct-hf25.56official
267rakutenai-7b-chat24.44official
268deepseek-r1-distill-llama-8b22.78official
269foundation-sec-8b22.22official
270phi-221.67official
271zephyr-7b-beta20official
272nous-hermes-2-mixtral-8x7b-dpo18.89official

toxicity_attack_non_success_rate

Measures how often Enkrypt's toxicity-generation attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1dolphin-2.5-mixtral-8x7b100official
1gemma-2-27b-it100official
1mistral-nemo-minitron-8b-instruct100official
1smaug-llama-3-70b-instruct100official
6claude-3.5-sonnet99.95official
7claude-3-opus99.91official
7granite-3.0-3b-a800m-instruct99.91official
9apriel-v1.5-15b-thinker99.82official
9claude-sonnet-599.82official
9granite-3.1-2b-instruct99.82official
9granite-3.2-2b-instruct99.82official
13claude-sonnet-499.77official
13granite-3.1-3b-a800m-instruct99.77official
15granite-3.1-8b-instruct99.68official
16claude-3-sonnet99.64official
16granite-4.0-h-small99.64official
16granite-4.0-h-tiny99.64official
16llama-2-70b-chat99.64official
20foundation-sec-8b-instruct99.55official
20granite-3.2-8b-instruct99.55official
20llama-2-13b-chat99.55official
23granite-3.0-2b-instruct99.5official
23llama-2-7b-chat99.5official
25claude-3-haiku99.45official
25granite-4.0-micro99.45official
25seallm-7b-v299.45official
28apertus-70b-instruct99.36official
28claude-3.5-haiku99.36official
28qwen2-72b-instruct99.36official
31claude-3.7-sonnet99.32official
32claude-opus-4.899.27official
32cogito-v2.199.27official
34claude-opus-499.18official
34phi-499.18official
36granite-4.0-h-micro99.09official
36minimax-m299.09official
38llama-3.1-nemotron-instruct-70b99.05official
38llama-3.1-tulu-3-8b-dpo99.05official
40granite-3.2-8b-instruct-preview99official
40yi-1.5-9b-chat99official
42llama-3-70b-instruct98.95official
43aya-expanse-8b98.95official
44apertus-8b-instruct98.91official
44claude-haiku-4.598.91official
44qwen2.5-72b-instruct98.91official
47llama-3.2-1b-instruct98.82official
48claude-sonnet-4.598.73official
48grok-4.798.73official
50qwq-32b-preview98.68official
51claude-opus-4.798.55official
51llama-3.2-instruct-11b-vision98.55official
53starling-lm-7b-beta98.48official
54gpt-4o98.41official
54meta-secalign-8b98.41official
56c4ai-aya-expanse-32b98.36official
56qwen3.5-35b-a3b98.36official
56sarvam-105b98.36official
59gpt-4-turbo98.32official
59phi-3.5-moe-instruct98.32official
59qwen2-57b-a14b-instruct98.32official
62reflection-llama-3.1-70b98.2official
63llama-3.1-tulu-3-8b98.18official
63mimo-v2.5-pro98.18official
63minimax-m2.798.18official
63nemotron-3-super-120b-a12b98.18official
63phi-3-small-8k-instruct98.18official
63qwen3-8b98.18official
69qwen3-235b-a22b98.14official
70deepseek-r1-distill-llama-8b98.09official
70qwen2.5-max98.09official
72gemma-3-12b98.05official
72llama-4-scout98.05official
74gemma-4-e4b98official
74gpt-4o-mini98official
74inkling98official
77amazon-titan-text-express-v197.95official
77deepseek-r1-distill-qwen-7b97.95official
77llama-3-8b-instruct-rr97.95official
80deepseek-r197.91official
80qwen3-30b-a3b97.91official
82llama-3.2-90b-vision-instruct97.86official
82phi-3-medium-4k-instruct97.86official
82qwen2.5-32b-instruct97.86official
85claude-opus-597.82official
85ling-3.0-flash97.82official
85llama-4-maverick97.82official
85olmo-2-7b-instruct97.82official
89granite-3.0-8b-instruct97.77official
90qwen2.5-14b-instruct97.73official
91glm-5.3-flash97.64official
91mercury-297.64official
91minimax-m397.64official
91o1-preview97.64official
95qwen2-vl-72b-instruct97.59official
96llama-3.1-tulu-3-8b-sft97.45official
96mimo-v2.6-pro97.45official
96mixtral-8x22b-instruct97.45official
96phi-3.5-mini-instruct97.45official
96qwen3.5-397b-a17b97.45official
101o197.41official
102gemma-3-27b-it97.36official
103gemini-3.5-flash97.27official
103glm-5.297.27official
103gpt-5.497.27official
103laguna-s-2.1-poolside97.27official
103ling-3.0-flash-vl97.27official
103nova-premier97.27official
103o1-mini97.27official
110llama-3.3-70b-instruct97.18official
111lfm2-350m97.12official
111lfm2.1-2b97.12official
113gemma-4-26b-a4b-it97.09official
113gpt-597.09official
113kimi-k2.7-code97.09official
113mistral-large-497.09official
117nova-micro97.05official
117phi-3-medium-128k-instruct97.05official
119claude-opus-5.596.91official
119gemma-4-12b96.91official
119gpt-5-nano96.91official
119gpt-oss-safeguard-20b96.91official
119hy396.91official
124qwq-32b96.86official
125gpt-5.296.73official
125grok-4.696.73official
125phi-3-small-128k-instruct96.73official
125sarvam-30b96.73official
129gemini-3.8-flash96.55official
129mimo-v2.6-flash96.55official
129mistral-small-396.55official
132llama-3-8b-instruct96.45official
133phi-4-mini96.45official
133qwen2.5-14b-instruct-1m96.45official
135internlm2-chat-20b96.41official
136fugu-max96.36official
136gemma-4-e2b96.36official
136kimi-k2.596.36official
136laguna-xs-2.1-poolside96.36official
136qwen2.5-1.5b-instruct96.36official
136qwen3.5-122b-a10b96.36official
136qwen3.5-27b96.36official
143lfm2-700m96.21official
144mimo-v2.6-pro-ultraspeed96.18official
144wizardlm-2-8x22b96.18official
146gpt-4.1-nano96.14official
147command-a96.05official
147llama-3.1-405b-instruct96.05official
147phi-3-mini-128k-instruct96.05official
150gemini-2.5-pro96.02official
151qwen3-235b-a22b-instruct95.91official
152gemma-sea-lion-v3-9b-it95.86official
153nova-lite95.82official
153nova-pro95.82official
155phi-3-mini-4k-instruct95.77official
156glm-4.595.76official
157gemma-4-31b-it95.64official
157glm-5.195.64official
157gpt-5.195.64official
157llama-3.1-70b-instruct95.64official
157muse-spark-1.195.64official
157qwen3.7-max95.64official
163command-r7b95.55official
164llama-3.2-3b-instruct95.5official
165fugu-ultra-v295.45official
165gemini-3.6-flash95.45official
165glm-4.695.45official
165glm-5-turbo95.45official
165grok-495.45official
165nemotron-3-ultra-550b-a55b95.45official
171gemini-1.5-pro95.41official
171granite-3.0-1b-a400m-instruct95.41official
173o3-mini95.36official
174kimi-k2.695.27official
175gpt-4.1-mini95.23official
176gpt-5-mini95.2official
177mixtral-8x7b-instruct95.18official
178qwen2.5-3b-instruct95.09official
179gemma-3-4b95.05official
179o395.05official
181llama-3-8b-instruct-mopeymule94.7official
182mistral-7b-instruct94.65official
183deepseek-v3.2-exp94.55official
183gpt-4.194.55official
183gpt-6-astra94.55official
183mistral-small-latest94.55official
183qwen3-vl-235b-a22b-instruct94.55official
183qwen3.8-max94.55official
189ai21-jamba-instruct-v1.094.45official
190k2-chat94.41official
191grok-4.594.36official
191krutrim-2-instruct94.36official
193qwen2.5-7b-instruct-1m94.18official
194h2o-danube3-4b-chat94.09official
195zephyr-7b-beta93.94official
196gpt-5.6-luna93.82official
196hunyuan-a13b-instruct93.82official
196seallms-v3-7b-chat93.82official
199gemini-2.0-flash93.64official
200deepseek-chat93.55official
201deepseek-v3.193.45official
202qwen2.5-0.5b-instruct93.36official
203o4-mini93.27official
204deepseek-llm-67b-chat93.14official
204jamba-large-1.693.14official
206gpt-493.09official
207gpt-6-luna92.91official
207open-codestral-mamba92.91official
209sarvam-192.88official
210deepseek-v4-pro92.55official
211gpt-5.6-terra92.36official
212mistral-large-latest92.27official
213falcon-h1-0.5b-instruct92.14official
214llama-3.1-8b-instruct92.07official
215gpt-5.592official
216jamba-1.7-large91.82official
216magistral-medium91.82official
218deepseek-v4-flash91.64official
219gemini-2.5-flash91.48official
220grok-4.391.45official
221longwriter-glm4-9b91.36official
222gpt-6-sol91.27official
223dbrx-instruct91.23official
223jamba-mini-1.691.23official
225gpt-5.6-sol91.09official
226kimi-k290.97official
227gemini-2.0-flash-lite-preview90.73official
228gemini-1.5-flash90.59official
229jamba-1.7-mini90.5official
230smollm-360m-instruct90official
231ai21-jamba-1.5-large-v1.089.64official
231deepseek-v389.64official
233magistral-small89.59official
234gpt-3.5-turbo89.18official
235gpt-oss-120b89.09official
236command-r-plus88.8official
237nexusraven-v2-13b88.64official
238grok-build-0.187.64official
239aya-23-8b86.64official
240nous-hermes-2-mixtral-8x7b-dpo86.59official
241ai21-jamba-1.5-mini-v1.086.36official
242codellama-7b-instruct-hf84.82official
243grok-4.1-fast84.18official
244gemma-2-2b-it84.14official
245aya-23-35b83.18official
246smollm2-1.7b-instruct82.77official
247h2o-danube3-500m-chat82.5official
248foundation-sec-8b82.05official
249smollm2-360m-instruct81.52official
250qwen1.5-14b-chat80.95official
251gpt-oss-20b80official
252rakutenai-7b-instruct79.24official
253qwen2.5-7b-instruct78.73official
254mistral-7b78.18official
255gemma-7b-it77.05official
255smollm-1.7b-instruct77.05official
257komodo-7b-base76.21official
258glm-4-9b-chat75.41official
259sea-lion-v1-7b-it72.58official
260falcon-mamba-7b-instruct71.09official
261gemma-2b-it70.45official
262gemma-2-9b-it70official
263qwen2-7b-instruct66.32official
264olmoe-1b-7b-instruct64.09official
265grok-361.75official
266olmo-7b-instruct-hf59.55official
267powerlm-3b57.27official
268phi-256.36official
269powermoe-3b55official
270rakutenai-7b-chat50.91official