← Evals

Evaluation profile

Enkrypt AI Safety Leaderboard

4sub-evals
3.15%total index weight
3components

Within-component eval weight: Human rights 13.7% · Misuse resistance 5.02% · Responsible agency 3.97%.

Model score (higher is better)Predicted score

About this eval

Resistance to Enkrypt bias, CBRN, harmful-content, and toxicity red-team tests.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirectionTotal index weightWithin-component weight
bias_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:bias_attack_non_success_rateMeasures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.human_rights_systemic_harm:0.800|ordinary_harm_misuse_resistance:0.200enkrypt-aiHigher is better1.32%Human rights 8.43% · Misuse resistance 0.516%
cbrn_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:cbrn_attack_non_success_rateMeasures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.ordinary_harm_misuse_resistance:0.400|responsible_agency_control:0.600enkrypt-aiHigher is better0.579%Misuse resistance 1.03% · Responsible agency 3.17%
harmful_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:harmful_attack_non_success_rateMeasures how often Enkrypt's harmful-content attacks do not succeed.human_rights_systemic_harm:0.150|ordinary_harm_misuse_resistance:0.700|responsible_agency_control:0.150enkrypt-aiHigher is better0.537%Human rights 1.58% · Misuse resistance 1.8% · Responsible agency 0.794%
toxicity_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:toxicity_attack_non_success_rateMeasures how often Enkrypt's toxicity-generation attacks do not succeed.human_rights_systemic_harm:0.350|ordinary_harm_misuse_resistance:0.650enkrypt-aiHigher is better0.718%Human rights 3.67% · Misuse resistance 1.67%

bias_attack_non_success_rate

Measures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2mistral-nemo-minitron-8b-instruct92.51official
3mistral-7b86.56official
4smollm-360m-instruct76.23official
5claude-3-opus74.42official
6claude-sonnet-570.54official
7powerlm-3b-eai-aligned67.96official
8komodo-7b-base65.63official
9mistral-large-latest60.47official
10gpt-559.95official
11claude-3.5-haiku56.59official
12qwen2.5-72b-instruct-turbo55.81official
13minimax-m2.754.52official
14llama-3.1-nemotron-instruct-70b54.26official
15llama-3.2-90b-vision-instruct-turbo52.2official
16claude-opus-4.851.94official
16minimax-m251.94official
18claude-3.5-sonnet51.68official
19qwen3.5-397b-a17b50.39official
20muse-spark-1.149.87official
21qwen2-5-7b-instruct-turbo49.35official
22claude-sonnet-4.547.55official
22sarvam-147.55official
24open-codestral-mamba46.51official
25hy343.93official
26gpt-5.143.67official
27claude-opus-443.41official
28claude-sonnet-442.89official
29dolphin-2-5-mixtral-8x7b41.6official
29gpt-5.241.6official
31gpt-5-mini41.09official
32qwen3.5-122b-a10b40.31official
33gpt-oss-120b39.79official
34qwen3.5-27b39.53official
35gpt-5.6-terra39.28official
36gpt-5-nano39.02official
36inkling39.02official
38gemini-2.5-pro38.85official
39mistral-7b-instruct-v0.2-eai-aligned38.76official
40gpt-5.538.5official
41powerlm-3b37.47official
42mistral-7b-instruct36.61official
43claude-haiku-4.535.14official
44smollm2-360m-instruct33.59official
45eai-llama-3-1-8b-instruct-sagealign32.04official
46gemma-2-27b-it31.78official
47lfm2.1-2b31.52official
47phi-231.52official
49glm-4.530.49official
50powermoe-3b29.2official
51kimi-k228.81official
52foundation-sec-8b-instruct28.68official
53gpt-5.6-sol27.91official
54gpt-oss-20b27.65official
55gemma-2-9b-it-enkrypt-aligned27.39official
55qwen3-vl-235b-a22b-instruct27.39official
57qwen3.5-35b-a3b26.61official
58gpt-4-turbo26.36official
58lfm2-700m26.36official
58sea-lion-v1-7b-it26.36official
61apriel-v1-5-15b-thinker26.1official
62gemma-2-2b-it25.84official
63gpt-oss-safeguard-20b25.58official
64deepseek-r125.06official
65gemini-2.5-flash24.84official
66cogito-v2-124.55official
67rakutenai-7b-chat24.29official
68claude-opus-4.723.51official
68glm-5.123.51official
68o1-preview23.51official
71deepseek-v3.2-exp23official
71jamba-1-7-large23official
71nexusraven-v2-13b23official
71nova-premier23official
71o323official
76claude-opus-4.622.74official
77qwen2-57b-a14b-instruct22.22official
77qwen3-235b-a22b-instruct-250722.22official
77smaug-llama-3-70b-instruct22.22official
80gpt-5.6-luna21.96official
81claude-3-sonnet21.71official
81qwen-2.5-7b-instruct21.71official
83qwen2.5-72b-instruct21.45official
84deepseek-v3.121.19official
84starling-lm-7b-beta21.19official
86gpt-4o20.67official
86hunyuan-a13b-instruct20.67official
88gemma-7b-it20.41official
88internlm2-chat-20b20.41official
90o4-mini20.16official
91eai-sagealign-8b-lora19.9official
92llama-3-70b-instruct19.64official
92llama-3-8b-instruct19.64official
92qwen2-7b-instruct19.64official
95grok-319.38official
95lfm2-350m19.38official
97apertus-8b-instruct-250919.12official
97o1-mini19.12official
97qwen1.5-14b-chat19.12official
97reflection-llama-3-1-70b19.12official
101claude-sonnet-4.618.86official
102granite-4.0-h-small18.6official
102llama-2-7b-chat18.6official
102llama-3-8b-instruct-rr18.6official
105glm-4-9b-chat18.35official
105jamba-1.5-mini-enkrypt-aligned-018.35official
105llama-3.1-8b-instruct18.35official
105meta-llama-3-1-8b-instruct-turbo18.35official
109apertus-70b-instruct-250918.09official
109jamba-1-7-mini18.09official
109magistral-small-250918.09official
109o3-mini18.09official
113gpt-4.117.83official
113longwriter-glm4-9b17.83official
113o117.83official
116granite-3.1-8b-instruct-enkrypt-aligned17.31official
117gemma-3-27b-it17.05official
118aya-23-35b16.8official
118olmo-7b-instruct-hf16.8official
118phi-416.8official
121falcon-h1-0-5b-instruct16.54official
121llama-3-8b-instruct-mopeymule16.54official
123deepseek-reasoner16.28official
123jamba-large-1-616.28official
123kimi-k2.516.28official
123meta-secalign-8b16.28official
123qwen2.5-max16.28official
128claude-3.7-sonnet16.02official
128gemma-2-9b-it16.02official
128gemma-3-4b16.02official
128qwen2.5-14b-instruct-1m16.02official
132magistral-medium15.76official
132qwen2-72b-instruct15.76official
134gpt-4.1-mini15.5official
134grok-3-eai-hardened-system-prompt15.5official
134zephyr-7b-beta15.5official
137c4ai-aya-expanse-32b15.25official
137gpt-415.25official
137mistral-small-315.25official
137nova-pro15.25official
141aya-expanse-8b14.99official
141granite-4.0-h-tiny14.99official
141granite-4.0-micro14.99official
141magistral-small14.99official
141nova-lite14.99official
141olmoe-1b-7b-0924-instruct14.99official
141phi-3.5-moe-instruct14.99official
148deepseek-chat14.73official
148deepseek-v4-flash14.73official
148deepseek-v4-pro14.73official
148gemini-1.5-pro14.73official
148granite-3-2-8b-instruct-preview-enkrypt-aligned14.73official
148llama-3-8b-chat-hf14.73official
148qwen-2-vl-72b-instruct14.73official
148yi-1.5-9b-chat14.73official
156falcon-mamba-7b-instruct14.47official
156qwen2.5-32b-instruct14.47official
158aya-23-8b-enkrypt-aligned14.21official
158mistral-small-latest14.21official
160ai21-jamba-1-5-large-v1-013.95official
160gemini-2-0-flash-lite-preview-02-0513.95official
160gemma2-9b-cpt-sea-lionv3-instruct13.95official
160granite-4.0-h-micro13.95official
160llama-4-scout13.95official
165gemini-2.0-flash13.7official
165gpt-4o-mini13.7official
165llama-3-1-70b-instruct-turbo13.7official
165phi-3-mini-128k-instruct13.7official
165phi-3-small-128k-instruct13.7official
165phi-4-mini13.7official
171granite-3-2-8b-instruct-preview13.44official
172deepseek-v313.18official
172gemma-3-12b13.18official
172granite-3-2-2b-instruct13.18official
172krutrim-2-instruct13.18official
172llama-3.2-instruct-11b-vision13.18official
172phi-3-mini-4k-instruct13.18official
172qwen2-5-7b-instruct-1m13.18official
172rakutenai-7b-instruct13.18official
172wizardlm-2-8x22b13.18official
181claude-3-haiku12.92official
181gemma-4-26b-a4b-it12.92official
181gpt-4.1-nano12.92official
181gpt-5.412.92official
181grok-4.312.92official
181llama-3-1-405b-instruct-turbo12.92official
181nova-micro12.92official
181qwen-2.5-14b-instruct12.92official
189glm-4.612.66official
189granite-3.0-8b-instruct12.66official
189jamba-mini-1-612.66official
189k2-chat12.66official
189phi-3-medium-4k-instruct12.66official
189qwq-32b-preview12.66official
195granite-3-2-8b-instruct12.4official
195grok-412.4official
195llama-2-70b-chat12.4official
195llama-3-70b-chat-hf12.4official
199ai21-jamba-1-5-mini-v1-012.14official
199gemini-1.5-flash12.14official
199grok-4-1-fast-non-reasoning12.14official
199phi-3-small-8k-instruct12.14official
203dbrx-instruct11.89official
203glm-5-turbo11.89official
203granite-3-1-8b-instruct11.89official
203mixtral-8x22b-instruct11.89official
203phi-3-medium-128k-instruct11.89official
208seallm-7b-v211.63official
209mixtral-8x7b-instruct11.37official
209phi-3.5-mini-instruct11.37official
211granite-3-2-8b-instruct-preview-thinking11.11official
211krutrim-2-instruct-enkrypt-aligned11.11official
211llama-2-13b-chat11.11official
211llama-3.2-3b-instruct11.11official
211llama-3.3-70b-instruct11.11official
211nous-hermes-2-mixtral-8x7b-dpo11.11official
211seallms-v3-7b-chat11.11official
218llama-3.1-tulu-3-8b10.85official
219granite-3-0-3b-a800m-instruct10.59official
219olmo-2-1124-7b-instruct10.59official
219qwen2.5-3b-instruct10.59official
222gemma-4-12b10.34official
222granite-3-1-2b-instruct10.34official
222llama-4-maverick10.34official
225deepseek-r1-distill-qwen-7b10.08official
225gpt-3.5-turbo10.08official
227amazon-titan-text-express-v19.82official
227llama-3.1-tulu-3-8b-dpo9.82official
227llama-3.1-tulu-3-8b-sft9.82official
230aya-23-8b9.56official
230deepseek-llm-67b-chat9.56official
230granite-3-0-2b-instruct9.56official
233ai21-jamba-instruct-v1-09.3official
233deepseek-r1-distill-llama-8b-enkrypt-aligned9.3official
233qwen3-235b-a22b9.3official
236sarvam-105b9.04official
237gemma-4-31b-it8.53official
237qwen3-30b-a3b8.53official
239deepseek-r1-distill-llama-8b8.27official
239granite-3-1-3b-a800m-instruct8.27official
241qwen-2.5-1.5b-instruct8.01official
242h2o-danube3-500m-chat7.49official
243h2o-danube3-4b-chat6.98official
243qwq-32b6.98official
245codellama-7b-instruct-hf6.72official
246gemma-4-e4b6.2official
247granite-3-0-1b-a400m-instruct5.43official
248sarvam-30b4.39official
248smollm2-1.7b-instruct4.39official
250foundation-sec-8b4.13official
250gemma-2b-it4.13official
250llama-3.2-1b-instruct4.13official
253qwen-2.5-0.5b-instruct3.88official
253smollm-1-7b-instruct3.88official
255qwen3-8b2.33official
256command-a1.81official
257gemma-4-e2b1.55official
258command-r-plus-08-20241.29official
259command-r-plus-04-20241.03official
260command-r7b-12-20240.52official

cbrn_attack_non_success_rate

Measures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2hy399.5official
3claude-3.5-sonnet98.17official
4gpt-5-nano98official
4grok-3-eai-hardened-system-prompt98official
6llama-3-8b-instruct-mopeymule97.33official
7deepseek-r1-distill-llama-8b-enkrypt-aligned97.17official
7gemma-2-9b-it-enkrypt-aligned97.17official
7meta-secalign-8b97.17official
10claude-3.5-haiku97official
11gpt-5-mini96.83official
12claude-3-sonnet96.33official
12claude-opus-4.796.33official
12o196.33official
15claude-3-opus95.67official
15komodo-7b-base95.67official
17o1-preview95.5official
17qwq-32b-preview95.5official
19llama-3-8b-instruct-rr95.33official
20aya-expanse-8b95.17official
20claude-3.7-sonnet95.17official
20gemma-2-9b-it95.17official
23krutrim-2-instruct-enkrypt-aligned95official
23phi-495official
25gpt-4-turbo94.67official
25sea-lion-v1-7b-it94.67official
27amazon-titan-text-express-v194.5official
27apriel-v1-5-15b-thinker94.5official
27nova-pro94.5official
30c4ai-aya-expanse-32b94.33official
30gemma-2b-it94.33official
30longwriter-glm4-9b94.33official
33gpt-4o93.83official
33krutrim-2-instruct93.83official
35dolphin-2-5-mixtral-8x7b93.67official
35granite-3.1-8b-instruct-enkrypt-aligned93.67official
35muse-spark-1.193.67official
35powerlm-3b-eai-aligned93.67official
39gpt-5.193.5official
39wizardlm-2-8x22b93.5official
41gemini-2.0-flash93.33official
41internlm2-chat-20b93.33official
41mistral-nemo-minitron-8b-instruct93.33official
44qwq-32b93official
45gpt-592.89official
46claude-3-haiku92.67official
46granite-3-2-8b-instruct-preview-thinking92.67official
46nova-lite92.67official
46o1-mini92.67official
50claude-sonnet-592.5official
50deepseek-r1-distill-qwen-7b92.5official
52qwen2.5-max92.33official
53llama-3.1-tulu-3-8b-dpo92.17official
54claude-opus-4.892official
54gpt-4o-mini92official
54llama-3.1-tulu-3-8b92official
54phi-3.5-mini-instruct92official
58hunyuan-a13b-instruct91.83official
58llama-2-13b-chat91.83official
60aya-23-35b91.67official
60llama-3.2-90b-vision-instruct-turbo91.67official
60o3-mini91.67official
63aya-23-8b-enkrypt-aligned91.5official
63nova-premier91.5official
63smaug-llama-3-70b-instruct91.5official
66claude-opus-4.691.33official
66gemini-2-0-flash-lite-preview-02-0591.33official
66gpt-491.33official
66inkling91.33official
66mistral-7b-instruct-v0.2-eai-aligned91.33official
71deepseek-chat91.17official
71jamba-mini-1-691.17official
71llama-4-maverick91.17official
71qwen2.5-72b-instruct-turbo91.17official
71zephyr-7b-beta91.17official
76ai21-jamba-1-5-large-v1-091official
77apertus-70b-instruct-250990.83official
77aya-23-8b90.83official
77command-r-plus-08-202490.83official
77deepseek-r1-distill-llama-8b90.83official
77llama-3.1-nemotron-instruct-70b90.83official
77llama-3.2-instruct-11b-vision90.83official
83gemma-3-12b90.67official
83mistral-small-390.67official
83mixtral-8x22b-instruct90.67official
86nexusraven-v2-13b90.5official
86sarvam-105b90.5official
88foundation-sec-8b-instruct90.33official
88gemma-3-27b-it90.33official
88granite-3-1-8b-instruct90.33official
88nova-micro90.33official
88o390.33official
88qwen2-72b-instruct90.33official
94gemini-1.5-pro90.17official
94granite-4.0-micro90.17official
94llama-3-1-405b-instruct-turbo90.17official
94mistral-large-latest90.17official
98gpt-4.190official
98phi-3-mini-128k-instruct90official
100gpt-5.289.83official
100llama-2-7b-chat89.83official
100mistral-7b89.83official
103gemma-2-27b-it89.67official
103granite-3-2-8b-instruct-preview-enkrypt-aligned89.67official
103h2o-danube3-4b-chat89.67official
103jamba-1.5-mini-enkrypt-aligned-089.67official
103olmo-2-1124-7b-instruct89.67official
103phi-3-medium-4k-instruct89.67official
109claude-haiku-4.589.5official
109gpt-4.1-nano89.5official
109phi-3-mini-4k-instruct89.5official
112granite-3-1-3b-a800m-instruct89.33official
112llama-3-70b-chat-hf89.33official
112qwen2.5-32b-instruct89.33official
112sarvam-30b89.33official
116gemma2-9b-cpt-sea-lionv3-instruct89.17official
116qwen-2.5-14b-instruct89.17official
118ai21-jamba-instruct-v1-089official
119starling-lm-7b-beta88.83official
119yi-1.5-9b-chat88.83official
121gpt-4.1-mini88.67official
121granite-3-2-8b-instruct88.67official
121granite-4.0-h-small88.67official
121seallm-7b-v288.67official
125eai-sagealign-8b-lora88.5official
125gemma-3-4b88.5official
125llama-2-70b-chat88.5official
125llama-3.1-tulu-3-8b-sft88.5official
125sarvam-188.5official
125smollm2-360m-instruct88.5official
131cogito-v2-188.33official
131granite-3-1-2b-instruct88.33official
131jamba-large-1-688.33official
131llama-3.2-1b-instruct88.33official
131rakutenai-7b-instruct88.33official
136mistral-small-latest88.17official
136nous-hermes-2-mixtral-8x7b-dpo88.17official
136qwen2.5-72b-instruct88.17official
139grok-388official
140llama-3.3-70b-instruct87.83official
140llama-4-scout87.83official
142eai-llama-3-1-8b-instruct-sagealign87.67official
143granite-3-2-2b-instruct87.5official
143granite-3-2-8b-instruct-preview87.5official
143granite-4.0-h-micro87.5official
143phi-3-small-8k-instruct87.5official
143smollm-360m-instruct87.5official
148deepseek-v387.33official
148granite-4.0-h-tiny87.33official
148o4-mini87.33official
148phi-3-medium-128k-instruct87.33official
148phi-3.5-moe-instruct87.33official
153gpt-3.5-turbo87.17official
153phi-3-small-128k-instruct87.17official
155claude-sonnet-4.587official
155deepseek-reasoner87official
155k2-chat87official
155qwen2-5-7b-instruct-1m87official
155qwen2.5-3b-instruct87official
155reflection-llama-3-1-70b87official
161granite-3.0-8b-instruct86.83official
162gemini-1.5-flash86.67official
162h2o-danube3-500m-chat86.67official
162mixtral-8x7b-instruct86.67official
165llama-3-1-70b-instruct-turbo86.5official
165qwen1.5-14b-chat86.5official
167mistral-7b-instruct86.39official
168llama-3-70b-instruct86.33official
168llama-3-8b-chat-hf86.33official
168phi-4-mini86.33official
168qwen2-57b-a14b-instruct86.33official
172gpt-oss-120b86.17official
173ai21-jamba-1-5-mini-v1-086official
173gemma-2-2b-it86official
173minimax-m286official
176apertus-8b-instruct-250985.83official
177llama-3.2-3b-instruct85.67official
178llama-3-8b-instruct85.33official
178phi-285.33official
180dbrx-instruct85.17official
180qwen-2.5-1.5b-instruct85.17official
180qwen2.5-14b-instruct-1m85.17official
183minimax-m2.785official
184claude-sonnet-4.684.67official
184qwen-2-vl-72b-instruct84.67official
184qwen3-235b-a22b-instruct-250784.67official
184seallms-v3-7b-chat84.67official
188magistral-small-250984.5official
188olmoe-1b-7b-0924-instruct84.5official
190qwen2-5-7b-instruct-turbo84.33official
191gemini-2.5-flash84.17official
192meta-llama-3-1-8b-instruct-turbo84official
193falcon-mamba-7b-instruct83.83official
193granite-3-0-1b-a400m-instruct83.83official
193llama-3.1-8b-instruct83.83official
196rakutenai-7b-chat83.67official
197deepseek-llm-67b-chat83.5official
197qwen2-7b-instruct83.5official
199gpt-5.483.33official
200magistral-medium83.17official
201deepseek-v4-pro82.67official
201qwen-2.5-7b-instruct82.67official
203qwen3-vl-235b-a22b-instruct82.5official
204glm-4-9b-chat82.33official
205granite-3-0-2b-instruct82.17official
206gpt-oss-safeguard-20b82official
206granite-3-0-3b-a800m-instruct82official
208deepseek-v3.181.67official
209deepseek-v3.2-exp81.5official
210kimi-k281.44official
211open-codestral-mamba81.33official
211qwen-2.5-0.5b-instruct81.33official
213gpt-oss-20b81official
214gpt-5.6-sol80.83official
214powerlm-3b80.83official
214smollm-1-7b-instruct80.83official
217gpt-5.6-terra80official
218lfm2.1-2b79.5official
219gpt-5.579.33official
220falcon-h1-0-5b-instruct79.17official
220gemini-2.5-pro79.17official
222glm-5.179official
222lfm2-700m79official
222olmo-7b-instruct-hf79official
225gemma-7b-it78.83official
226smollm2-1.7b-instruct78.5official
227gpt-5.6-luna77.83official
228glm-4.577.67official
229foundation-sec-8b77.33official
230grok-476.83official
231magistral-small76.17official
232glm-5-turbo76official
233command-r-plus-04-202475.5official
233qwen3.5-397b-a17b75.5official
235jamba-1-7-mini75.33official
236claude-opus-475official
237glm-4.674.67official
238jamba-1-7-large73.17official
238qwen3.5-35b-a3b73.17official
240command-a72.67official
241powermoe-3b72.33official
242grok-4-1-fast-non-reasoning71.83official
243command-r7b-12-202471.33official
244qwen3.5-27b71.17official
245codellama-7b-instruct-hf70.5official
246deepseek-v4-flash70.33official
247qwen3.5-122b-a10b70.17official
248lfm2-350m69.67official
249gemma-4-e2b68official
250qwen3-8b67official
251gemma-4-e4b66.83official
251kimi-k2.566.83official
253gemma-4-31b-it66.67official
254gemma-4-12b65.5official
255grok-4.365.17official
256claude-sonnet-463official
256gemma-4-26b-a4b-it63official
258deepseek-r146.5official
259qwen3-30b-a3b44.33official
260qwen3-235b-a22b43.33official

harmful_attack_non_success_rate

Measures how often Enkrypt's harmful-content attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1claude-sonnet-5100official
1gemma-2-9b-it-enkrypt-aligned100official
1gpt-5.4100official
1gpt-5.6-luna100official
1muse-spark-1.1100official
7claude-opus-4.699.44official
7claude-opus-4.799.44official
7claude-opus-4.899.44official
7claude-sonnet-499.44official
7claude-sonnet-4.599.44official
7claude-sonnet-4.699.44official
7deepseek-r1-distill-llama-8b-enkrypt-aligned99.44official
7gpt-5.599.44official
7gpt-5.6-sol99.44official
7granite-3.1-8b-instruct-enkrypt-aligned99.44official
17claude-haiku-4.598.89official
17claude-opus-498.89official
17powerlm-3b-eai-aligned98.89official
17qwen3.5-27b98.89official
21claude-3.7-sonnet98.33official
21o1-preview98.33official
21qwen3.5-35b-a3b98.33official
24gpt-5.6-terra97.78official
24inkling97.78official
24minimax-m2.797.78official
24qwen3.5-122b-a10b97.78official
28claude-3.5-sonnet97.5official
29krutrim-2-instruct-enkrypt-aligned97.22official
29qwen3.5-397b-a17b97.22official
31phi-496.67official
32o196.11official
32sarvam-105b96.11official
34gemma-4-12b95.56official
35gemma-4-26b-a4b-it95official
35grok-4.395official
37claude-3.5-haiku94.44official
37kimi-k2.594.44official
37meta-secalign-8b94.44official
40gemma-4-31b-it93.89official
40o393.89official
42claude-3-sonnet93.33official
42gpt-593.33official
42grok-3-eai-hardened-system-prompt93.33official
45eai-sagealign-8b-lora92.78official
45gpt-5-nano92.78official
45hy392.78official
45o1-mini92.78official
49claude-3-opus92.22official
49eai-llama-3-1-8b-instruct-sagealign92.22official
49llama-3-8b-instruct-mopeymule92.22official
52gpt-5.291.67official
52granite-4.0-h-tiny91.67official
54glm-5.191.11official
54gpt-5-mini91.11official
54llama-3-8b-chat-hf91.11official
54llama-3.2-1b-instruct91.11official
58minimax-m289.44official
59glm-5-turbo88.89official
59granite-4.0-micro88.89official
61cogito-v2-188.33official
61llama-2-13b-chat88.33official
63llama-2-70b-chat87.78official
63llama-3-70b-chat-hf87.78official
63llama-3-70b-instruct87.78official
66claude-3-haiku87.22official
66llama-3-8b-instruct87.22official
66qwen2-72b-instruct87.22official
69foundation-sec-8b-instruct86.67official
69gemma-4-e2b86.67official
69olmo-2-1124-7b-instruct86.67official
72krutrim-2-instruct86.11official
72llama-3.1-tulu-3-8b-sft86.11official
74gemma-4-e4b85.56official
74gpt-oss-120b85.56official
74granite-4.0-h-small85.56official
74jamba-1.5-mini-enkrypt-aligned-085.56official
74llama-2-7b-chat85.56official
74llama-3.2-instruct-11b-vision85.56official
80llama-3.2-3b-instruct85official
80o4-mini85official
82nova-lite84.44official
82o3-mini84.44official
84gpt-5.183.89official
84sarvam-30b83.89official
86llama-3-8b-instruct-rr83.33official
87llama-3.1-tulu-3-8b82.78official
88llama-4-maverick82.22official
88nova-pro82.22official
90k2-chat81.67official
90llama-3.1-tulu-3-8b-dpo81.67official
92gemma-2-9b-it81.11official
92mistral-7b-instruct-v0.2-eai-aligned81.11official
94gpt-480.56official
94gpt-oss-20b80.56official
94nova-premier80.56official
97qwen3-235b-a22b-instruct-250780official
98nova-micro79.44official
98phi-3.5-mini-instruct79.44official
100kimi-k279.16official
101amazon-titan-text-express-v178.89official
101apriel-v1-5-15b-thinker78.89official
101granite-4.0-h-micro78.89official
104deepseek-v4-pro77.78official
105gemma-2b-it77.22official
106deepseek-v4-flash76.67official
107aya-23-8b-enkrypt-aligned76.11official
107gpt-4-turbo76.11official
107granite-3-1-3b-a800m-instruct76.11official
107phi-3.5-moe-instruct76.11official
111phi-3-mini-4k-instruct75.56official
111qwen2.5-72b-instruct75.56official
113gpt-4.175official
113granite-3.0-8b-instruct75official
113llama-3.2-90b-vision-instruct-turbo75official
113qwq-32b-preview75official
117gemma-2-2b-it74.44official
117gpt-oss-safeguard-20b74.44official
119gemma-2-27b-it73.89official
119phi-3-medium-128k-instruct73.89official
121apertus-70b-instruct-250973.33official
121codellama-7b-instruct-hf73.33official
121llama-3-1-405b-instruct-turbo73.33official
121llama-3.1-8b-instruct73.33official
121meta-llama-3-1-8b-instruct-turbo73.33official
126llama-3.1-nemotron-instruct-70b72.22official
126phi-3-mini-128k-instruct72.22official
128granite-3-1-8b-instruct71.67official
128internlm2-chat-20b71.67official
128qwen2.5-72b-instruct-turbo71.67official
128reflection-llama-3-1-70b71.67official
132phi-3-small-8k-instruct71.11official
133komodo-7b-base70.56official
133qwen3-vl-235b-a22b-instruct70.56official
135qwen-2.5-14b-instruct69.44official
135smaug-llama-3-70b-instruct69.44official
137c4ai-aya-expanse-32b68.89official
138gemini-1.5-pro68.33official
138llama-4-scout68.33official
140gpt-4o67.78official
140phi-3-small-128k-instruct67.78official
142aya-expanse-8b67.22official
142granite-3-2-8b-instruct-preview-enkrypt-aligned67.22official
142qwen2.5-max67.22official
145llama-3.3-70b-instruct66.11official
146phi-3-medium-4k-instruct64.44official
147gemini-2.0-flash63.89official
148grok-4-1-fast-non-reasoning63.33official
149llama-3-1-70b-instruct-turbo62.78official
150qwen2-7b-instruct62.22official
150qwen3-8b62.22official
152granite-3-0-2b-instruct61.67official
152qwen2.5-14b-instruct-1m61.67official
152seallm-7b-v261.67official
152seallms-v3-7b-chat61.67official
156gpt-4o-mini60.56official
156phi-4-mini60.56official
158gpt-4.1-nano60official
158qwen2.5-32b-instruct60official
160granite-3-0-1b-a400m-instruct59.44official
161deepseek-v3.158.89official
161granite-3-0-3b-a800m-instruct58.89official
163deepseek-chat58.33official
163gpt-4.1-mini58.33official
163qwen-2-vl-72b-instruct58.33official
166longwriter-glm4-9b57.78official
166qwen1.5-14b-chat57.78official
166wizardlm-2-8x22b57.78official
169gemma-3-27b-it56.11official
170gemini-1.5-flash55.56official
170gemma2-9b-cpt-sea-lionv3-instruct55.56official
170lfm2-700m55.56official
170lfm2.1-2b55.56official
170qwen2-57b-a14b-instruct55.56official
170sea-lion-v1-7b-it55.56official
176deepseek-reasoner55official
176glm-4.655official
176granite-3-1-2b-instruct55official
176granite-3-2-2b-instruct55official
180gemini-2.5-flash54.63official
181gemma-7b-it54.44official
181mistral-nemo-minitron-8b-instruct54.44official
181qwen-2.5-1.5b-instruct54.44official
181smollm2-1.7b-instruct54.44official
185gemini-2-0-flash-lite-preview-02-0553.89official
185mixtral-8x22b-instruct53.89official
187apertus-8b-instruct-250953.33official
188gemma-3-12b52.78official
188granite-3-2-8b-instruct-preview52.78official
190deepseek-v352.22official
190glm-4.552.22official
190qwen2-5-7b-instruct-1m52.22official
193nexusraven-v2-13b50.56official
194granite-3-2-8b-instruct50official
195jamba-large-1-649.44official
196command-a48.89official
196gemma-3-4b48.89official
198glm-4-9b-chat48.33official
198qwen2-5-7b-instruct-turbo48.33official
198smollm-1-7b-instruct48.33official
201starling-lm-7b-beta47.78official
202deepseek-v3.2-exp46.67official
202qwen3-235b-a22b46.67official
204aya-23-35b46.11official
204granite-3-2-8b-instruct-preview-thinking46.11official
204jamba-1-7-large46.11official
207falcon-mamba-7b-instruct45.56official
207mistral-small-345.56official
209gemini-2.5-pro45.37official
210command-r7b-12-202445official
211ai21-jamba-1-5-large-v1-043.89official
211ai21-jamba-instruct-v1-043.89official
211h2o-danube3-4b-chat43.89official
211lfm2-350m43.89official
215deepseek-r142.22official
215jamba-1-7-mini42.22official
215qwen-2.5-7b-instruct42.22official
218qwen2.5-3b-instruct41.67official
219aya-23-8b41.11official
219hunyuan-a13b-instruct41.11official
221grok-340.56official
221yi-1.5-9b-chat40.56official
223command-r-plus-08-202440official
223rakutenai-7b-instruct40official
225command-r-plus-04-202439.44official
225mistral-small-latest39.44official
225sarvam-139.44official
228mistral-large-latest38.89official
229ai21-jamba-1-5-mini-v1-038.33official
229deepseek-llm-67b-chat38.33official
229jamba-mini-1-638.33official
229mixtral-8x7b-instruct38.33official
229qwen3-30b-a3b38.33official
234gpt-3.5-turbo37.22official
235mistral-7b36.67official
236magistral-small-250936.11official
237dbrx-instruct34.44official
237falcon-h1-0-5b-instruct34.44official
239grok-433.89official
239qwq-32b33.89official
241magistral-medium33.33official
241magistral-small33.33official
241smollm2-360m-instruct33.33official
244dolphin-2-5-mixtral-8x7b32.22official
245open-codestral-mamba31.67official
245powerlm-3b31.67official
247mistral-7b-instruct31.3official
248olmoe-1b-7b-0924-instruct31.11official
248qwen-2.5-0.5b-instruct31.11official
250smollm-360m-instruct28.89official
251powermoe-3b28.33official
252h2o-danube3-500m-chat27.22official
253deepseek-r1-distill-qwen-7b25.56official
253olmo-7b-instruct-hf25.56official
255rakutenai-7b-chat24.44official
256deepseek-r1-distill-llama-8b22.78official
257foundation-sec-8b22.22official
258phi-221.67official
259zephyr-7b-beta20official
260nous-hermes-2-mixtral-8x7b-dpo18.89official

toxicity_attack_non_success_rate

Measures how often Enkrypt's toxicity-generation attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1dolphin-2-5-mixtral-8x7b100official
1gemma-2-27b-it100official
1granite-3.1-8b-instruct-enkrypt-aligned100official
1llama-3-70b-instruct100official
1meta-llama-3-1-8b-instruct-turbo100official
1mistral-nemo-minitron-8b-instruct100official
1qwen2.5-72b-instruct100official
1smaug-llama-3-70b-instruct100official
10claude-3.5-sonnet99.95official
11claude-3-opus99.91official
11granite-3-0-3b-a800m-instruct99.91official
11grok-3-eai-hardened-system-prompt99.91official
14apriel-v1-5-15b-thinker99.82official
14claude-sonnet-599.82official
14granite-3-1-2b-instruct99.82official
14granite-3-2-2b-instruct99.82official
18claude-sonnet-499.77official
18granite-3-1-3b-a800m-instruct99.77official
20granite-3-1-8b-instruct99.68official
21claude-3-sonnet99.64official
21granite-4.0-h-small99.64official
21granite-4.0-h-tiny99.64official
21llama-2-70b-chat99.64official
25granite-3-2-8b-instruct-preview99.59official
26foundation-sec-8b-instruct99.55official
26granite-3-2-8b-instruct99.55official
26llama-2-13b-chat99.55official
29granite-3-0-2b-instruct99.5official
29llama-2-7b-chat99.5official
31claude-3-haiku99.45official
31granite-4.0-micro99.45official
31seallm-7b-v299.45official
34apertus-70b-instruct-250999.36official
34claude-3.5-haiku99.36official
34qwen2-72b-instruct99.36official
37claude-3.7-sonnet99.32official
37krutrim-2-instruct-enkrypt-aligned99.32official
39claude-opus-4.899.27official
39cogito-v2-199.27official
41claude-opus-499.18official
41deepseek-r1-distill-llama-8b-enkrypt-aligned99.18official
41phi-499.18official
44gemma-2-9b-it-enkrypt-aligned99.09official
44granite-4.0-h-micro99.09official
44minimax-m299.09official
47llama-3.1-nemotron-instruct-70b99.05official
47llama-3.1-tulu-3-8b-dpo99.05official
49yi-1.5-9b-chat99official
50aya-expanse-8b98.95official
51apertus-8b-instruct-250998.91official
51claude-haiku-4.598.91official
53llama-3.2-1b-instruct98.82official
54claude-sonnet-4.598.73official
55qwq-32b-preview98.68official
56claude-opus-4.798.55official
56llama-3.2-instruct-11b-vision98.55official
58starling-lm-7b-beta98.48official
59gpt-4o98.41official
59granite-3-2-8b-instruct-preview-thinking98.41official
59meta-secalign-8b98.41official
62c4ai-aya-expanse-32b98.36official
62granite-3-2-8b-instruct-preview-enkrypt-aligned98.36official
62qwen3.5-35b-a3b98.36official
62sarvam-105b98.36official
66gpt-4-turbo98.32official
66phi-3.5-moe-instruct98.32official
66qwen2-57b-a14b-instruct98.32official
69reflection-llama-3-1-70b98.2official
70llama-3.1-tulu-3-8b98.18official
70minimax-m2.798.18official
70phi-3-small-8k-instruct98.18official
70qwen3-8b98.18official
74llama-3-8b-chat-hf98.14official
74qwen3-235b-a22b98.14official
76deepseek-r1-distill-llama-8b98.09official
76qwen2.5-max98.09official
78gemma-3-12b98.05official
78llama-4-scout98.05official
80gemma-4-e4b98official
80gpt-4o-mini98official
80inkling98official
83amazon-titan-text-express-v197.95official
83deepseek-r1-distill-qwen-7b97.95official
83llama-3-8b-instruct-rr97.95official
86deepseek-r197.91official
86llama-3-70b-chat-hf97.91official
86qwen3-30b-a3b97.91official
89llama-3.2-90b-vision-instruct-turbo97.86official
89phi-3-medium-4k-instruct97.86official
89qwen2.5-32b-instruct97.86official
92llama-4-maverick97.82official
92olmo-2-1124-7b-instruct97.82official
92qwen2.5-72b-instruct-turbo97.82official
95granite-3.0-8b-instruct97.77official
96qwen-2.5-14b-instruct97.73official
97o1-preview97.64official
98qwen-2-vl-72b-instruct97.59official
99llama-3.1-tulu-3-8b-sft97.45official
99mixtral-8x22b-instruct97.45official
99phi-3.5-mini-instruct97.45official
99qwen3.5-397b-a17b97.45official
103o197.41official
104gemma-3-27b-it97.36official
105gpt-5.497.27official
105jamba-1.5-mini-enkrypt-aligned-097.27official
105nova-premier97.27official
105o1-mini97.27official
109llama-3.3-70b-instruct97.18official
110lfm2-350m97.12official
110lfm2.1-2b97.12official
112gemma-4-26b-a4b-it97.09official
112gpt-597.09official
114nova-micro97.05official
114phi-3-medium-128k-instruct97.05official
116gemma-4-12b96.91official
116gpt-5-nano96.91official
116gpt-oss-safeguard-20b96.91official
116hy396.91official
120qwq-32b96.86official
121gpt-5.296.73official
121phi-3-small-128k-instruct96.73official
121sarvam-30b96.73official
124mistral-small-396.55official
125phi-4-mini96.45official
125qwen2.5-14b-instruct-1m96.45official
127internlm2-chat-20b96.41official
128gemma-4-e2b96.36official
128kimi-k2.596.36official
128qwen-2.5-1.5b-instruct96.36official
128qwen3.5-122b-a10b96.36official
128qwen3.5-27b96.36official
133lfm2-700m96.21official
134wizardlm-2-8x22b96.18official
135gpt-4.1-nano96.14official
136command-a96.05official
136llama-3-1-405b-instruct-turbo96.05official
136phi-3-mini-128k-instruct96.05official
139gemini-2.5-pro96.02official
140qwen3-235b-a22b-instruct-250795.91official
141gemma2-9b-cpt-sea-lionv3-instruct95.86official
142nova-lite95.82official
142nova-pro95.82official
144phi-3-mini-4k-instruct95.77official
145glm-4.595.76official
146mistral-7b-instruct-v0.2-eai-aligned95.73official
147gemma-4-31b-it95.64official
147glm-5.195.64official
147gpt-5.195.64official
147llama-3-1-70b-instruct-turbo95.64official
147muse-spark-1.195.64official
147qwen2-5-7b-instruct-turbo95.64official
153command-r7b-12-202495.55official
154llama-3.2-3b-instruct95.5official
155eai-sagealign-8b-lora95.45official
155glm-4.695.45official
155glm-5-turbo95.45official
155grok-495.45official
159gemini-1.5-pro95.41official
159granite-3-0-1b-a400m-instruct95.41official
161o3-mini95.36official
162gpt-4.1-mini95.23official
163gpt-5-mini95.2official
164mixtral-8x7b-instruct95.18official
165qwen2.5-3b-instruct95.09official
166gemma-3-4b95.05official
166o395.05official
168llama-3-8b-instruct94.77official
169llama-3-8b-instruct-mopeymule94.7official
170mistral-7b-instruct94.65official
171eai-llama-3-1-8b-instruct-sagealign94.64official
172deepseek-v3.2-exp94.55official
172gpt-4.194.55official
172mistral-small-latest94.55official
172qwen3-vl-235b-a22b-instruct94.55official
176ai21-jamba-instruct-v1-094.45official
177k2-chat94.41official
178krutrim-2-instruct94.36official
179qwen2-5-7b-instruct-1m94.18official
180aya-23-8b-enkrypt-aligned94.14official
181h2o-danube3-4b-chat94.09official
182zephyr-7b-beta93.94official
183gpt-5.6-luna93.82official
183hunyuan-a13b-instruct93.82official
183seallms-v3-7b-chat93.82official
186gemini-2.0-flash93.64official
187deepseek-chat93.55official
188deepseek-v3.193.45official
189qwen-2.5-0.5b-instruct93.36official
190deepseek-reasoner93.32official
191o4-mini93.27official
192deepseek-llm-67b-chat93.14official
192jamba-large-1-693.14official
194gpt-493.09official
195open-codestral-mamba92.91official
196sarvam-192.88official
197deepseek-v4-pro92.55official
198gpt-5.6-terra92.36official
199mistral-large-latest92.27official
200falcon-h1-0-5b-instruct92.14official
201gpt-5.592official
202jamba-1-7-large91.82official
202magistral-medium91.82official
204deepseek-v4-flash91.64official
204magistral-small91.64official
206gemini-2.5-flash91.48official
207grok-4.391.45official
208longwriter-glm4-9b91.36official
209dbrx-instruct91.23official
209jamba-mini-1-691.23official
211gpt-5.6-sol91.09official
212kimi-k290.97official
213gemini-2-0-flash-lite-preview-02-0590.73official
214gemini-1.5-flash90.59official
215jamba-1-7-mini90.5official
216smollm-360m-instruct90official
217command-r-plus-08-202489.86official
218ai21-jamba-1-5-large-v1-089.64official
218deepseek-v389.64official
220gpt-3.5-turbo89.18official
221gpt-oss-120b89.09official
222nexusraven-v2-13b88.64official
223command-r-plus-04-202487.73official
224magistral-small-250987.55official
225aya-23-8b86.64official
226nous-hermes-2-mixtral-8x7b-dpo86.59official
227ai21-jamba-1-5-mini-v1-086.36official
228codellama-7b-instruct-hf84.82official
229grok-4-1-fast-non-reasoning84.18official
230gemma-2-2b-it84.14official
230llama-3.1-8b-instruct84.14official
232aya-23-35b83.18official
233smollm2-1.7b-instruct82.77official
234h2o-danube3-500m-chat82.5official
235foundation-sec-8b82.05official
236smollm2-360m-instruct81.52official
237qwen1.5-14b-chat80.95official
238powerlm-3b-eai-aligned80.41official
239gpt-oss-20b80official
240rakutenai-7b-instruct79.24official
241mistral-7b78.18official
242gemma-7b-it77.05official
242smollm-1-7b-instruct77.05official
244komodo-7b-base76.21official
245glm-4-9b-chat75.41official
246sea-lion-v1-7b-it72.58official
247falcon-mamba-7b-instruct71.09official
248gemma-2b-it70.45official
249gemma-2-9b-it70official
250qwen2-7b-instruct66.32official
251olmoe-1b-7b-0924-instruct64.09official
252qwen-2.5-7b-instruct61.82official
253grok-361.75official
254olmo-7b-instruct-hf59.55official
255powerlm-3b57.27official
256phi-256.36official
257powermoe-3b55official
258rakutenai-7b-chat50.91official