AI Safety Evidence

Which language models have the strongest safety evidence?

An evidence-weighted ranking of 907 language models across 157 independent evaluations. 333 models currently have enough breadth to rank.

What changed · Find evidence · Components · Methodology · Data

Overall ranking

Rank combines model behavior (90%) and company governance (10%). Models need at least 3 evals across 2 behavior components. The interval is at least as important as the point estimate: it shows source-family sensitivity, not future performance.

How to interpret these ranks

The behavior order is the mean rank across complete-lineage bootstrap refits. Every sub-eval contributes only an ordering; native score scales are never pooled. Intervals separately resample transitive governed-source dependency components. Coverage varies and nearby models are often indistinguishable: the median 90% interval spans 163.5 ranks.

Rank by release date

333 of 333 ranked models have verified release dates. Each mark identifies the model's developer. Release date is context only and is not used to calculate rank.

What changed

Latest models with safety evidence

  1. Agnes 3.0 Flash agnes · 1 evals across 1 components
  2. DeepSeek V4.1 Flash DeepSeek · 5 evals across 3 components
  3. Mercury 2.5 Inception Labs · 2 evals across 2 components
  4. MiniCPM5 2B openbmb · 1 evals across 1 components
  5. Ling 3.0 Flash VL InclusionAI · 1 evals across 1 components
  6. GPT 6 Astra OpenAI · 14 evals across 6 components
  7. Muse Spark 1.3 Meta · 4 evals across 3 components
  8. Gemini 3.8 Flash Cyber Google · 1 evals across 1 components

Full ranking table

Rows are ordered by estimated rank, but broad overlapping intervals should not be read as evidence of a real difference.

333 models
Overall rank; brackets show the 90% source-sensitivity interval.
Estimated rank
[90% interval]		ModelEvalsComponentsRelease date
1 [1–4]gpt-6-astra146/72026-09-03
2 [1–12]claude-opus-5227/72026-07-24
3 [4–28]claude-fable-5267/72026-06-09
4 [2–198]claude-fable-5.1177/72026-09-01
5 [5–52]claude-opus-4.8327/72026-05-28
6 [3–17]muse-spark-1.33+13/72026-09-02
7 [13–72]gpt-5.6-terra257/72026-07-09
8 [7–69]muse-spark-1.1177/72026-07-09
9 [4–89]gpt-5.3-chat65/72026-03-03
10 [3–123]claude-mythos-preview33/72026-04-07
11 [11–67]claude-opus-4.7387/72026-04-16
12 [3–87]gpt-5.5-instant43/72026-05-26
13 [15–67]gpt-5.4377/72026-03-05
14 [13–62]muse-spark-1.275/72026-08-05
15 [12–70]claude-opus-4.6377/72026-02-05
16 [17–68]gpt-5.5447/72026-04-23
17 [11–80]gemini-3.8-flash14+16/72026-09-02
18 [10–107]inkling-small2+35/72026-07-30
19 [15–104]gemini-3.7-flash186/72026-08-13
20 [6–99]gemini-3.6-flash106/72026-07-21
21 [18–144]gpt-5.6-sol327/72026-07-09
22 [19–156]gpt-5.6-luna24+37/72026-07-09
23 [9–169]mimo-v2-omni33/72026-03-18
24 [11–95]claude-sonnet-4.6397/72026-01-21
25 [32–82]glm-5.313+16/72026-08-18
26 [24–85]gpt-5.2357/72025-12-11
27 [5–121]gpt-5.2-chat54/72025-12-11
28 [21–58]deepseek-v4.1-flash3+23/72026-09-10
29 [7–214]granite-4.2-8b1+25/72026-08-25
30 [4–156]claude-295/72023-07-11
31 [3–262]gpt-5.5-pro33/72026-04-23
32 [26–95]claude-haiku-4.5467/72025-10-15
33 [25–116]gpt-5-mini32+17/72025-08-07
34 [12–116]claude-opus-4267/72025-05-22
35 [28–119]kimi-k3247/72026-07-16
36 [13–150]gpt-5-nano25+27/72025-08-07
37 [12–144]gpt-5447/72025-08-07
38 [4–195]gemini-2.5-pro-exp43/72025-03-25
39 [2–277]gpt-5-pro54/72025-08-07
40 [8–202]phi-3.5-moe-instruct56/72024-08-22
41 [21–107]gemini-3.1-pro65/72026-02-19
42 [13–139]grok-4.20-multi-agent44/72026-03-10
43 [13–132]claude-opus-4.5297/72025-11-24
44 [38–111]qwen3.5-397b-a17b12+17/72026-02-16
45 [21–266]qwen3.5-27b76/72026-02-24
46 [11–116]claude-3.7-sonnet287/72025-02-24
47 [30–131]claude-sonnet-4.5447/72025-09-29
48 [28–131]gpt-5.1347/72025-11-13
49 [13–210]inkling7+26/72026-07-14
50 [9–161]gpt-5.1-codex32/72025-11-13
51 [6–184]o1-preview46/72024-09-12
52 [13–224]claude-sonnet-5197/72026-06-30
53 [9–263]llama-3.1-tulu-3-8b35/72024-11-20
54 [15–200]mimo-v2.5-pro8+16/72026-04-27
55 [37–124]claude-sonnet-4407/72025-05-22
56 [8–299]granite-4.0-h-small34/72025-10-02
57 [9–192]mimo-v2-pro55/72026-03-18
58 [55–137]grok-4.5217/72026-07-08
59 [43–141]claude-opus-4.1216/72025-08-05
60 [1–275]gpt-5.4-pro43/72026-03-05
61 [58–166]minimax-m38+26/72026-06-02
62 [3–263]chatgpt-4o33/72025-03-27
63 [40–141]gemini-3.1-pro-preview347/72026-02-19
64 [43–157]gpt-oss-20b19+17/72025-08-05
65 [42–199]gemini-3.5-flash307/72026-05-19
66 [58–138]kimi-k2.622+27/72026-04-14
67 [28–191]qwen3.5-9b4+17/72026-02-27
68 [31–234]glm-4.5-air13+15/72025-07-28
69 [22–213]gpt-5.4-mini236/72026-03-17
70 [10–276]nova-lite76/72024-12-03
71 [42–232]glm-5.3-flash4+16/72026-08-26
72 [25–194]gemma-4-26b-a4b-it7+15/72026-03-11
73 [46–162]qwen3.5-plus76/72026-02-15
74 [27–264]qwen3.7-flash2+12/72026-07-27
75 [22–321]palmyra-x-00463/72024-10-09
76 [37–319]qwen3-235b-a22b-fp8-throughput63/72025-04-28
77 [11–242]nemotron-3.5-lightning2+15/72026-08-11
78 [8–192]claude-3.5-haiku157/72024-10-22
79 [64–179]gemma-4-31b-it15+27/72026-03-11
80 [25–197]qwen3.7-max137/72026-05-20
81 [52–229]mimo-v2.56+25/72026-04-27
82 [63–217]glm-515+17/72026-02-11
83 [31–218]gemini-1.0-pro86/72023-12-06
84 [73–235]glm-5.224+17/72026-06-16
85 [66–201]minimax-m2.715+17/72026-04-09
86 [29–172]gpt-4.1377/72025-04-14
87 [36–269]mistral-large66/72024-02-26
88 [14–256]hy34+25/72026-07-02
89 [26–267]qwen3.8-max76/72026-08-03
90 [61–202]laguna-s-2.1-poolside1+35/72026-07-21
91 [73–238]deepseek-v4-flash19+17/72026-04-22
92 [95–268]palmyra-fin63/72024-07-31
93 [22–308]muse-spark53/72026-04-08
94 [31–237]o1-mini117/72024-09-12
95 [44–225]qwen-72b-chat44/72023-11-30
96 [28–179]qwen2-72b-instruct105/72024-06-07
97 [63–184]kimi-k232+17/72025-07-11
98 [26–187]gpt-4.5-preview116/72025-02-27
99 [58–186]qwen3-max96/72025-09-24
100 [27–188]o1196/72024-12-17
101 [26–276]internlm2-chat-7b44/72024-01-17
102 [27–240]qwen3-4b45/72025-04-27
103 [58–255]gpt-5.3-codex55/72026-02-05
104 [37–191]gemini-1.5-pro227/72024-02-15
105 [35–248]seed-2.0-mini2+15/72026-02-14
106 [45–248]deepseek-v3.114+17/72025-08-21
107 [18–246]qwen3.6-27b45/72026-04-21
108 [42–221]gemini-3.5-flash-lite8+15/72026-07-21
109 [22–199]o3306/72025-04-16
110 [26–229]palmyra-x563/72025-04-28
111 [58–187]gemini-2.5-pro467/72025-03-25
112 [36–235]internlm-chat-20b44/72023-09-18
113 [30–208]gpt-oss-safeguard-20b3+15/72025-10-29
114 [37–239]nemotron-3-ultra-550b-a55b8+16/72026-06-03
115 [75–214]grok-4.3247/72026-05-15
116 [39–232]gpt-5.2-codex33/72025-12-18
117 [12–262]ox-alpha3+25/72026-08-20
118 [76–177]gpt-oss-120b32+37/72025-08-05
119 [39–322]ministral-3-3b2+13/72025-10-31
120 [60–187]gemini-3-pro-preview277/72025-11-18
121 [40–202]gemini-1.5-flash177/72024-05-14
122 [33–326]qwen3-30b-a3b65/72025-04-27
123 [36–266]internlm2-chat-20b55/72024-01-17
124 [83–201]deepseek-v3.232+27/72025-12-01
125 [22–261]deepseek-v3.2-exp75/72025-09-29
126 [63–250]glm-5.118+27/72026-04-03
127 [61–271]kimi-k2.7-code33/72026-06-11
128 [22–269]qwen2.5-72b-instruct18+17/72024-09-16
129 [33–219]gpt-4.1-mini21+17/72025-04-14
130 [17–246]ernie-4.5-300b-a47b66/72025-06-28
131 [62–267]minimax-m276/72025-10-27
132 [45–221]qwen3-235b-a22b30+27/72025-04-29
133 [81–218]doubao-seed-1.666/72025-06-11
134 [64–239]grok-4-fast186/72025-09-19
135 [79–254]minimax-m2.512+17/72026-02-12
136 [55–235]grok-3-mini177/72025-04-03
137 [86–244]longcat-2.02+15/72026-07-05
138 [46–304]olmo-3-7b-instruct33/72025-11-19
139 [8–304]nova-2.0-lite42/72025-12-02
140 [21–236]phi-4-reasoning-plus35/72025-04-17
141 [70–287]deepseek-v4-pro237/72026-04-22
142 [69–197]claude-3.5-sonnet347/72024-06-21
143 [78–225]claude-3-opus277/72024-03-04
144 [67–195]gpt-4-turbo257/72023-11-06
145 [27–290]qwen3-32b8+17/72025-04-29
146 [86–257]qwen3.6-plus117/72026-04-02
147 [71–290]olmo-3.1-32b-instruct32/72025-12-10
148 [88–208]grok-4337/72025-07-09
149 [24–300]nemotron-3-nano-omni-30b-a3b2+15/72026-04-28
150 [60–219]deepseek-v333+17/72024-12-26
151 [93–255]grok-4.20277/72026-03-10
152 [1–303]gemma-4-e4b34/72026-03-31
153 [66–238]qwen-14b-chat84/72023-09-25
154 [73–291]qwen3.6-max-preview53/72026-04-22
155 [13–290]qwen3.8-27b2+23/72026-08-14
156 [16–278]phi-465/72024-12-11
157 [68–223]gemini-2.5-flash39+17/72025-04-17
158 [41–257]qwen2.5-32b-instruct55/72024-09-19
159 [30–300]phi-3-mini-4k-instruct43/72024-04-22
160 [79–261]qwen3.7-plus75/72026-05-26
161 [32–322]qwen3-max-preview32/72025-09-05
162 [113–203]gpt-4o72+17/72024-05-13
163 [53–278]grok-4.6136/72026-08-12
164 [101–258]kimi-k2.530+27/72026-01-01
165 [113–249]qwen3-next-80b-a3b126/72025-09-11
166 [105–205]gemini-2.0-pro-preview63/72025-02-05
167 [15–270]granite-4.0-small-guardian63/72025-10-02
168 [90–264]nemotron-3-super-120b-a12b10+16/72026-03-10
169 [70–252]text-davinci-00334/72022-11-28
170 [112–287]qwen3-235b-a22b-instruct34/72025-07-21
171 [77–316]mistral-medium45/72023-12-11
172 [79–246]gpt-4187/72023-03-14
173 [55–312]mercury-23+14/72026-02-24
174 [40–317]glm-4.7-flash5+13/72026-01-19
175 [81–295]qwen3.5-flash5+15/72026-02-24
176 [99–224]qwen1.5-32b-chat46/72024-04-02
177 [40–283]deepseek-v4-flash-07314+13/72026-07-31
178 [95–235]baichuan-2-13b-chat135/72023-09-06
179 [102–231]gemini-3.1-flash-lite25+27/72026-03-03
180 [58–262]solar-pro-42+25/72026-08-11
181 [56–259]grok-3197/72025-04-03
182 [108–237]o3-mini266/72025-01-31
183 [93–257]qwen1.5-14b-chat65/72024-02-04
184 [23–272]nova-premier45/72025-04-30
185 [112–231]gpt-3.5-turbo287/72023-03-01
186 [111–255]llama-3.3-70b-instruct30+27/72024-12-06
187 [89–272]qwen3-30b-a3b-instruct76/72025-07-28
188 [135–252]llama-4-maverick35+17/72025-04-05
189 [49–298]hy3-preview55/72026-04-13
190 [85–231]claude-3-haiku197/72024-03-13
191 [131–250]deepseek-r1487/72025-01-20
192 [132–240]o4-mini346/72025-04-16
193 [107–267]granite-4.0-small63/72025-10-02
194 [36–303]nemotron-3-nano-30b-a3b7+14/72025-12-15
195 [23–308]qwen3-coder-480b-a35b-instruct42/72025-07-22
196 [101–284]glm-4-9b-chat84/72024-06-05
197 [103–240]gemini-2.0-flash207/72024-12-11
198 [117–234]qwen1.5-72b-chat136/72024-02-04
199 [105–241]yi-34b-chat95/72023-11-23
200 [113–297]llama-3.2-instruct-11b-vision34/72024-09-25
201 [22–274]gpt-5.4-nano166/72026-03-17
202 [73–280]command-r-plus127/72024-04-04
203 [113–328]mistral-small-3.152/72025-03-11
204 [76–260]gemma-2b-it56/72024-02-21
205 [16–281]nova-micro65/72024-12-03
206 [134–246]qwen1.5-7b-chat96/72024-02-04
207 [86–290]step-3.5-flash5+16/72026-02-01
208 [42–310]mistral-medium-3.575/72026-03-31
209 [63–279]internlm-chat-7b54/72023-07-06
210 [131–259]llama-3.1-405b-instruct236/72024-07-23
211 [116–280]gpt-4.1-nano156/72025-04-14
212 [116–259]gemini-3-flash-preview28+17/72025-12-17
213 [93–262]gemma-7b-it77/72024-02-21
214 [104–301]grok-4.1-fast257/72025-11-19
215 [84–262]claude-2.154/72023-11-21
216 [113–283]mistral-small-476/72026-01-23
217 [37–309]llama-3.2-90b-vision-instruct44/72024-09-19
218 [36–307]deepseek-llm-7b-chat33/72023-11-29
219 [36–294]gemini-2.0-flash-lite55/72025-02-25
220 [120–302]glm-4.796/72026-06-03
221 [59–290]step-3.7-flash1+22/72026-05-23
222 [111–260]llama-2-13b-chat106/72023-07-18
223 [107–294]glm-4.696/72025-09-30
224 [120–281]mimo-v2-flash76/72025-12-16
225 [121–315]magistral-medium86/72025-06-10
226 [122–258]yi-6b-chat55/72023-11-23
227 [104–259]gemma-2-9b-it97/72024-06-27
228 [94–272]gemini-2.5-flash-lite237/72025-06-17
229 [37–306]gemma-3-12b96/72025-03-10
230 [92–294]deepseek-v3.1-terminus44/72025-09-22
231 [18–274]granite-4.0-micro-guardian63/72025-10-02
232 [123–274]llama-3-70b-instruct137/72024-04-18
233 [135–283]glm-4.5117/72025-07-28
234 [110–251]claude-3-sonnet157/72024-03-04
235 [131–253]llama-2-7b-chat167/72023-07-18
236 [129–298]gemini-2.0-flash-lite-preview75/72025-02-05
237 [44–302]glm-5-turbo76/72026-03-15
238 [137–249]llama-3-8b-instruct167/72024-04-18
239 [101–309]qwen3.5-122b-a10b55/72026-02-24
240 [55–320]command-r84/72024-03-11
241 [40–303]qwen3.5-4b35/72026-02-27
242 [162–264]gemma-2-27b-it67/72024-06-27
243 [141–290]yi-1.5-9b-chat33/72024-05-13
244 [128–279]chatglm-6b54/72023-03-14
245 [123–267]llama-3.1-70b-instruct237/72024-07-23
246 [81–288]olmo-2-32b-instruct86/72025-03-13
247 [163–269]qwen-7b-chat94/72023-08-03
248 [61–301]ernie-5.134/72026-05-09
249 [137–309]qwen3.5-35b-a3b54/72026-02-24
250 [173–277]baichuan-2-7b-chat115/72023-09-06
251 [44–316]mistral-medium-3.197/72025-08-12
252 [71–289]qwen2.5-7b-instruct19+17/72024-09-19
253 [106–292]phi-3.5-mini-instruct56/72024-08-22
254 [73–301]minimax-m2.163/72025-12-20
255 [14–318]nvidia-nemotron-nano-9b-v232/72025-08-12
256 [110–323]phi-233/72023-12-12
257 [185–269]gpt-4o-mini317/72024-07-18
258 [148–275]qwen2.5-14b-instruct65/72024-09-19
259 [83–315]o3-pro43/72025-06-10
260 [113–294]llama-2-70b-chat96/72023-07-18
261 [49–294]yi-1.5-34b-chat44/72024-05-13
262 [189–281]chatglm3-6b104/72023-10-27
263 [111–290]trinity-large74/72026-01-27
264 [188–279]vicuna-7b-v1.544/72023-06-22
265 [49–294]gemma-3-27b-it136/72025-03-10
266 [131–298]nova-pro86/72024-12-03
267 [139–321]qwen3-vl-32b-instruct33/72025-10-19
268 [39–325]mistral-small-396/72025-01-30
269 [202–275]llama-4-scout217/72025-04-05
270 [140–307]muse-glimmer2+14/72026-08-10
271 [107–310]gemma-2-2b-it45/72024-07-31
272 [111–313]mistral-small-3.245/72025-06-19
273 [21–317]olmo-3.1-32b-think32/72025-12-10
274 [199–294]mistral-7b-instruct247/72023-09-27
275 [127–330]mistral-nemo55/72024-07-18
276 [170–319]qwen2-7b-instruct54/72024-06-07
277 [210–297]palmyra-med63/72024-07-31
278 [144–327]ling-2.6-flash3+15/72026-04-21
279 [187–317]qwen2.5-max46/72025-01-25
280 [195–287]vicuna-13b-v1.544/72023-03-30
281 [180–313]vicuna-13b43/72023-03-30
282 [111–324]qwen2.5-1.5b-instruct53/72024-09-19
283 [65–330]qwen2.5-3b-instruct33/72024-09-17
284 [67–315]granite-3.3-8b-instruct94/72025-04-10
285 [77–319]qwen1.5-0.5b-chat34/72024-02-04
286 [189–315]gemma-3-4b66/72025-03-10
287 [203–314]chatglm2-6b63/72023-06-25
288 [215–298]llama-3.1-8b-instruct327/72024-07-23
289 [209–300]qwen3-14b66/72025-04-27
290 [31–321]olmo-2-13b-instruct65/72024-11-26
291 [111–328]seallms-v3-7b-chat34/72024-07-03
292 [217–302]qwen3-8b106/72025-04-29
293 [156–317]zephyr-7b-beta54/72023-10-26
294 [166–331]mistral-medium-365/72025-05-07
295 [113–329]qwen3-next-80b-a3b-instruct42/72025-09-09
296 [230–310]command-a85/72025-03-11
297 [127–325]qwen3-vl-235b-a22b-instruct44/72025-09-22
298 [163–322]phi-4-mini44/72025-02-26
299 [230–322]llama-3.2-1b-instruct96/72024-09-25
300 [217–315]moss-moon-003-sft33/72023-04-19
301 [153–327]mistral-7b44/72023-09-27
302 [235–308]qwen2.5-7b33/72024-09-19
303 [238–318]vicuna-33b-v1.344/72023-06-22
304 [43–326]mixtral-8x22b-instruct95/72024-04-17
305 [179–325]deepseek-v3.2-speciale33/72025-11-28
306 [192–320]granite-4.0-micro96/72025-10-02
307 [214–330]qwen3-vl-8b-instruct44/72025-10-11
308 [245–319]davinci34/72020-06-11
309 [194–325]mistral-large-3166/72025-12-01
310 [157–333]deepseek-llm-67b-chat85/72023-11-29
311 [232–318]vicuna-7b53/72023-06-22
312 [190–327]qwen3-4b-instruct32/72025-04-29
313 [202–321]marin-8b-instruct53/72025-05-14
314 [269–320]jamba-1.7-large44/72025-07-03
315 [219–329]qwq-32b45/72025-03-06
316 [231–329]mixtral-8x7b-instruct136/72023-12-10
317 [290–324]jamba-1.7-mini34/72025-07-03
318 [265–324]mistral-large-2145/72024-07-24
319 [231–326]olmo-2-7b-instruct65/72024-11-26
320 [254–328]qwen-1.8b-chat33/72023-11-30
321 [266–327]command-r7b34/72024-12-13
322 [263–333]llama-3.2-3b34/72024-09-25
323 [296–326]dbrx-instruct75/72024-03-27
324 [266–328]olmoe-1b-7b-instruct65/72025-01-27
325 [275–329]deepseek-r1-distill-llama-70b43/72025-01-20
326 [274–330]qwen1.5-1.8b-chat45/72024-02-04
327 [277–332]magistral-small55/72025-06-04
328 [228–333]grok-243/72024-12-12
329 [269–331]llama-3.2-3b-instruct85/72024-09-25
330 [304–333]qwen2.5-0.5b-instruct43/72024-09-19
331 [286–333]llama-3.1-8b-base34/72024-07-23
332 [313–332]ministral-3-14b32/72025-10-31
333 [322–333]ministral-3-8b42/72025-10-31