← Models

Model profile

Mercury 2

Inception Labsdeveloper
2026-02-24release date
#162 / 348Safety rank
#457 / 663Freedom rank

Evidence summary

Safety. Mercury 2 has an estimated Safety rank of #162; its 90% source-sensitivity interval is #36–#326. Its behavior-only rank is #165; company governance moves the combined estimate to #162. Published Safety evidence spans 5 eval lineages and 5 of 7 components. Its strongest relative result is Adversarial Poetry Refusal (AHB self-run) (indiscriminate_weapons_cbrne, #1 of 14); its weakest is Enkrypt AI Safety Leaderboard (cbrn_attack_non_success_rate, #255 of 272).

Freedom. Mercury 2 has an estimated Freedom rank of #457; its 90% source-sensitivity interval is #319–#519. Published Freedom evidence spans 3 eval lineages and 1 of 1 components. Its strongest relative result is Enkrypt AI Safety Leaderboard (cbrn_attack_non_success_rate, #18 of 272); its weakest is Adversarial Poetry Refusal (AHB self-run) (defamation, #13 of 14).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#303 / 361↓0.9122Source ↗official
Adversarial Poetry Refusal (AHB self-run)child_sexual_exploitation#2 / 14↓1.449Source ↗self run
Adversarial Poetry Refusal (AHB self-run)defamation#2 / 14↓2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)hate#4 / 14↓5.797Source ↗self run
Adversarial Poetry Refusal (AHB self-run)indiscriminate_weapons_cbrne#1 / 14↓0Source ↗self run
Adversarial Poetry Refusal (AHB self-run)intellectual_property#3 / 14↓2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)non_violent_crimes#4 / 14↓2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)privacy#5 / 14↓9.42Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sex_related_crimes#6 / 14↓5.072Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sexual_content#3 / 14↓4.545Source ↗self run
Adversarial Poetry Refusal (AHB self-run)specialized_advice#3 / 14↓2.333Source ↗self run
Adversarial Poetry Refusal (AHB self-run)suicide_self_harm#4 / 14↓3.788Source ↗self run
Adversarial Poetry Refusal (AHB self-run)violent_crimes#2 / 14↓2.273Source ↗self run
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#93 / 111↑1408.0Source ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#57 / 272↑30.49Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#255 / 272↑52.67Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#21 / 272↑98.89Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#91 / 270↑97.64Source ↗official
Vectara HHEM Factual Consistencyfactual_consistency_rate#76 / 94↑87.7Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Adversarial Poetry Refusal (AHB self-run)child_sexual_exploitation#11 / 14↑1.449Source ↗self run
Adversarial Poetry Refusal (AHB self-run)defamation#13 / 14↑2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)hate#9 / 14↑5.797Source ↗self run
Adversarial Poetry Refusal (AHB self-run)indiscriminate_weapons_cbrne#12 / 14↑0Source ↗self run
Adversarial Poetry Refusal (AHB self-run)intellectual_property#12 / 14↑2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)non_violent_crimes#11 / 14↑2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)privacy#10 / 14↑9.42Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sex_related_crimes#9 / 14↑5.072Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sexual_content#11 / 14↑4.545Source ↗self run
Adversarial Poetry Refusal (AHB self-run)specialized_advice#11 / 14↑2.333Source ↗self run
Adversarial Poetry Refusal (AHB self-run)suicide_self_harm#11 / 14↑3.788Source ↗self run
Adversarial Poetry Refusal (AHB self-run)violent_crimes#12 / 14↑2.273Source ↗self run
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#18 / 272↓52.67Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#248 / 272↓98.89Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#177 / 270↓97.64Source ↗official
SpeechMap model completioncomplete_pct#94 / 181↑57Source ↗official