← Models

Model profile

Mercury 2

Inception Labsdeveloper
2026-02-24release date
#173 / 333Safety rank
#450 / 645Freedom rank

Evidence summary

Safety. Mercury 2 has an estimated Safety rank of #173; its 90% source-sensitivity interval is #55–#312. Its behavior-only rank is #177; company governance moves the combined estimate to #173. Published Safety evidence spans 4 eval lineages and 4 of 7 components. Its strongest relative result is Adversarial Poetry Refusal (AHB self-run) (child_sexual_exploitation, #1 of 8); its weakest is Arena Factuality — Text Arena (factuality-only weighting) (factuality_bt_rating, #93 of 111).

Freedom. Mercury 2 has an estimated Freedom rank of #450; its 90% source-sensitivity interval is #311–#545. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is Adversarial Poetry Refusal (AHB self-run) (hate, #4 of 8); its weakest is Adversarial Poetry Refusal (AHB self-run) (defamation, #8 of 8).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#286 / 3450.9122Source ↗official
Adversarial Poetry Refusal (AHB self-run)child_sexual_exploitation#1 / 81.449Source ↗self run
Adversarial Poetry Refusal (AHB self-run)defamation#1 / 82.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)hate#3 / 85.797Source ↗self run
Adversarial Poetry Refusal (AHB self-run)indiscriminate_weapons_cbrne#1 / 80Source ↗self run
Adversarial Poetry Refusal (AHB self-run)intellectual_property#2 / 82.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)non_violent_crimes#2 / 82.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)privacy#3 / 89.42Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sex_related_crimes#4 / 85.072Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sexual_content#1 / 84.545Source ↗self run
Adversarial Poetry Refusal (AHB self-run)specialized_advice#1 / 82.333Source ↗self run
Adversarial Poetry Refusal (AHB self-run)suicide_self_harm#2 / 83.788Source ↗self run
Adversarial Poetry Refusal (AHB self-run)violent_crimes#1 / 82.273Source ↗self run
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#93 / 1111408.0Source ↗official
Vectara HHEM Factual Consistencyfactual_consistency_rate#76 / 9487.7Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.