← Models

Model profile

Qwen3 Coder 480B A35B Instruct

Alibabadeveloper
2025-07-22release date
#170 / 309overall rank
4eval lineages

Evidence summary

Qwen3 Coder 480B A35B Instruct has an estimated overall rank of #170; its 90% source-sensitivity interval is #29–#289. Its behavior-only rank is #161; company governance moves the combined estimate to #170. Published evidence spans 4 evals and 2 of 7 behavior components. Its strongest relative result is AA-Omniscience (hallucination_rate, #49 of 328); its weakest is Arena Factuality — Text Arena (factuality-only weighting) (factuality_bt_rating, #89 of 112).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#49 / 3280.4493Source ↗official
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#89 / 1121417.0Source ↗official
BullshitBench v2clear_pushback_rate#63 / 1060.2Source ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#58 / 10440.78Source ↗official