← Models

Model profile

Ernie 4.5 300B A47B

Baidudeveloper
2025-06-28release date
#127 / 267overall rank
5eval lineages

Evidence summary

Ernie 4.5 300B A47B has an estimated overall rank of #127; its 90% source-sensitivity interval is #26–#208. Its behavior-only rank is #132; company governance moves the combined estimate to #127. Published evidence spans 5 evals and 6 of 7 behavior components. Its strongest relative result is FlagEval Safety and Values (a5_qualified_rate, #1 of 18); its weakest is BullshitBench v2 (clear_pushback_rate, #100 of 105).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionBetterSource
AA-Omnisciencehallucination_rate#90 / 3110.671↓ lowerSource ↗official
BullshitBench v2clear_pushback_rate#100 / 1050.04↑ higherSource ↗official
Confabulationsconfabulation_rate#28 / 5225.25↓ lowerSource ↗official
FlagEval Safety and Valuesa1_qualified_rate#2 / 1885.04↑ higherSource ↗official
FlagEval Safety and Valuesa2_qualified_rate#11 / 1878.79↑ higherSource ↗official
FlagEval Safety and Valuesa3_qualified_rate#13 / 1885.37↑ higherSource ↗official
FlagEval Safety and Valuesa4_qualified_rate#3 / 1890.04↑ higherSource ↗official
FlagEval Safety and Valuesa5_qualified_rate#1 / 1877.55↑ higherSource ↗official
UAVBench safety-critical decision recognitionethical_safety_critical_accuracy#16 / 270.68↑ higherSource ↗official