Model profile
Claude 2.1
Anthropicdeveloper
2023-11-21release date
#198 / 312overall rank
5eval lineages
Evidence summary
Claude 2.1 has an estimated overall rank of #198; its 90% source-sensitivity interval is #29–#250. Its behavior-only rank is #215; company governance moves the combined estimate to #198. Published evidence spans 5 evals and 4 of 7 behavior components. Its strongest relative result is SORRY-Bench (avg, #1 of 51); its weakest is Claude 3 model-card adversarial human-preference evaluations (incorrect_refusals_wildchat_rank, #5 of 5).
Compare this model
Only models sharing at least one published sub-eval are listed.
Official and reference links
- OpenRouter ↗anthropic/claude-2.1
- Official model documentation ↗Family-level model document · anthropic · first party
- Release source ↗direct research preview identity date
Published eval results
Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.