Evaluation profile
Inkling-Small model card — FORTRESS
2sub-evals
0.305%total index weight
2components
Within-component eval weight: Benign helpfulness 2.71% · Misuse resistance 0.337%.
Model score (higher is better)Predicted score
About this eval
Harmful-request refusal paired with continued assistance on benign requests.
Included in the behavior ranking.
Sub-evals
| Measure | Component | Direction | Total index weight | Within-component weight |
|---|---|---|---|---|
| benign_answer_rateinkling-small-model-card/fortress.csv:benign_answer_rateMeasures whether the evaluated model continues answering safe requests rather than over-refusing them. | benign_helpfulness_non_overrefusal:1.000inkling-small-model-card | Higher is better | 0.271% | Benign helpfulness 2.71% |
| harmful_refusal_rateinkling-small-model-card/fortress.csv:harmful_refusal_rateMeasures whether the evaluated model refuses harmful adversarial requests. | ordinary_harm_misuse_resistance:1.000inkling-small-model-card | Higher is better | 0.0337% | Misuse resistance 0.337% |
benign_answer_rate
Measures whether the evaluated model continues answering safe requests rather than over-refusing them.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | deepseek-v4-flash | 99.2 | official | |
| 2 | gpt-5.6-luna | 97.8 | official | |
| 3 | inkling-small | 96.9 | official | |
| 4 | inkling | 95.9 | official | |
| 5 | gemini-3.5-flash-lite | 95.5 | official | |
| 6 | qwen3.5-397b-a17b | 95.4 | official | |
| 7 | mimo-v2.5 | 94.6 | official | |
| 8 | claude-haiku-4.5 | 94.1 | official | |
| 9 | nemotron-3-ultra | 90.6 | official | |
| 10 | minimax-m2.7 | 90.1 | official |
harmful_refusal_rate
Measures whether the evaluated model refuses harmful adversarial requests.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | claude-haiku-4.5 | 91.3 | official | |
| 2 | minimax-m2.7 | 86.3 | official | |
| 3 | gpt-5.6-luna | 83.8 | official | |
| 4 | inkling | 78 | official | |
| 5 | nemotron-3-ultra | 77.6 | official | |
| 6 | qwen3.5-397b-a17b | 77.3 | official | |
| 7 | inkling-small | 71.6 | official | |
| 8 | gemini-3.5-flash-lite | 70.7 | official | |
| 9 | mimo-v2.5 | 64.8 | official | |
| 10 | deepseek-v4-flash | 32 | official |