Evaluation profile
Inkling-Small model card — FORTRESS
2sub-evals
0.217%Safety weight
0.376%Freedom weight
2components
Weights below are portfolio-specific global index weights.
Model score (higher is better)Predicted score
About this eval
Harmful-request refusal paired with continued assistance on benign requests.
Included in the behavior ranking.
Sub-evals
| Measure | Component | Direction by ranking | Safety weight | Freedom weight |
|---|---|---|---|---|
| benign_answer_rateinkling-small-model-card/fortress.csv:benign_answer_rateMeasures whether the evaluated model continues answering safe requests rather than over-refusing them. | Safety: benign_helpfulness_non_overrefusal:1.000 · Freedom: user_direction_following:1.000inkling-small-model-card | Safety: higher · Freedom: higher | 0.191% | 0.188% |
| harmful_refusal_rateinkling-small-model-card/fortress.csv:harmful_refusal_rateMeasures whether the evaluated model refuses harmful adversarial requests. | Safety: ordinary_harm_misuse_resistance:1.000 · Freedom: user_direction_following:1.000inkling-small-model-card | Safety: higher · Freedom: lower | 0.0262% | 0.188% |
benign_answer_rate
Measures whether the evaluated model continues answering safe requests rather than over-refusing them.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | deepseek-v4-flash | 99.2 | official | |
| 2 | gpt-5.6-luna | 97.8 | official | |
| 3 | inkling-small | 96.9 | official | |
| 4 | inkling | 95.9 | official | |
| 5 | gemini-3.5-flash-lite | 95.5 | official | |
| 6 | qwen3.5-397b-a17b | 95.4 | official | |
| 7 | mimo-v2.5 | 94.6 | official | |
| 8 | claude-haiku-4.5 | 94.1 | official | |
| 9 | nemotron-3-ultra | 90.6 | official | |
| 10 | minimax-m2.7 | 90.1 | official |
harmful_refusal_rate
Measures whether the evaluated model refuses harmful adversarial requests.
| Rank | Model | Value | Relative performance | Provenance |
|---|---|---|---|---|
| 1 | claude-haiku-4.5 | 91.3 | official | |
| 2 | minimax-m2.7 | 86.3 | official | |
| 3 | gpt-5.6-luna | 83.8 | official | |
| 4 | inkling | 78 | official | |
| 5 | nemotron-3-ultra | 77.6 | official | |
| 6 | qwen3.5-397b-a17b | 77.3 | official | |
| 7 | inkling-small | 71.6 | official | |
| 8 | gemini-3.5-flash-lite | 70.7 | official | |
| 9 | mimo-v2.5 | 64.8 | official | |
| 10 | deepseek-v4-flash | 32 | official |