Evaluation profile
Olam Social Poker — Social Lie Rate
1sub-evals
0.329%total index weight
1components
Within-component eval weight: Truthfulness 2.19%.
Model score (lower is better)Predicted score
About this eval
Propensity to verbalize deliberate strategic lies during Social Poker table talk.
Included in the behavior ranking.
Sub-evals
| Measure | Component | Direction | Total index weight | Within-component weight |
|---|---|---|---|---|
| social_lie_rate_per_10000_turnsolam-poker-deception/deception-rate.csv:social_lie_rate_per_10000_turnsMeasures how frequently a model chooses to make deliberate strategic false claims during Social Poker. | truthfulness_honesty:1.000olam-poker-deception | Lower is better | 0.329% | Truthfulness 2.19% |
social_lie_rate_per_10000_turns
Measures how frequently a model chooses to make deliberate strategic false claims during Social Poker.