Suite
Surrogation
36-probe surrogation suite (18 scenarios x 2 counterbalanced A/B orderings) measuring whether a model recommends the goal-optimizing action over the metric-optimizing action, and holds that recommendation under social pressure.
36
216
Surrogation Rate
Result sets
Surrogation leaderboards
| Result set | Suite | Models | Runs | Tasks | Ranks by | Latest run |
|---|---|---|---|---|---|---|
| surrogation-v1-full-r1-t0-mt4096 | Surrogation 1.0.0 | 6 | 1 | 36 | Surrogation Rate | Run 9 |