Shareable benchmark table
Conditions and budgets
The three frozen conditions run over the same three tasks, with their turn/tool budgets and wall-time caps.
Table 11 · Frozen protocol
Conditions and budgets
| Condition | Agent access | Turn / tool budget | Wall cap |
|---|---|---|---|
| Tool-assisted | Bounded search/read + forge build/test feedback, then one submitted proof | 12 turns / 10 tools | 1200 s |
| Static (no tools) | Full source context (target + provided test harness); no tool feedback | 3 turns / 0 tools | 900 s |
| Budgeted triage | A strict budget of four inspect operations, then one submission | 6 turns / 4 tools | 900 s |
The agent receives only the vulnerable workspace; the fixed revision is never mounted. Foundry ffi and filesystem permissions are disabled in every task.
