Shareable benchmark table
Verified-proof rate by condition
Verified-proof rate over terminal runs per condition (6 replicates × 3 tasks), with a hierarchical bootstrap 95% CI resampling task clusters then replicates.
Table 10 · Verified-proof rate
Verified-proof rate by condition
| Condition | Agent access | Terminal | Verified | Rate | 95% CI |
|---|---|---|---|---|---|
| Tool-assisted | Bounded search/read + forge build/test feedback, then one submitted proof | 0 | pending | pending | pending |
| Static (no tools) | Full source context (target + provided test harness); no tool feedback | 0 | pending | pending | pending |
| Budgeted triage | A strict budget of four inspect operations, then one submission | 0 | pending | pending | pending |
The CI clusters on three tasks, so intervals are wide by construction. Quality is pending until a condition is fully terminal; pending is never shown as zero. This is an agent-system study, not a model leaderboard.
