# Benchmark run 20261015T165911Z-suite-paper_repro-baseline-8b4f85

Status `success`, agent `baseline`, commit `62cdbe0860ad`.

| suite | tasks | pass rate | 95% CI | incidents as fail | incident rate | tokens in / out | cost |
|---|---|---|---|---|---|---|---|
| paper_repro | 153 | 0.366 | [0.343, 0.390] (cluster_bootstrap) | 0.366 | 0.000 | 0 / 0 | — |

- paper_repro: by kind tool 1.000 (n=56), agent 0.000 (n=55), design 0.000 (n=42); implementation fidelity 56/56; replication fidelity 101/144; accuracy given t1 0/55; tool coverage 56/56 (by_construction); agent coverage 55/56 (by_construction); failures no_estimate_cited 90, wrong_args 2, wrong_tool 5

Rendered from summary.json; every number there is recomputable from results.jsonl.