Execução 20261015T171142Z-suite-causcibench_real-naive-d6494d

{}

{
  "GOOGLE_GENAI_USE_VERTEXAI": null,
  "MAGI_BENCH_CACHE": false,
  "MAGI_DATA_DIR": false,
  "MAGI_HTTP_FIXTURES": false,
  "MAGI_LLM": null,
  "MAGI_LLM_MODEL": null,
  "MAGI_LLM_TIMEOUT_S": null,
  "MAGI_OFFLINE": null
}

• 0 em cache
• 0 tokens em incidentes
• 0 entrada
• 276 chamadas ao modelo
• 0 saída
• 0 raciocínio
• 123 chamadas de ferramentas

Plan suite-causcibench_real: 153 task(s) of causcibench_real, agent naive (naive-ols), 1 epoch(s) for agent tasks.

Anyone can run verify_bundle.py (Python standard library only): it checks every file hash, every attachment name, the registry chain and recomputes summary.json from results.jsonl. Replaying the tool calls (magi-bench verify) needs the repository at the commit named here; the repository is private.

• Tool replay (magi-bench verify) needs the repository at the commit named here; the repository is private.
• Thought summaries, where recorded, are as the model reported them.