{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"tool_called","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"evidence.pool_dl","value":null,"weight":1.0,"where":null},{"abs_tol":0.005,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":"pooled","kind":"figure_close","min_lre":null,"note":"headline figure against the truth","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"evidence.pool_dl","value":4.303993521444336,"weight":1.0,"where":null},{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number traced to a tool call or the question","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"any_of","min_lre":null,"note":"the answer cites the expected tool's figures","open_interval":false,"rel_tol":null,"required":false,"source_id":null,"table":null,"tool":null,"value":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_cites","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"evidence.pool_dl","value":null,"weight":1.0,"where":null}],"weight":1.0,"where":null}],"datasets":{},"difficulty":"M","id":"tool_selection.pooling.test.s1004","level":"T2","meta":{"acceptable_tools":[],"expected_tool":"evidence.pool_dl","family":"pooling","features":["meta_analysis","published_estimates"],"headline_keys":{"evidence.pool_dl":["pooled"]},"lesson":"Several independent estimates of one effect in one unit: evidence.pool_dl with one estimate per study, and report the heterogeneity.","params":{"estimates":[4.6,1.7,5.4,3.2],"k":4,"mu":5.7,"se":[0.8,2.2,1.9,2.2],"tau":0.5,"with_ci":false},"reference":{"cite":1,"note":"","steps":[{"args":{"estimates":[{"estimate":4.6,"id":"e1","se":0.8,"study_id":"A"},{"estimate":1.7,"id":"e2","se":2.2,"study_id":"B"},{"estimate":5.4,"id":"e3","se":1.9,"study_id":"C"},{"estimate":3.2,"id":"e4","se":2.2,"study_id":"D"}],"unit":"pontos percentuais"},"tool":"evidence.pool_dl","why":"Estudos independentes do mesmo efeito: meta-an\u00e1lise de efeitos aleat\u00f3rios."}]},"seed":1004,"tolerance":0.005,"trap_tools":[],"truth_value":4.303993521444336,"variant":0},"question":"Quatro avalia\u00e7\u00f5es independentes de programas de transfer\u00eancia de renda condicionada estimaram o efeito sobre a frequ\u00eancia escolar, em pontos percentuais:\n- Estudo A (2008): 4,6 (erro-padr\u00e3o 0,8)\n- Estudo B (2009): 1,7 (erro-padr\u00e3o 2,2)\n- Estudo C (2011): 5,4 (erro-padr\u00e3o 1,9)\n- Estudo D (2013): 3,2 (erro-padr\u00e3o 2,2)\nO que esses estudos indicam, em conjunto, sobre o efeito m\u00e9dio? Qu\u00e3o diferentes s\u00e3o entre si?","requires":[],"runner":null,"sources":[],"split":"test","suite":"tool_selection","tags":["tool_selection","pooling","test"],"target":"agent","tool":null,"truth":"DerSimonian\u2013Laird random-effects mean of the 4 estimates as written in the question (closed form, numpy) = 4.30399 (SE 0.6663); tolerance 0.005 covers interval-to-SE conventions"}