{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number traced to a tool call or the question","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":true,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"CRB estimate_within_solution_ci: the answer figure inside the gold 95% interval effect \u00b1 1.96\u00b7|SE| of source crb_papers.q118.gold (closed, evaluate_result.py; no --auto-rescale)","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":[0.22662636020803378,0.7306884804562361],"weight":1.0,"where":null},{"abs_tol":1.2858727557352104e-07,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold effect to rel 1e-6 (abs floor 1e-6\u00b7SE); never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q118.gold","table":null,"tool":null,"value":0.478657420332135,"weight":1.0,"where":null},{"abs_tol":1.2858727557352104e-07,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold SE to rel 1e-6; never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q118.gold","table":null,"tool":null,"value":0.12858727557352104,"weight":1.0,"where":null}],"datasets":{"ds_0083":{"columns":null,"description":"| Variable Name | Description                                                                                   |\n|---------------|-----------------------------------------------------------------------------------------------|\n| petpooled     | Indicator equal to 1 if the member signed at least one pro\u2013civil rights discharge petition in the specified Congress; 0 otherwise. |\n| Dvotespercent | Democratic candidate\u2019s two\u2011party vote share in the district in the most recent U.S. House election before the Congress (0\u20131).      |\n| icpsr         | ICPSR legislator identification code for the U.S. House member.                                |\n\nData Description: \nThis dataset links individual U.S. House members to their participation in civil rights discharge petitions during a specific Congress. The underlying historical collection spans 1933\u20131972. The core variable captures whether a member signed any of the pro\u2013civil rights discharge petitions filed in that Congress, merged with district electoral information from the preceding House election and a stable legislator identifier.\n\nDischarge petition signatures were transcribed from archival petition sheets housed at the National Archives, while district vote shares were drawn from compiled U.S. House election returns (ICPSR archives). Legislator identifiers come from ICPSR coding. The file corresponds to observations of House members (ICPSR-coded) and, consistent with the study\u2019s focus, covers non\u2011Southern districts as defined in the paper. The \u201cpetpooled\u201d measure pools signatures across all relevant pro\u2013civil rights discharge petitions filed within the Congress represented in the file.\n","file_sha256":"d24cd40c82c62b3418b80bcf67b8a4dd44b0282a0676b16bff2ef0aa9245b07d","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"d24cd40c82c62b3418b80bcf67b8a4dd44b0282a0676b16bff2ef0aa9245b07d","transforms":[],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0083/data/data.csv"}},"difficulty":"M","id":"crb_papers.q118","level":"T2","meta":{"agent_reach":{"blocked_by":["no_reference_path","no_tool:rdrobust_robust_bias_corrected","needs_op:rdrobust_cluster_variance"],"dtypes":{"ds_0083":{"Dvotespercent":"float64","petpooled":"int64"}},"named":{"outcome":["petpooled"],"treatment":["Dvotespercent"]},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"ds_0083","crb":{"data_path":"data/ds_0083/data/data.csv","dataset_id":"ds_0083","gold":{"ci95":[0.22662636020803378,0.7306884804562361],"ci_rule":"effect \u00b1 1.96\u00b7|standard_error| (evaluate_result.ci_bounds)","effect":0.478657420332135,"standard_error":0.12858727557352104},"identification":{"causal_quantity":"CATE","cutoff":0.5,"outcomes":["petpooled"],"running_variable":"Dvotespercent","strategy":"Regression Discontinuity","treatments":["Dvotespercent"],"variant":"sharp"},"identification_strategy":"Regression Discontinuity"},"naive":{"dataset":"ds_0083","treatment":"Dvotespercent","y":"petpooled"},"native_id":"118","reference_path":{"calls":[],"needs":["no_tool:rdrobust_robust_bias_corrected","needs_op:rdrobust_cluster_variance"],"provenance":"none","quotes":{},"reference_datasets":[],"source_id":"crb_papers.q118.script"}},"question":"Among U.S. House races decided near the 50% threshold prior to the 83rd Congress, what is the effect of electing a Democrat (versus a Republican) on the representative's likelihood of supporting civil-rights discharge petitions during the 83rd Congress?","requires":[],"runner":null,"sources":["crb_papers.q118.gold","crb_papers.q118.script"],"split":"public","suite":"crb_papers","tags":["econ-bench","external","crb","rd","ref_none"],"target":"agent","tool":null,"truth":"CausalReasoningBenchmark gold at the pinned revision: causal_queries.json effect and standard_error (the value the item's estimation.py prints), scored as evaluate_result.py scores estimate_within_solution_ci"}