{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number traced to a tool call or the question","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":true,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"CRB estimate_within_solution_ci: the answer figure inside the gold 95% interval effect \u00b1 1.96\u00b7|SE| of source crb_papers.q026.gold (closed, evaluate_result.py; no --auto-rescale)","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":[0.0009770944724262626,0.22369236157944505],"weight":1.0,"where":null},{"abs_tol":5.681511915995377e-08,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold effect to rel 1e-6 (abs floor 1e-6\u00b7SE); never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q026.gold","table":null,"tool":null,"value":0.11233472802593567,"weight":1.0,"where":null},{"abs_tol":5.681511915995377e-08,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold SE to rel 1e-6; never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q026.gold","table":null,"tool":null,"value":0.05681511915995378,"weight":1.0,"where":null}],"datasets":{"ds_0014":{"columns":null,"description":"| Variable Name | Description |\n| --- | --- |\n| cycle | Even-numbered year of the U.S. House general-election cycle (range: 1980\u20132012). Serves as the time index for the panel. |\n| district_final | Congressional district identifier (state postal abbreviation + district number, e.g., AK1 for at\u2011large). District codes are reindexed after each decennial redistricting to reflect new boundaries. |\n| general_sharetotal_A_all | Proportion (0\u20131) of all itemized individual dollars contributed to candidates in the district\u2019s general-election contest that are attributed to donors classified as Asian. Donor ethnoracial identity is inferred with a surname\u2013geography Bayesian method and aggregated to the district\u2013cycle level. |\n| general_sharetotal_B_all | Proportion (0\u20131) of all itemized individual dollars contributed to candidates in the district\u2019s general-election contest that are attributed to donors classified as Black. Donor ethnoracial identity is inferred with a surname\u2013geography Bayesian method and aggregated to the district\u2013cycle level. |\n| general_sharetotal_H_all | Proportion (0\u20131) of all itemized individual dollars contributed to candidates in the district\u2019s general-election contest that are attributed to donors classified as Latino/Hispanic. Donor ethnoracial identity is inferred with a surname\u2013geography Bayesian method and aggregated to the district\u2013cycle level. |\n| cand_A_all | Indicator (1/0) that at least one major\u2011party nominee (Democratic or Republican) in the district\u2019s general election is identified as Asian, based on verified public sources and candidate records. |\n| cand_B_all | Indicator (1/0) that at least one major\u2011party nominee in the district\u2019s general election is identified as Black, based on verified public sources and candidate records. |\n| cand_H_all | Indicator (1/0) that at least one major\u2011party nominee in the district\u2019s general election is identified as Latino/Hispanic, based on verified public sources and candidate records. |\n| dfe | Constant column equal to 1 for all rows, included for convenience in some analysis workflows; it carries no substantive information about districts or elections. |\n\nDataset Context:\nThis panel assembles district\u2013election year information for U.S. House general elections from 1980 through 2012. Monetary figures come from the DIME compilation of Federal Election Commission disclosures and related sources, limited to itemized individual contributions reported under federal law (generally contributions exceeding the cycle-level reporting threshold). Dollars are aggregated to the general-election period for candidates competing in a given district and cycle.\n\nTo characterize the ethnoracial composition of contributors, the data employ a widely used Bayesian surname\u2013geography approach (implemented via the wru methodology). This procedure combines U.S. Census surname frequencies with donors\u2019 geocoded locations (Census tract or, if unavailable, state) to estimate the probability that a donor belongs to an ethnoracial group; donors are then assigned to the most probable category, and contributions are summed to compute district-level shares for Asian, Black, and Latino/Hispanic contributors. These shares are fractions of total itemized individual dollars given to general-election candidates in the district; the remainder of contributions reflects donors in other categories.\n\nCandidate ethnoracial identity is coded from verified public records, including congressional caucus memberships and other documentation, and linked to each district\u2019s major\u2011party general-election nominees. District identifiers reflect changes from decennial redistricting (e.g., around 1982, 1992, 2002, and 2012), so the same geographic area may appear under different labels across redistricting periods. Because federal disclosures only require itemization above the reporting threshold, very small donations are not included; all shares and totals therefore describe the universe of reported itemized individual contributions.","file_sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","transforms":[],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0014/data/data.csv"},"ref_complete":{"columns":null,"description":"How many of 2008 and 2010 each district has the outcome in","file_sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","transforms":[{"args":{"columns":["cycle","district_final","cand_A_all","cand_B_all","cand_H_all","general_sharetotal_A_all"]},"op":"select"},{"args":{"query":"cycle in [2008, 2010]"},"op":"filter"},{"args":{"columns":["general_sharetotal_A_all"]},"op":"dropna"},{"args":{"aggs":[{"column":"general_sharetotal_A_all","fn":"count","name":"n"}],"by":["district_final","cycle"]},"op":"collapse"},{"args":{"aggs":[{"column":"n","fn":"count","name":"ncycles"}],"by":["district_final"]},"op":"collapse"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0014/data/data.csv"},"ref_panel":{"columns":null,"description":"District rows of 2008 and 2010: no Asian nominee then one (treated) or in neither (control), outcome observed in both","file_sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","transforms":[{"args":{"columns":["cycle","district_final","cand_A_all","cand_B_all","cand_H_all","general_sharetotal_A_all"]},"op":"select"},{"args":{"query":"cycle in [2008, 2010]"},"op":"filter"},{"args":{"how":"inner","on":["district_final"],"with":"ref_pre"},"op":"merge"},{"args":{"how":"inner","on":["district_final"],"with":"ref_post"},"op":"merge"},{"args":{"query":"a_pre == 0 and (a_post == 1 or a_post == 0)"},"op":"filter"},{"args":{"how":"left","on":["district_final"],"with":"ref_complete"},"op":"merge"},{"args":{"query":"ncycles == 2"},"op":"filter"},{"args":{"args":{"cmp":"eq","column":"a_post","value":1},"name":"Treated","op":"indicator"},"op":"derive"},{"args":{"args":{"cmp":"eq","column":"cycle","value":2010},"name":"Post","op":"indicator"},"op":"derive"},{"args":{"args":{"columns":["Treated","Post"]},"name":"Treated_Post","op":"interaction"},"op":"derive"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0014/data/data.csv"},"ref_post":{"columns":null,"description":"Each district's cand_A_all in 2010 (a_post)","file_sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","transforms":[{"args":{"columns":["cycle","district_final","cand_A_all","cand_B_all","cand_H_all","general_sharetotal_A_all"]},"op":"select"},{"args":{"query":"cycle == 2010"},"op":"filter"},{"args":{"columns":["district_final","cand_A_all"]},"op":"select"},{"args":{"map":{"cand_A_all":"a_post"}},"op":"rename"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0014/data/data.csv"},"ref_pre":{"columns":null,"description":"Each district's cand_A_all in 2008 (a_pre)","file_sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"a9a7b57b90e4f8ca919421bfb08da2403ef1dd534ec517c0236f12c81f504038","transforms":[{"args":{"columns":["cycle","district_final","cand_A_all","cand_B_all","cand_H_all","general_sharetotal_A_all"]},"op":"select"},{"args":{"query":"cycle == 2008"},"op":"filter"},{"args":{"columns":["district_final","cand_A_all"]},"op":"select"},{"args":{"map":{"cand_A_all":"a_pre"}},"op":"rename"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0014/data/data.csv"}},"difficulty":"M","id":"crb_papers.q026","level":"T2","meta":{"agent_reach":{"blocked_by":["reference_frame:ref_complete","reference_frame:ref_panel","reference_frame:ref_post","reference_frame:ref_pre"],"dtypes":{"ds_0014":{"cand_A_all":"float64","general_sharetotal_A_all":"float64"}},"named":{"outcome":["general_sharetotal_A_all"],"treatment":["cand_A_all"]},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"ds_0014","crb":{"data_path":"data/ds_0014/data/data.csv","dataset_id":"ds_0014","gold":{"ci95":[0.0009770944724262626,0.22369236157944505],"ci_rule":"effect \u00b1 1.96\u00b7|standard_error| (evaluate_result.ci_bounds)","effect":0.11233472802593567,"standard_error":0.05681511915995378},"identification":{"bad_controls":null,"causal_quantity":"ATT","controls":["cand_B_all","cand_H_all"],"group_variable":"district_final","minimal_controlling_set":["cand_B_all","cand_H_all"],"outcomes":["general_sharetotal_A_all"],"reason_for_bad_controls":null,"reason_for_minimal_controlling_set":"The paper\u2019s DiD specification includes indicator variables for the presence of Asian, Black, and Latino nominees in the general election simultaneously: \u201cAsian.Candidate_it, Black.Candidate_it, and Latino.Candidate_it are dummy variables for the presence of a nominee of the ethnorace in the general election.\u201d (Estimation Strategy \u2014 Difference-in-Difference Design). Including the other minority-candidate indicators alongside cand_A_all blocks co-treatments in the same election when estimating the ATT for Asian candidates.","strategy":"Difference-in-Differences","time_variable":"cycle","treatments":["cand_A_all"]},"identification_strategy":"Difference-in-Differences"},"headline_keys":{"infer.ols":["coef.Treated_Post"]},"naive":{"dataset":"ds_0014","treatment":"cand_A_all","y":"general_sharetotal_A_all"},"native_id":"26","reference":{"cite":1,"note":"Reference path transcribed from the item's own estimation script.","steps":[{"args":{"cluster":"district_final","controls":["Treated","Post","cand_B_all","cand_H_all"],"dataset":"ref_panel","x":["Treated_Post"],"y":"general_sharetotal_A_all"},"tool":"infer.ols","why":"smf.ols('general_sharetotal_A_all ~ Treated + Post + Treated:Post + cand_B_all + cand_H_all').fit(cov_type='cluster', groups=district_final) (CR1 errors with statsmodels' default G/(G-1)\u00b7(N-1)/(N-K) correction)"}]},"reference_path":{"calls":[{"args":{"cluster":"district_final","controls":["Treated","Post","cand_B_all","cand_H_all"],"dataset":"ref_panel","x":["Treated_Post"],"y":"general_sharetotal_A_all"},"tool":"infer.ols"}],"needs":[],"provenance":"benchmark_script","quotes":{},"reference_datasets":["ref_complete","ref_panel","ref_post","ref_pre"],"source_id":"crb_papers.q026.script"}},"question":"Among districts observed in 2008 and 2010, how did the share of general-election contributions from Asian donors change when a district went from having no Asian major-party nominee to having one, relative to districts with no Asian nominee in either election?","requires":[],"runner":null,"sources":["crb_papers.q026.gold","crb_papers.q026.script"],"split":"public","suite":"crb_papers","tags":["econ-bench","external","crb","did","ref_benchmark_script"],"target":"agent","tool":null,"truth":"CausalReasoningBenchmark gold at the pinned revision: causal_queries.json effect and standard_error (the value the item's estimation.py prints), scored as evaluate_result.py scores estimate_within_solution_ci"}