{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number traced to a tool call or the question","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":true,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"CRB estimate_within_solution_ci: the answer figure inside the gold 95% interval effect \u00b1 1.96\u00b7|SE| of source crb_papers.q061.gold (closed, evaluate_result.py; no --auto-rescale)","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":[-0.005924892408704113,0.23647272648356268],"weight":1.0,"where":null},{"abs_tol":6.18361272684354e-08,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold effect to rel 1e-6 (abs floor 1e-6\u00b7SE); never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q061.gold","table":null,"tool":null,"value":0.11527391703742929,"weight":1.0,"where":null},{"abs_tol":6.18361272684354e-08,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold SE to rel 1e-6; never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q061.gold","table":null,"tool":null,"value":0.06183612726843541,"weight":1.0,"where":null}],"datasets":{"ds_0032":{"columns":null,"description":"| Variable Name | Description |\n| --- | --- |\n| countyid | Numeric identifier for a county in Zhejiang province, China. The same identifier links its observations across years. |\n| year | Calendar year. The file contains rows for 1952, 1957, 1965, 1978, and 1998. The nonsoe outcome is observed only in 1965, 1978, and 1998. |\n| nonsoe | Share of county industrial output produced by collective and private firms, on a 0\u20131 scale. Calculated as total industrial output minus state-owned industrial output, divided by total industrial output. |\n| mfc1978 | Indicator equal to 1 for a historically classified marginal-faction county in 1978, and 0 otherwise. This column combines the county's historical classification with the year being 1978; its zeros in other years do not mean that the historical classification changed. |\n| mfc1998 | Indicator equal to 1 for a historically classified marginal-faction county in 1998, and 0 otherwise. This column combines the same historical county classification with the year being 1998. |\n\nDataset Context:\nThis extract contains 61 counties in Zhejiang province, with 305 county-year rows. Industrial statistics were compiled from provincial statistical records. The non-state sector includes collective and private firms. Non-state industrial-output shares are unavailable in the file for 1952 and 1957; the numbers of counties with observed shares are 52 in 1965, 53 in 1978, and 61 in 1998. Reporting was disrupted during the Cultural Revolution, so the observations are benchmark years rather than a continuous annual series.\n\nHistorical county classifications were constructed from organizational histories and county gazetteers. In Zhejiang, counties maintaining independent guerrilla forces during 1945\u20131948 were classified as marginal-faction counties, reflecting the subsequent marginalization of those local political elites within the provincial power structure. Other counties form the dominant-faction category. This historical classification is constant for a county; 1978 and 1998 in the two column names identify observation years, not dates when the classification was introduced. The county-level classification can be recovered from either column's value in its named year.\n","file_sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","transforms":[],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0032/data/data.csv"},"ref_panel":{"columns":null,"description":"One row per county observed in 1965 and 1978: the change in nonsoe and the treated status","file_sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","transforms":[{"args":{"columns":["countyid","year","nonsoe","mfc1978"]},"op":"select"},{"args":{"query":"year in [1965, 1978]"},"op":"filter"},{"args":{"columns":["countyid","year","nonsoe"]},"op":"dropna"},{"args":{"query":"year == 1965"},"op":"filter"},{"args":{"map":{"nonsoe":"y_pre"}},"op":"rename"},{"args":{"columns":["countyid","y_pre"]},"op":"select"},{"args":{"how":"inner","on":["countyid"],"with":"ref_post"},"op":"merge"},{"args":{"how":"inner","on":["countyid"],"with":"ref_treat"},"op":"merge"},{"args":{"args":{"left":"y_post","right":"y_pre"},"name":"delta","op":"diff"},"op":"derive"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0032/data/data.csv"},"ref_post":{"columns":null,"description":"nonsoe of each county in 1978, as y_post","file_sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","transforms":[{"args":{"columns":["countyid","year","nonsoe","mfc1978"]},"op":"select"},{"args":{"query":"year in [1965, 1978]"},"op":"filter"},{"args":{"columns":["countyid","year","nonsoe"]},"op":"dropna"},{"args":{"query":"year == 1978"},"op":"filter"},{"args":{"map":{"nonsoe":"y_post"}},"op":"rename"},{"args":{"columns":["countyid","y_post"]},"op":"select"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0032/data/data.csv"},"ref_treat":{"columns":null,"description":"Each county's max of mfc1978 over its 1965 and 1978 rows (treated)","file_sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"reference","sha256":"6eede5a4f1540d2b6513ec2483909477a548f32e838e4e0bb0a385ab6edde649","transforms":[{"args":{"columns":["countyid","year","nonsoe","mfc1978"]},"op":"select"},{"args":{"query":"year in [1965, 1978]"},"op":"filter"},{"args":{"columns":["countyid","year","nonsoe"]},"op":"dropna"},{"args":{"aggs":[{"column":"mfc1978","fn":"max","name":"treated"}],"by":["countyid"]},"op":"collapse"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0032/data/data.csv"}},"difficulty":"M","id":"crb_papers.q061","level":"T2","meta":{"agent_reach":{"blocked_by":["reference_frame:ref_panel","reference_frame:ref_post","reference_frame:ref_treat"],"dtypes":{"ds_0032":{"mfc1978":"float64","nonsoe":"float64"}},"named":{"outcome":["nonsoe"],"treatment":["mfc1978"]},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"ds_0032","crb":{"data_path":"data/ds_0032/data/data.csv","dataset_id":"ds_0032","gold":{"ci95":[-0.005924892408704113,0.23647272648356268],"ci_rule":"effect \u00b1 1.96\u00b7|standard_error| (evaluate_result.ci_bounds)","effect":0.11527391703742929,"standard_error":0.06183612726843541},"identification":{"bad_controls":[],"causal_quantity":"ATT","controls":[],"group_variable":"countyid","minimal_controlling_set":[],"outcomes":["nonsoe"],"reason_for_bad_controls":"No post-treatment covariates are available beyond the outcome itself; we avoid adjusting for any variable determined after treatment to prevent over-control or collider bias.","reason_for_minimal_controlling_set":"Identification relies on county and year fixed effects and the exogenous timing of the Cultural Revolution. The paper argues selection into MFC/DFC stems from pre-1949 legacies and that the Cultural Revolution was an exogenous shock, so no observed time-varying controls are required for identification.","strategy":"Difference-in-Differences","time_variable":"year","treatments":["mfc1978"]},"identification_strategy":"Difference-in-Differences"},"headline_keys":{"infer.ols":["coef.treated"]},"naive":{"dataset":"ds_0032","treatment":"mfc1978","y":"nonsoe"},"native_id":"61","reference":{"cite":1,"note":"Reference path transcribed from the item's own estimation script.","steps":[{"args":{"dataset":"ref_panel","se":"HC1","x":["treated"],"y":"delta"},"tool":"infer.ols","why":"sm.OLS(delta, add_constant(treated)).fit(cov_type='HC1')"}]},"reference_path":{"calls":[{"args":{"dataset":"ref_panel","se":"HC1","x":["treated"],"y":"delta"},"tool":"infer.ols"}],"needs":[],"provenance":"benchmark_script","quotes":{},"reference_datasets":["ref_panel","ref_post","ref_treat"],"source_id":"crb_papers.q061.script"}},"question":"Did Zhejiang counties historically classified as marginal-faction counties experience larger growth in the non-state (collective and private) share of industrial output from 1965 to 1978 than dominant-faction counties?","requires":[],"runner":null,"sources":["crb_papers.q061.gold","crb_papers.q061.script"],"split":"public","suite":"crb_papers","tags":["econ-bench","external","crb","did","ref_benchmark_script"],"target":"agent","tool":null,"truth":"CausalReasoningBenchmark gold at the pinned revision: causal_queries.json effect and standard_error (the value the item's estimation.py prints), scored as evaluate_result.py scores estimate_within_solution_ci"}