{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number traced to a tool call or the question","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":true,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"CRB estimate_within_solution_ci: the answer figure inside the gold 95% interval effect \u00b1 1.96\u00b7|SE| of source crb_papers.q063.gold (closed, evaluate_result.py; no --auto-rescale)","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":[-0.013648284776121233,3.4245468339091016],"weight":1.0,"where":null},{"abs_tol":8.770905915013323e-07,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold effect to rel 1e-6 (abs floor 1e-6\u00b7SE); never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q063.gold","table":null,"tool":null,"value":1.7054492745664902,"weight":1.0,"where":null},{"abs_tol":8.770905915013323e-07,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"replication cell: the gold SE to rel 1e-6; never required","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"crb_papers.q063.gold","table":null,"tool":null,"value":0.8770905915013324,"weight":1.0,"where":null}],"datasets":{"ds_0033":{"columns":null,"description":"| Variable Name | Description |\n|---------------|-------------|\n| year | Reference calendar year t for the country\u2013year record; the released extract has reference years 1987\u20132006. |\n| ccode | Numeric country identifier (standard country code used to identify panel units). |\n| new_empinx | Annual CIRI \"Human Empowerment\" index (composite civil and political rights indicator) for the country\u2013year. |\n| polity2 | Polity IV combined regime score for the country\u2013year (standard polity measure of regime characteristics). |\n| EV | Natural logarithm of one plus net EU/European Community official development assistance in year t\u22121, measured in millions of constant 1995 US dollars. Negative net amounts were set to zero before the logarithmic transformation. |\n| l2CPcol2 | Equals 1 when the recipient country was a former colony of the EU member holding the Council presidency during July\u2013December of year t\u22122; otherwise 0. |\n| covihme_ayem | Average years of educational attainment (lagged educational-attainment measure, source noted in paper). |\n| covihme_ayemF | Equals 1 when covihme_ayem represents a missing value coded \u221299, and 0 otherwise. |\n| covwdi_exp | Exports (World Bank WDI series, lagged; often logged/transformed in the replication). |\n| covwdi_expF | Missingness flag / indicator for covwdi_exp. |\n| covwdi_fdi | Foreign direct investment (WDI series, lagged; inward FDI measure). |\n| covwdi_fdiF | Missingness flag / indicator for covwdi_fdi. |\n| covwdi_imp | Imports (World Bank WDI series, lagged; often logged/transformed). |\n| covwdi_impF | Missingness flag / indicator for covwdi_imp. |\n| covwvs_rel | Lagged religiosity measure included in the source socioeconomic compilation; measured in year t\u22122, with \u221299 for missing values. |\n| covwvs_relF | Missingness flag / indicator for covwvs_rel. |\n| coviNY_GDP_PETR_RT_ZS | Petroleum/oil rents as percent of GDP (World Bank indicator NY.GDP.PETR.RT.ZS), lagged. |\n| coviNY_GDP_PETR_RT_ZSF | Missingness flag / indicator for coviNY_GDP_PETR_RT_ZS. |\n| covdemregion | Regional democracy context: number (or summary count) of democracies in the same region (lagged regional-democracy measure). |\n| covdemregionF | Missingness flag / indicator for covdemregion. |\n| covloggdpC | Logged GDP per capita measured in year t\u22122; missing values are represented by \u221299 and flagged by covloggdpCF. |\n| covloggdpCF | Missingness flag / indicator for covloggdpC. |\n| covloggdp | Logged GDP measured in year t\u22122; missing values are represented by \u221299 and flagged by covloggdpF. |\n| covloggdpF | Missingness flag / indicator for covloggdp. |\n| _Iyear_1963 \u2026 _Iyear_2011 | Binary year-indicator columns retained from the wider source panel. Each denotes the corresponding calendar year; columns for years outside this extract are zero. |\n| _Iccode_40 \u2026 _Iccode_990 | Binary country-indicator columns retained from the wider source panel; each denotes the corresponding ccode. |\n| new_empinxavg | Arithmetic average of the CIRI Human Empowerment index in years t, t+1, t+2, and t+3; the index ranges from 0 to 14. |\n| polity2avg | Arithmetic average of the Polity IV combined score over years t, t+1, t+2, and t+3. |\n\nData Description: Each observation is an aid-recipient country in reference year t. The released extract contains 1,792 observations for 115 countries, with reference years 1987\u20132006. It combines EU/European Community aid records, historical colonial links, Council-presidency calendars, the CIRI Human Empowerment index, Polity IV regime scores, and socioeconomic measures from World Development Indicators, religiosity and education-attainment series, and regional democracy counts.\n\nThe Council presidency rotates among member governments for six-month terms under a prearranged schedule. During July\u2013December, the presidency participates in setting the following year's aid budget. Historical colonial links connect recipient countries to particular European governments. The European Commission subsequently administers disbursement of the allocated aid; an aid allocation is distinct from the amount actually disbursed. l2CPcol2 refers to the second-half presidency in t\u22122, EV to aid in t\u22121, and new_empinxavg to outcomes over t through t+3.\n\nSubstantive variables prefixed cov are measured two years before the reference year. Missing values were replaced with the placeholder \u221299; associated variables ending in F equal 1 for those missing values and 0 otherwise. The \u221299 entries are not measured socioeconomic values. The file also retains binary year and country indicators and the four-year outcome averages.\n","file_sha256":"12fb375d5f7bc7882d97ba1cfcbbdb3f0d005e988762d4b8c98a6a8d00133974","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"12fb375d5f7bc7882d97ba1cfcbbdb3f0d005e988762d4b8c98a6a8d00133974","transforms":[],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0033/data/data.csv"},"ref_iv":{"columns":null,"description":"Complete rows of the script's columns, with year and country dummies","file_sha256":"12fb375d5f7bc7882d97ba1cfcbbdb3f0d005e988762d4b8c98a6a8d00133974","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"redistributed by CausalReasoningBenchmark (MIT) under the original replication data's terms","member":null,"object":null,"params":{},"path":null,"read_kw":{"low_memory":false},"records":null,"role":"reference","sha256":"12fb375d5f7bc7882d97ba1cfcbbdb3f0d005e988762d4b8c98a6a8d00133974","transforms":[{"args":{"columns":["new_empinxavg","EV","l2CPcol2","year","ccode","covloggdp","covloggdpCF","covloggdpC","covdemregionF","covdemregion","coviNY_GDP_PETR_RT_ZSF","coviNY_GDP_PETR_RT_ZS","covwvs_relF","covwvs_rel","covwdi_imp","covwdi_fdiF","covwdi_fdi","covwdi_expF","covwdi_exp","covihme_ayemF","covihme_ayem"]},"op":"select"},{"args":{"columns":["new_empinxavg","EV","l2CPcol2","year","ccode","covloggdp","covloggdpCF","covloggdpC","covdemregionF","covdemregion","coviNY_GDP_PETR_RT_ZSF","coviNY_GDP_PETR_RT_ZS","covwvs_relF","covwvs_rel","covwdi_imp","covwdi_fdiF","covwdi_fdi","covwdi_expF","covwdi_exp","covihme_ayemF","covihme_ayem"]},"op":"dropna"},{"args":{"column":"year","drop_first":true,"prefix":"year"},"op":"dummies"},{"args":{"column":"ccode","drop_first":true,"prefix":"ccode"},"op":"dummies"}],"url":"https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/data/ds_0033/data/data.csv"}},"difficulty":"M","id":"crb_papers.q063","level":"T2","meta":{"agent_reach":{"blocked_by":["reference_frame:ref_iv","needs_op:two_way_cluster"],"dtypes":{"ds_0033":{"EV":"float64","new_empinxavg":"float64"}},"named":{"outcome":["new_empinxavg"],"treatment":["EV"]},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"ds_0033","crb":{"data_path":"data/ds_0033/data/data.csv","dataset_id":"ds_0033","gold":{"ci95":[-0.013648284776121233,3.4245468339091016],"ci_rule":"effect \u00b1 1.96\u00b7|standard_error| (evaluate_result.ci_bounds)","effect":1.7054492745664902,"standard_error":0.8770905915013324},"identification":{"causal_quantity":"LATE","controls":["covloggdp","covloggdpCF","covloggdpC","covdemregionF","covdemregion","coviNY_GDP_PETR_RT_ZSF","coviNY_GDP_PETR_RT_ZS","covwvs_relF","covwvs_rel","covwdi_imp","covwdi_fdiF","covwdi_fdi","covwdi_expF","covwdi_exp","covihme_ayemF","covihme_ayem","year","ccode"],"instrument":["l2CPcol2"],"is_encouragement_design":false,"minimal_controlling_set":["year","ccode"],"outcomes":["new_empinxavg"],"reason_for_minimal_controlling_set":"\u201cWe statistically correct for membership expansion by using year fixed effects.\u201d The estimating equations include country and year fixed effects (see Eq. (1) with I(i = k) and I(t = j); Identification and Theoretical Implications, pp. 676\u2013677).","strategy":"Instrumental Variable","treatments":["EV"],"variant":"fuzzy natural experiment"},"identification_strategy":"Instrumental Variable"},"headline_keys":{"infer.iv_2sls":["coef.EV"]},"naive":{"dataset":"ds_0033","treatment":"EV","y":"new_empinxavg"},"native_id":"63","reference":{"cite":1,"note":"Reference path transcribed from the item's own estimation script.","steps":[{"args":{"cluster":"ccode","dataset":"ref_iv","endog":["EV"],"exog":["covloggdp","covloggdpCF","covloggdpC","covdemregion","coviNY_GDP_PETR_RT_ZSF","coviNY_GDP_PETR_RT_ZS","covwvs_relF","covwvs_rel","covwdi_imp","covwdi_fdiF","covwdi_fdi","covwdi_expF","covwdi_exp","covihme_ayemF","covihme_ayem","year_1988.0","year_1989.0","year_1990.0","year_1991.0","year_1992.0","year_1993.0","year_1994.0","year_1995.0","year_1996.0","year_1997.0","year_1998.0","year_1999.0","year_2000.0","year_2001.0","year_2002.0","year_2003.0","year_2004.0","year_2005.0","year_2006.0","ccode_40.0","ccode_41.0","ccode_42.0","ccode_51.0","ccode_52.0","ccode_53.0","ccode_54.0","ccode_55.0","ccode_56.0","ccode_57.0","ccode_58.0","ccode_60.0","ccode_70.0","ccode_80.0","ccode_90.0","ccode_91.0","ccode_92.0","ccode_93.0","ccode_94.0","ccode_95.0","ccode_100.0","ccode_101.0","ccode_110.0","ccode_115.0","ccode_130.0","ccode_135.0","ccode_140.0","ccode_145.0","ccode_150.0","ccode_155.0","ccode_160.0","ccode_165.0","ccode_352.0","ccode_402.0","ccode_403.0","ccode_404.0","ccode_411.0","ccode_420.0","ccode_432.0","ccode_433.0","ccode_434.0","ccode_435.0","ccode_436.0","ccode_437.0","ccode_438.0","ccode_439.0","ccode_451.0","ccode_452.0","ccode_461.0","ccode_471.0","ccode_475.0","ccode_481.0","ccode_482.0","ccode_483.0","ccode_484.0","ccode_490.0","ccode_500.0","ccode_501.0","ccode_510.0","ccode_516.0","ccode_517.0","ccode_520.0","ccode_522.0","ccode_531.0","ccode_540.0","ccode_541.0","ccode_551.0","ccode_552.0","ccode_553.0","ccode_560.0","ccode_565.0","ccode_570.0","ccode_571.0","ccode_572.0","ccode_580.0","ccode_581.0","ccode_590.0","ccode_591.0","ccode_600.0","ccode_615.0","ccode_616.0","ccode_620.0","ccode_625.0","ccode_645.0","ccode_651.0","ccode_652.0","ccode_660.0","ccode_663.0","ccode_678.0","ccode_692.0","ccode_694.0","ccode_696.0","ccode_698.0","ccode_750.0","ccode_760.0","ccode_770.0","ccode_771.0","ccode_775.0","ccode_780.0","ccode_781.0","ccode_811.0","ccode_812.0","ccode_816.0","ccode_820.0","ccode_830.0","ccode_835.0","ccode_850.0","ccode_935.0","ccode_940.0","ccode_946.0","ccode_947.0","ccode_950.0","ccode_955.0","ccode_990.0"],"instruments":["l2CPcol2"],"y":"new_empinxavg"},"tool":"infer.iv_2sls","why":"IV2SLS(new_empinxavg, 1 + controls - covdemregionF + C(year) + C(ccode), EV, l2CPcol2); one of the two cluster dimensions"}]},"reference_path":{"calls":[{"args":{"cluster":"ccode","dataset":"ref_iv","endog":["EV"],"exog":["covloggdp","covloggdpCF","covloggdpC","covdemregion","coviNY_GDP_PETR_RT_ZSF","coviNY_GDP_PETR_RT_ZS","covwvs_relF","covwvs_rel","covwdi_imp","covwdi_fdiF","covwdi_fdi","covwdi_expF","covwdi_exp","covihme_ayemF","covihme_ayem","year_1988.0","year_1989.0","year_1990.0","year_1991.0","year_1992.0","year_1993.0","year_1994.0","year_1995.0","year_1996.0","year_1997.0","year_1998.0","year_1999.0","year_2000.0","year_2001.0","year_2002.0","year_2003.0","year_2004.0","year_2005.0","year_2006.0","ccode_40.0","ccode_41.0","ccode_42.0","ccode_51.0","ccode_52.0","ccode_53.0","ccode_54.0","ccode_55.0","ccode_56.0","ccode_57.0","ccode_58.0","ccode_60.0","ccode_70.0","ccode_80.0","ccode_90.0","ccode_91.0","ccode_92.0","ccode_93.0","ccode_94.0","ccode_95.0","ccode_100.0","ccode_101.0","ccode_110.0","ccode_115.0","ccode_130.0","ccode_135.0","ccode_140.0","ccode_145.0","ccode_150.0","ccode_155.0","ccode_160.0","ccode_165.0","ccode_352.0","ccode_402.0","ccode_403.0","ccode_404.0","ccode_411.0","ccode_420.0","ccode_432.0","ccode_433.0","ccode_434.0","ccode_435.0","ccode_436.0","ccode_437.0","ccode_438.0","ccode_439.0","ccode_451.0","ccode_452.0","ccode_461.0","ccode_471.0","ccode_475.0","ccode_481.0","ccode_482.0","ccode_483.0","ccode_484.0","ccode_490.0","ccode_500.0","ccode_501.0","ccode_510.0","ccode_516.0","ccode_517.0","ccode_520.0","ccode_522.0","ccode_531.0","ccode_540.0","ccode_541.0","ccode_551.0","ccode_552.0","ccode_553.0","ccode_560.0","ccode_565.0","ccode_570.0","ccode_571.0","ccode_572.0","ccode_580.0","ccode_581.0","ccode_590.0","ccode_591.0","ccode_600.0","ccode_615.0","ccode_616.0","ccode_620.0","ccode_625.0","ccode_645.0","ccode_651.0","ccode_652.0","ccode_660.0","ccode_663.0","ccode_678.0","ccode_692.0","ccode_694.0","ccode_696.0","ccode_698.0","ccode_750.0","ccode_760.0","ccode_770.0","ccode_771.0","ccode_775.0","ccode_780.0","ccode_781.0","ccode_811.0","ccode_812.0","ccode_816.0","ccode_820.0","ccode_830.0","ccode_835.0","ccode_850.0","ccode_935.0","ccode_940.0","ccode_946.0","ccode_947.0","ccode_950.0","ccode_955.0","ccode_990.0"],"instruments":["l2CPcol2"],"y":"new_empinxavg"},"tool":"infer.iv_2sls"}],"needs":["needs_op:two_way_cluster"],"provenance":"benchmark_script","quotes":{},"reference_datasets":["ref_iv"],"source_id":"crb_papers.q063.script"}},"question":"What is the causal effect of a one log-unit increase in logged EU ODA (EV) in year t-1 on the CIRI Human Empowerment index averaged over years t through t+3 in the study population?","requires":[],"runner":null,"sources":["crb_papers.q063.gold","crb_papers.q063.script"],"split":"public","suite":"crb_papers","tags":["econ-bench","external","crb","iv","ref_benchmark_script"],"target":"agent","tool":null,"truth":"CausalReasoningBenchmark gold at the pinned revision: causal_queries.json effect and standard_error (the value the item's estimation.py prints), scored as evaluate_result.py scores estimate_within_solution_ci"}