{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":"unbacked_number","field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"no_estimate_cited","field":"value","interval":false,"key":null,"kind":"answer_figure","min_lre":null,"note":"an answer figure: the effect of an estimator call the answer cites","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_tool","field":"value","interval":false,"key":null,"kind":"tool_called","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.ols","value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"y","kind":"arg_equals","min_lre":null,"note":"outcome: age-adjusted female suicide rate","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.ols","value":"asmrs","weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"x","kind":"arg_equals","min_lre":null,"note":"the unilateral-divorce indicator","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.ols","value":["post"],"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"weights","kind":"arg_equals","min_lre":null,"note":"the specification does not weight by population","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.ols","value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_sample","field":"value","interval":false,"key":"n_obs","kind":"diagnostic","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.ols","value":1617,"weight":1.0,"where":null},{"abs_tol":1.267704945311894e-06,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"software reference","open_interval":false,"rel_tol":1e-06,"required":true,"source_id":"goodman_bacon_2021.fig5_dd.software","table":null,"tool":null,"value":-3.0799257655399144,"weight":1.0,"where":null},{"abs_tol":1.267704945311894e-06,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"software reference, SE (the question states the convention)","open_interval":false,"rel_tol":1e-06,"required":true,"source_id":"goodman_bacon_2021.fig5_dd.software","table":null,"tool":null,"value":1.267704945311894,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"published cell: recorded, never required on T2/T3","open_interval":false,"rel_tol":null,"required":false,"source_id":"goodman_bacon_2021.fig5_dd.paper","table":null,"tool":null,"value":-3.08,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"published cell, SE: recorded, never required on T2/T3","open_interval":false,"rel_tol":null,"required":false,"source_id":"goodman_bacon_2021.fig5_dd.paper","table":null,"tool":null,"value":1.27,"weight":1.0,"where":null}],"datasets":{"bacon_example":{"columns":null,"description":"The state-year panel Goodman-Bacon (2021), 'Difference-in-Differences with Variation in Treatment Timing', uses to replicate Stevenson and Wolfers (2006) on unilateral (no-fault) divorce and female suicide: one row per U.S. state and year, 1964-1996 (1,617 rows: 49 states, 33 years). Columns: stfips, the state's FIPS code; year; _nfd, the year the state adopted unilateral (no-fault) divorce, for the 36 states that adopted it between 1969 and 1985 (missing for the states that adopted it before 1964 and for those that never adopted it in the window); post, the unilateral-divorce indicator: 1 in the years in which the state had unilateral divorce (from _nfd on, and in every year for the states that adopted it before 1964) and 0 otherwise; asmrs, the age-adjusted suicide mortality of women (suicides per million women); pcinc, personal income per capita (BEA); asmrh, the age-adjusted homicide mortality of women; cases, AFDC (welfare) cases; weight, a population weight; copop, the state's population.","file_sha256":"5a555448e605f75603160be20f56ca343600ec81863f3060994bac1285c29094","format":"dta","frame_sha256":null,"generator":null,"kind":"file","licence":"No licence stated (author's site); fetched, not redistributed.","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"5a555448e605f75603160be20f56ca343600ec81863f3060994bac1285c29094","transforms":[],"url":"http://pped.org/bacon_example.dta"}},"difficulty":"M","id":"paper_repro.goodman_bacon_2021.fig5_dd.agent","level":"T2","meta":{"acceptable_tools":["infer.ols"],"alternatives":[{"args":{"dataset":"bacon_example","time":"year","treat":"post","unit":"stfips","y":"asmrs"},"note":"T3 only: the two-way fixed effects estimator with state and year effects, the same design as least squares with state and year dummies; its errors are clustered by state, so it cannot pass the T2 HC1 SE check","tool":"infer.twfe"}],"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"goodman_bacon_2021","contamination":{"benchmark_first_public":"2018-09","gold_in_public_repo":true,"model_reported_cutoff":null,"url":"https://doi.org/10.3386/w25018"},"expected_tool":"infer.ols","family":"did","headline_keys":{"infer.ols":["coef.post"]},"kind":"agent","known_deviation":null,"locator":"NBER Working Paper 25018, Figure 5 (event-study and difference-in-differences estimates of the effect of no-fault divorce on female suicide), the printed 'DD Coefficient'","n_published":null,"paper":"goodman_bacon_2021","question_states":[],"reference":{"cite":1,"steps":[{"args":{"controls":[],"dataset":"bacon_example","fe":["stfips","year"],"se":"HC1","weights":null,"x":["post"],"y":"asmrs"},"tool":"infer.ols","why":"Figure 5: two-way fixed effects DD of the female suicide rate on the unilateral-divorce indicator with state and year fixed effects, unweighted, no controls, heteroskedasticity-robust errors."}]},"se_policy":{"basis":"Figure 5 notes: 'Standard errors are robust to heteroskedasticity.' The working paper's text gives 1.13 for the same coefficient; the figure states its convention and is the cell used.","convention":"heteroskedasticity-robust HC1 (Stata robust), state and year effects as dummies","never_required":false,"stated_in_question":true},"target":"fig5_dd","trap_tools":[]},"question":"Goodman-Bacon (2018, NBER Working Paper 25018; published in the Journal of Econometrics, 2021), 'Difference-in-Differences with Variation in Treatment Timing', Figure 5 (a replication of Stevenson and Wolfers 2006): estimate the two-way fixed effects difference-in-differences coefficient of unilateral (no-fault) divorce on the age-adjusted female suicide rate (suicides per million women), by ordinary least squares with state fixed effects and year fixed effects, the unilateral-divorce indicator as the only regressor, no population weights and no other controls, and heteroskedasticity-robust standard errors with the usual small-sample correction (HC1, Stata's robust). Report the difference-in-differences coefficient.","requires":[],"runner":null,"sources":["goodman_bacon_2021.fig5_dd.paper","goodman_bacon_2021.fig5_dd.software"],"split":"public","suite":"paper_repro","tags":["paper_repro","goodman_bacon_2021","did"],"target":"agent","tool":null,"truth":"Goodman-Bacon, A. (2021). Difference-in-Differences with Variation in Treatment Timing. Journal of Econometrics 225(2): 254-277. Cell read from the NBER Working Paper 25018 (revised September 2018). NBER Working Paper 25018, Figure 5 (event-study and difference-in-differences estimates of the effect of no-fault divorce on female suicide), the printed 'DD Coefficient' (source goodman_bacon_2021.fig5_dd.paper); software reference goodman_bacon_2021.fig5_dd.software: statsmodels 0.15.0: the reference specification of goodman_bacon_2021 fig5_dd (infer.ols, figure 'coef.post') on an independent code path"}