{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":"unbacked_number","field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"no_estimate_cited","field":"value","interval":false,"key":null,"kind":"answer_figure","min_lre":null,"note":"an answer figure: the effect of an estimator call the answer cites","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_tool","field":"value","interval":false,"key":null,"kind":"tool_called","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"y","kind":"arg_equals","min_lre":null,"note":"outcome: the Democratic vote share in the next election for the seat","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":"vote","weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"running","kind":"arg_equals","min_lre":null,"note":"running variable: the Democratic margin of victory","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":"margin","weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"cutoff","kind":"arg_equals","min_lre":null,"note":"a margin of zero","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":0,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"bandwidth","kind":"arg_equals","min_lre":null,"note":"the bandwidth the example fixes","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":16.79369,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"kernel","kind":"arg_equals","min_lre":null,"note":"rdrobust's default kernel","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":"triangular","weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_args","field":"value","interval":false,"key":"polynomial","kind":"arg_equals","min_lre":null,"note":"local linear (p = 1)","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":1,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_sample","field":"value","interval":false,"key":"n_left","kind":"diagnostic","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":343,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":"wrong_sample","field":"value","interval":false,"key":"n_right","kind":"diagnostic","min_lre":null,"note":"","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":"infer.rdd","value":310,"weight":1.0,"where":null},{"abs_tol":1.4979017917145529e-06,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"software reference","open_interval":false,"rel_tol":1e-06,"required":true,"source_id":"ccft_2017.senate_h16794.software","table":null,"tool":null,"value":7.425304341122386,"weight":1.0,"where":null},{"abs_tol":1.4979017917145529e-06,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"software reference, SE: recorded, not required (the question does not state the convention)","open_interval":false,"rel_tol":1e-06,"required":false,"source_id":"ccft_2017.senate_h16794.software","table":null,"tool":null,"value":1.497901791714553,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"published cell: recorded, never required on T2/T3","open_interval":false,"rel_tol":null,"required":false,"source_id":"ccft_2017.senate_h16794.paper","table":null,"tool":null,"value":7.4253,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"se","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"published cell, SE: recorded, never required on T2/T3","open_interval":false,"rel_tol":null,"required":false,"source_id":"ccft_2017.senate_h16794.paper","table":null,"tool":null,"value":1.4954,"weight":1.0,"where":null}],"datasets":{"senate":{"columns":null,"description":"U.S. Senate elections, 1914-2010, the extract of the data of Cattaneo, Frandsen and Titiunik (2015) that ships with the rdrobust package as its illustration: one row per state and Senate election (1,390 rows). Columns: state, state code; year, year of the election; margin, the Democratic party's margin of victory in that election, in percentage points (negative when the Democratic candidate lost); vote, the Democratic party's vote share, in percent, in the next election for the same Senate seat (missing for some rows); class, the seat's Senate class (1, 2 or 3); termshouse and termssenate, terms the Democratic candidate had served in the House and in the Senate; population, the state's population.","file_sha256":"def1fc6b8ae5af273f2140aa449c81b3ecfe1d0f325aa80ceccb0d9638a2ad44","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"rdrobust package, GPL-2; fetched, not redistributed.","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"def1fc6b8ae5af273f2140aa449c81b3ecfe1d0f325aa80ceccb0d9638a2ad44","transforms":[],"url":"https://raw.githubusercontent.com/rdpackages/rdrobust/7df239395c4afce2a58e22ef16a5817341683955/R/rdrobust_senate.csv"}},"difficulty":"M","id":"paper_repro.ccft_2017.senate_h16794.agent","level":"T2","meta":{"acceptable_tools":["infer.rdd"],"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"ccft_2017","contamination":{"benchmark_first_public":"2017-06","gold_in_public_repo":true,"model_reported_cutoff":null,"url":"https://doi.org/10.1177/1536867X1701700208"},"expected_tool":"infer.rdd","family":"rd","headline_keys":{"infer.rdd":["effect"]},"kind":"agent","known_deviation":{"evidence":"Recorded before this track's software-reference run and before any dry run, from the printed output: rdrobust's conventional standard error uses its nearest-neighbour variance estimator ('VCE method = NN'), while infer.rdd computes HC1 and the reference follows the tool's declared HC1. The point estimate depends only on the kernel, the polynomial and the bandwidth, all fixed here; the printed cell is recorded and non-required on T1.","fields":["se"],"found_in_run":false,"kind":"se_convention"},"locator":"Section 7.2 (default results and backward compatibility), output of 'rdrobust vote margin, h(16.79369) b(27.43745)', row 'Conventional'","n_published":653,"paper":"ccft_2017","question_states":["bandwidth"],"reference":{"cite":1,"steps":[{"args":{"bandwidth":16.79369,"cutoff":0,"dataset":"senate","kernel":"triangular","polynomial":1,"running":"margin","y":"vote"},"tool":"infer.rdd","why":"rdrobust's Senate example at the bandwidth h = 16.79369 that Calonico, Cattaneo and Titiunik (2014) selected: local linear, triangular kernel, cutoff 0; the conventional point estimate (rdrobust's own errors are nearest-neighbour based; the tool's are HC1)."}]},"se_policy":{"basis":"The printed output states 'VCE method = NN'; infer.rdd offers HC1 or clustered errors only.","convention":"rdrobust's nearest-neighbour variance (VCE method NN, 3 matches) as printed; the tool and the reference compute HC1","never_required":false,"stated_in_question":false},"target":"senate_h16794","trap_tools":[]},"question":"Calonico, Cattaneo, Farrell and Titiunik (2017), 'rdrobust: Software for Regression-discontinuity Designs', the U.S. Senate example (data of Cattaneo, Frandsen and Titiunik 2015): estimate the incumbency advantage as a sharp regression discontinuity, the jump at a Democratic lead of zero in the Democratic party's share of the votes in the next election for the same seat, where the running variable is the Democratic lead over the strongest opponent in the current election, in percentage points. Use a local linear regression on each side of zero with kernel weights that fall linearly from one at zero to nothing at the bandwidth, and the bandwidth h = 16.79369 percentage points that Calonico, Cattaneo and Titiunik (2014) selected for this example (use it as given; do not recompute it). Report the conventional point estimate of the jump.","requires":[],"runner":null,"sources":["ccft_2017.senate_h16794.paper","ccft_2017.senate_h16794.software"],"split":"public","suite":"paper_repro","tags":["paper_repro","ccft_2017","rd"],"target":"agent","tool":null,"truth":"Calonico, S., Cattaneo, M. D., Farrell, M. H. and Titiunik, R. (2017). rdrobust: Software for Regression-discontinuity Designs. Stata Journal 17(2): 372-404. The U.S. Senate example (data of Cattaneo, Frandsen and Titiunik 2015, Journal of Causal Inference 3(1)), with the bandwidth of Calonico, Cattaneo and Titiunik (2014, Stata Journal 14(4): 909-946). Section 7.2 (default results and backward compatibility), output of 'rdrobust vote margin, h(16.79369) b(27.43745)', row 'Conventional' (source ccft_2017.senate_h16794.paper); software reference ccft_2017.senate_h16794.software: statsmodels 0.15.0: the reference specification of ccft_2017 senate_h16794 (infer.rdd, figure 'effect') on an independent code path"}