{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number of the answer is stated by a tool call","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":true,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"QRData eval.py: strictly inside gold \u00b1 3% (a '%' gold divided by 100), on the answer figure after meta.answer_format","open_interval":true,"rel_tol":null,"required":true,"source_id":"qrdata.gold.394","table":null,"tool":null,"value":[0.55387,0.5881299999999999],"weight":1.0,"where":null}],"datasets":{"pres08":{"columns":null,"description":"Regression towards the mean represents an empirical phenomenon where an observation with a value of the predictor further away from the distribution\u2019s mean tends to have a value of an outcome variable closer to that mean. This tendency can be explained by chance alone.\n\nWe will examine whether or not the US presidential election data exhibit the regression towards the mean phenomenon. To do this, we use Obama\u2019s vote share in the 2008 election to predict his vote share in his 2012 reelection.\n\nThe CSV data file pres08.csv contains the election results by state of the 2008 US presidential election.\nVariable Description\nstate: abbreviated name of the state\nstate.name: unabbreviated name of the state\nObama: Obama\u2019s vote share (percentage)\nMcCain: McCain\u2019s vote share (percentage)\nEV: number of Electoral College votes for the state\n\nIn addition, we have the CSV file pres12.csv, which contains the election results by state of the 2012 US presidential election.\nVariable Description\nstate: abbreviated name of the state\nObama: Obama\u2019s vote share (percentage)\nRomney: Romney\u2019s vote share (percentage)\nEV: number of Electoral College votes for the state","file_sha256":"3c3a97cca6fdd96f6856f7856b5f8bc786a31d1a9be78c9f610ef3070783e970","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"CC BY-NC 4.0","member":"data/pres08.csv","object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"3c3a97cca6fdd96f6856f7856b5f8bc786a31d1a9be78c9f610ef3070783e970","transforms":[],"url":"https://raw.githubusercontent.com/xxxiaol/QRData/de450af45ff7101b328bb064c6b475f73414a7ed/benchmark/data.zip"},"pres12":{"columns":null,"description":"Data file pres12.csv of this question; the question's data description is the description of dataset 'pres08'.","file_sha256":"3c3a97cca6fdd96f6856f7856b5f8bc786a31d1a9be78c9f610ef3070783e970","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"CC BY-NC 4.0","member":"data/pres12.csv","object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"3c3a97cca6fdd96f6856f7856b5f8bc786a31d1a9be78c9f610ef3070783e970","transforms":[],"url":"https://raw.githubusercontent.com/xxxiaol/QRData/de450af45ff7101b328bb064c6b475f73414a7ed/benchmark/data.zip"}},"difficulty":"M","id":"qrdata_socsci.394","level":"T2","meta":{"agent_reach":{"blocked_by":["no_reference_path","no_tool:quartile_proportion"],"dtypes":{},"named":{},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":3,"unit_scale":1.0},"answer_format_from":{"figure_transform":null,"round_to":"nearest thousandth","unit_scale":"1.0: an estimator's figure is on the gold's own scale"},"cluster":"pres08.csv","family":"numerical","headline_keys":{},"native":{"answer":"0.571","keywords":["Social science","Statistics","Quartile"],"multiple_choices":null,"question_type":"numerical","reference":"Quantitative Social Science 4.2.5"},"native_id":394,"reference":{"cite":1,"note":"Sem caminho de refer\u00eancia com as ferramentas registradas: no_tool:quartile_proportion. A resposta n\u00e3o cita estimativa de efeito.","steps":[{"args":{"dataset":"pres08"},"tool":"data.describe","why":"Sem caminho de refer\u00eancia com as ferramentas registradas: no_tool:quartile_proportion."}]},"reference_path":{"calls":[],"needs":["no_tool:quartile_proportion"],"provenance":"none","quotes":{},"reference_datasets":[],"source_id":null},"reference_why":null},"question":"We standardize vote shares across elections by computing their z-scores so that we can measure Obama\u2019s electoral performance in each state relative to his average performance of that year. That is, we subtract the mean from Obama\u2019s vote share in each election and then divide it by the standard deviation.\nWhat is the proportion of states where Obama received a greater share of standardized votes in 2012 than he did in 2008, in the bottom quartile of Obama\u2019s 2008 (standardized) vote share? Please round to the nearest thousandth.","requires":[],"runner":null,"sources":["qrdata.gold.394","qrdata.eval_py"],"split":"public","suite":"qrdata_socsci","tags":["econ-bench","external","qrdata","qss","numerical","no_reference_path"],"target":"agent","tool":null,"truth":"QRData gold: benchmark/QRData.json item 394 at de450af45ff7101b328bb064c6b475f73414a7ed"}