{"args":{},"checks":[{"abs_tol":null,"bind":"any","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_backed","min_lre":null,"note":"every number in the answer was stated by a tool call","open_interval":false,"rel_tol":null,"required":true,"source_id":null,"table":null,"tool":null,"value":null,"weight":1.0,"where":null},{"abs_tol":null,"bind":"answer_call","column":null,"failure_class":null,"field":"value","interval":false,"key":null,"kind":"answer_figure_close","min_lre":null,"note":"CauSciBench effect accuracy: |answer figure \u2212 gold| \u2264 5% of |gold|","open_interval":false,"rel_tol":0.05,"required":true,"source_id":"causcibench_real.gold.q156","table":null,"tool":null,"value":0.038,"weight":1.0,"where":null}],"datasets":{"foos_all_in":{"columns":null,"description":"This study examines political engagement and voting behavior among residents of Birmingham, UK during the West Midlands Police and Crime Commissioner election held on November 15, 2012. The dataset captures information from multiple electoral wards within the city and includes detailed demographic, contact, and electoral participation records for individuals and their household members. The dataset represents a comprehensive electoral database maintained by the local Labour Party organization, containing canvassing information collected through door-to-door and telephone contact efforts with registered voters. This information includes self-reported party preferences and validated turnout records from public electoral registers. The data covers approximately 38% of registered voters in the targeted constituencies and provides a detailed view of political engagement patterns across different demographic groups and geographic areas within Birmingham during this specific electoral period.\n\nVariable Descriptions:\nperson_id: Unique identifier for each individual in the dataset\nhh_id: Household identifier linking individuals who reside at the same address\nward: Electoral ward designation within Birmingham where the individual is registered to vote\ntitle: Personal title or form of address (e.g., Mr., Mrs., Ms.)\nage: Individual's age at the time of data collection\nlandlinemobileboth: Type of telephone service available for the individual (landline, mobile, or both)\ncurrentabsentvoter: Registration status indicating whether the individual is registered for postal/absentee voting\nlatestvoterid: Most recent voter identification number on record\nlocal2012: Participation record in local elections held in 2012\nlocal2011: Participation record in local elections held in 2011\nGeneral2010: Participation record in the 2010 General Election\nelect5: Participation record in a previous election (fifth historical record)\nelect6: Participation record in a previous election (sixth historical record)\nelect7: Participation record in a previous election (seventh historical record)\nelect8: Participation record in a previous election (eighth historical record)\nrandom: Randomization assignment indicator used for research design purposes\ntreatment: Experimental group assignment for individuals in the study\ncontact: Indicator of whether contact was successfully made with the individual\nvote_PCC2012: Voting participation in the November 2012 Police and Crime Commissioner election","file_sha256":"67e792b6f8707c142cdb7821eb133a831d25071f89a6963e837b78699aba4f5e","format":"csv","frame_sha256":null,"generator":null,"kind":"file","licence":"CC0 1.0 (CauSciBench data/README.md); original source https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/ZFLG25","member":null,"object":null,"params":{},"path":null,"read_kw":{},"records":null,"role":"agent","sha256":"67e792b6f8707c142cdb7821eb133a831d25071f89a6963e837b78699aba4f5e","transforms":[],"url":"https://huggingface.co/datasets/causal-nlp/causcibench/resolve/d8aca99042e0bf1d73120a9dc1b65d4079fa1c3a/csv_files/realdata/foos_all_in.csv"}},"difficulty":"M","id":"causcibench_real.q156","level":"T2","meta":{"agent_reach":{"blocked_by":["no_reference_path","needs_spec:outcome","missing_column:foos_all_in.treated"],"dtypes":{"foos_all_in":{"treated":null,"turnout":null}},"named":{"outcome":["turnout"],"treatment":["treated"]},"reachable":false,"rule":"magi_bench.reach/1"},"answer_format":{"figure_transform":"identity","round_to":null,"unit_scale":1.0},"cluster":"paper:All in the family: Partisan disagreement and electoral mobilization in intimate networks","gold":{"effect":0.038,"effect_as_stored":"0.038","is_significant":1,"source_id":"causcibench_real.gold.q156","std_error":0.015,"std_error_as_stored":"0.015"},"metadata":{"control_variables":null,"dataset_path":"data/csv_files/realdata/foos_all_in.csv","effect":0.038,"id":156,"instrument_var":null,"interaction_var":null,"is_rct":true,"is_significant":1,"method":"ols","name":"All in the family: Partisan disagreement and electoral mobilization in intimate networks","outcome_var":"turnout","running_var":null,"state_var":null,"std_error":0.015,"temporal_var":null,"treatment_var":"treated"},"naive":null,"name":"All in the family: Partisan disagreement and electoral mobilization in intimate networks","native_id":156,"outcome":"turnout","pin":{"data_repo":"causal-nlp/causcibench","data_revision":"d8aca99042e0bf1d73120a9dc1b65d4079fa1c3a","repo":"causalNLP/CauSciBench","revision":"d9bb43a2d90f261978cc5ac0b628c0484f6e8956"},"precision_limited":false,"reference_notes":["the outcome 'turnout' is not a column of the CSV"],"reference_path":{"calls":[],"needs":["needs_spec:outcome"],"provenance":"none","quotes":{"outcome":"outcome_var: turnout"},"reference_datasets":[],"source_id":null},"reference_rule":"causcibench_metadata_rule/1","source":"causcibench","treatment":"treated"},"question":"Among unassigned household members, what is the effect of assigning a high\u2011partisan message to the other household member on turnout?","requires":[],"runner":null,"sources":["causcibench_real.gold.q156"],"split":"public","suite":"causcibench_real","tags":["econ-bench","external","causcibench","method:ols"],"target":"agent","tool":null,"truth":"CauSciBench real_input.json @ d9bb43a, id 156: effect 0.038"}