{"attempt":1,"datasets":{"ds_0044":{"description_shown":"| Variable Name  | Description                                                                                 |\n|----------------|---------------------------------------------------------------------------------------------|\n| Unnamed/Index  | Row identifier / index column carried over from the source CSV (sequence number).          |\n| city           | Municipality name and state (lowercase string, e.g., \"akron, oh\").                         |\n| YEAR           | Census year (decennial year) for the observation (numeric).                                |\n| occ            | Occupation class for municipal employment (e.g., \"blue_collar\", \"white_collar\", \"police\").  |\n| name           | Demographic group label combining race and nativity (e.g., \"white_x_native_born\").         |\n| govt           | Proportion (share) of municipal government jobs in this city\u2013year\u2013occupation held by group. |\n| pop            | Proportion (share) of the municipality's total population comprised by the named group.     |\n| treat_assign   | Binary indicator whether a statewide legislative mandate applied to the municipality that decade (0/1). |\n| treat_actual   | Binary indicator whether the municipality had the municipal civil service commission in effect that decade (0/1). |\n| bandwidth      | Numeric distance in residents between the municipality's population and the state cutoff used in assignment rules. |\n\nData Description: This dataset is a municipality-by-decade panel that links full-count U.S. decennial census records (1850\u20131940) on municipal employment and population composition with administrative indicators derived from state statutes and municipal surveys. Each observation identifies a city and census year, an occupation class, and a demographic group, and reports group shares in the municipal population and in the local government workforce; the file also includes binary flags recording whether a state-level mandate applied and whether a municipal civil service commission was in place, plus a numeric distance-from-cutoff measure used for threshold-based comparisons. The underlying sources include full-count census enumerations (industry/occupation and birthplace fields), historical surveys of municipal civil service adoption, and compiled state session-law information assembled to create a harmonized longitudinal dataset on municipal staff composition.","file_sha256":"d5035ee26421d944dd396fa22c1f412e72a32f59388ef130ad486a3c851a813b","frame_sha256":null,"role":"agent","transforms":[]},"ref_iv":{"description_shown":"","file_sha256":"d5035ee26421d944dd396fa22c1f412e72a32f59388ef130ad486a3c851a813b","frame_sha256":null,"role":"reference","transforms":[{"args":{"query":"occ == 'blue_collar' and name == 'white_x_native_born'"},"op":"filter"},{"args":{"columns":["govt","treat_actual","treat_assign","pop","YEAR","city"]},"op":"select"},{"args":{"columns":["govt","treat_actual","treat_assign","pop","YEAR","city"]},"op":"dropna"},{"args":{"column":"YEAR","drop_first":true,"prefix":"YEAR"},"op":"dummies"},{"args":{"column":"city","drop_first":true,"prefix":"city"},"op":"dummies"}]}},"epoch":1,"event":"sample_init","question":"What is the causal effect of municipal civil service reform adoption on the share of blue-collar municipal government jobs held by native-born white workers, estimated for municipalities whose adoption was externally induced (local compliers)?","question_sha256":"00aff9a6acb5300043926f15ca4a01f3e1c8f4d25b4d46aa52b547a8f91e834f","run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":0,"skills":[],"task_id":"crb_papers.q074","task_sha256":"c34219b8aa9595071fae1232f2af4919c9aaf06dc623116c1e56d21fd5ce22fc","timestamp":"2026-10-15T17:00:54.977407Z"}
{"attempt":1,"call_id":"call_afbf171a","dataset_id":"ref_iv","epoch":1,"event":"transform","frame_sha256_after":"9c9371e96a414fcda913875d8714e056f0a1d7041a2f3f52d434fc5b91b4e9ee","frame_sha256_before":"70ec9feb2c796cfd98963f1948c8a52286056dadf4df3fc19d3c7179994c358f","index":0,"rows_after":1686,"rows_before":40452,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":1,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:54.977407Z","transform":{"args":{"query":"occ == 'blue_collar' and name == 'white_x_native_born'"},"op":"filter"}}
{"attempt":1,"call_id":"call_4585a77d","dataset_id":"ref_iv","epoch":1,"event":"transform","frame_sha256_after":"1166c0af001f00307c4422c0a6614e371e9185fb6f91720a6c4d52448fc7bdf2","frame_sha256_before":"9c9371e96a414fcda913875d8714e056f0a1d7041a2f3f52d434fc5b91b4e9ee","index":1,"rows_after":1686,"rows_before":1686,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":2,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:54.986108Z","transform":{"args":{"columns":["govt","treat_actual","treat_assign","pop","YEAR","city"]},"op":"select"}}
{"attempt":1,"call_id":"call_8abb8023","dataset_id":"ref_iv","epoch":1,"event":"transform","frame_sha256_after":"1166c0af001f00307c4422c0a6614e371e9185fb6f91720a6c4d52448fc7bdf2","frame_sha256_before":"1166c0af001f00307c4422c0a6614e371e9185fb6f91720a6c4d52448fc7bdf2","index":2,"rows_after":1686,"rows_before":1686,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":3,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:54.987821Z","transform":{"args":{"columns":["govt","treat_actual","treat_assign","pop","YEAR","city"]},"op":"dropna"}}
{"attempt":1,"call_id":"call_fd91998e","dataset_id":"ref_iv","epoch":1,"event":"transform","frame_sha256_after":"aaa7279efd2f289dbecdec17a0ce57df68e8ac7b2fd9b9e1861177675827574b","frame_sha256_before":"1166c0af001f00307c4422c0a6614e371e9185fb6f91720a6c4d52448fc7bdf2","index":3,"rows_after":1686,"rows_before":1686,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":4,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:54.989211Z","transform":{"args":{"column":"YEAR","drop_first":true,"prefix":"YEAR"},"op":"dummies"}}
{"attempt":1,"call_id":"call_3d118f2a","dataset_id":"ref_iv","epoch":1,"event":"transform","frame_sha256_after":"7d61c3ca2820695850a004a3f562adc84c8c7616c63bd9cf034254497c8c4fda","frame_sha256_before":"aaa7279efd2f289dbecdec17a0ce57df68e8ac7b2fd9b9e1861177675827574b","index":4,"rows_after":1686,"rows_before":1686,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":5,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:54.990734Z","transform":{"args":{"column":"city","drop_first":true,"prefix":"city"},"op":"dummies"}}
{"attempt":1,"attempts":[],"call_id":"call_7cab9deb","epoch":1,"event":"model","finish_reason":"tool_use","latency_ms":0.0,"model_reported":"reference","model_requested":"reference","provider":"scripted","request":{"config":{},"contents_refs":[],"messages_refs":["3cd6d0361e36ea0ca3ad9caef752058bb923038e1baab70b1b2b0e4a21e23709"],"system_stable_ref":"433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420","system_task_ref":"b2d8bd4b0d3515c1fd43a0f2b1d0c30cdee6df462a9d8fe09c9ed979b694cb67","tools_ref":"52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b"},"response":{"text":"IV2SLS.from_formula('govt ~ 1 + pop + C(YEAR) + C(city) + [treat_actual ~ treat_assign]').fit(cov_type='robust')","thoughts":null,"tool_calls":[{"args":{"dataset":"ref_iv","endog":["treat_actual"],"exog":["pop","YEAR_1860.0","YEAR_1870.0","YEAR_1880.0","YEAR_1900.0","YEAR_1910.0","YEAR_1920.0","YEAR_1930.0","YEAR_1940.0","city_albany, ny","city_alexandria, la","city_allentown, pa","city_alliance, oh","city_altoona, pa","city_ames, ia","city_amsterdam, ny","city_anniston, al","city_appleton, wi","city_arnold, pa","city_ashland, oh","city_ashland, wi","city_ashtabula, oh","city_atlantic city, nj","city_attleboro, ma","city_auburn, ny","city_augusta, ga","city_barberton, oh","city_batavia, ny","city_baton rouge, la","city_beacon, ny","city_beaver falls, pa","city_bellaire, oh","city_beloit, wi","city_benton harbor, mi","city_bethlehem, pa","city_beverly, ma","city_binghamton, ny","city_boise, id","city_boone, ia","city_boston, ma","city_bradford, pa","city_brainerd, mn","city_brockton, ma","city_bucyrus, oh","city_buffalo, ny","city_burlington, ia","city_butler, pa","city_cambridge, ma","city_cambridge, oh","city_camden, nj","city_campbell, oh","city_canton, oh","city_carbondale, pa","city_casper, wy","city_cedar rapids, ia","city_chelsea, ma","city_chester, pa","city_cheyenne, wy","city_chicopee, ma","city_chillicothe, oh","city_cincinnati, oh","city_cleveland heights, oh","city_cleveland, oh","city_clifton, nj","city_clinton, ia","city_coatesville, pa","city_coffeyville, ks","city_cohoes, ny","city_columbia, sc","city_columbus, oh","city_connellsville, pa","city_corning, ny","city_corpus christi, tx","city_cortland, ny","city_coshocton, oh","city_council bluffs, ia","city_cudahy, wi","city_cuyahoga falls, oh","city_dallas, tx","city_davenport, ia","city_dayton, oh","city_dearborn, mi","city_denver, co","city_des moines, ia","city_dover, nj","city_du bois, pa","city_dubuque, ia","city_dunkirk, ny","city_duquesne, pa","city_east cleveland, oh","city_east liverpool, oh","city_east orange, nj","city_easton, pa","city_eau claire, wi","city_el paso, tx","city_elizabeth, nj","city_elmira, ny","city_elyria, oh","city_endicott, ny","city_erie, pa","city_euclid, oh","city_eugene, or","city_everett, ma","city_fall river, ma","city_farrell, pa","city_findlay, oh","city_fitchburg, ma","city_floral park, ny","city_fond du lac, wi","city_fort dodge, ia","city_fort madison, ia","city_fort smith, ar","city_fostoria, oh","city_franklin, pa","city_freeport, ny","city_fremont, oh","city_fulton, ny","city_gadsden, al","city_gardner, ma","city_garfield heights, oh","city_gary, in","city_geneva, ny","city_glen cove, ny","city_glens falls, ny","city_gloucester, ma","city_gloversville, ny","city_greeley, co","city_green bay, wi","city_greensburg, pa","city_greenville, sc","city_hamilton, oh","city_harrisburg, pa","city_hastings, ne","city_haverhill, ma","city_hazleton, pa","city_hempstead, ny","city_hibbing, mn","city_holyoke, ma","city_hornell, ny","city_houston, tx","city_hudson, ny","city_hutchinson, ks","city_ilion, ny","city_indianapolis, in","city_iowa city, ia","city_ironton, oh","city_irvington, nj","city_ithaca, ny","city_jackson, mi","city_janesville, wi","city_jeannette, pa","city_jersey city, nj","city_johnson city, ny","city_johnstown, ny","city_johnstown, pa","city_kansas city, ks","city_kearny, nj","city_kenmore, ny","city_kenosha, wi","city_keokuk, ia","city_kingston, ny","city_klamath falls, or","city_la crosse, wi","city_lackawanna, ny","city_lafayette, la","city_lake charles, la","city_lakewood, oh","city_lancaster, oh","city_lancaster, pa","city_lawrence, ma","city_lebanon, pa","city_leominster, ma","city_lima, oh","city_little falls, ny","city_little rock, ar","city_lockport, ny","city_lorain, oh","city_lowell, ma","city_lynbrook, ny","city_lynn, ma","city_madison, wi","city_malden, ma","city_mamaroneck, ny","city_manitowoc, wi","city_mankato, mn","city_mansfield, oh","city_marietta, oh","city_marinette, wi","city_marion, oh","city_marlborough, ma","city_marshalltown, ia","city_martins ferry, oh","city_mason city, ia","city_massillon, oh","city_mckeesport, pa","city_meadville, pa","city_medford, ma","city_melrose, ma","city_middletown, ny","city_middletown, oh","city_milwaukee, wi","city_monroe, la","city_morristown, nj","city_muscatine, ia","city_nanticoke, pa","city_new bedford, ma","city_new castle, pa","city_new philadelphia, oh","city_new rochelle, ny","city_new york, ny","city_newark, nj","city_newark, oh","city_newburgh, ny","city_newburyport, ma","city_newton, ia","city_newton, ma","city_niagara falls, ny","city_niles, oh","city_north adams, ma","city_north little rock, ar","city_north tonawanda, ny","city_northampton, ma","city_norwood, oh","city_nutley, nj","city_ogdensburg, ny","city_oil city, pa","city_olean, ny","city_omaha, ne","city_oneida, ny","city_oneonta, ny","city_orange, nj","city_orlando, fl","city_oshkosh, wi","city_oskaloosa, ia","city_ossining, ny","city_oswego, ny","city_ottumwa, ia","city_painesville, oh","city_parma, oh","city_parsons, ks","city_paterson, nj","city_peabody, ma","city_peekskill, ny","city_philadelphia, pa","city_pine bluff, ar","city_piqua, oh","city_pittsburgh, pa","city_pittsfield, ma","city_pittston, pa","city_plattsburg, ny","city_pocatello, id","city_port chester, ny","city_port huron, mi","city_port jervis, ny","city_portland, or","city_portsmouth, oh","city_pottsville, pa","city_poughkeepsie, ny","city_quincy, ma","city_racine, wi","city_rahway, nj","city_reading, pa","city_revere, ma","city_rochester, mn","city_rochester, ny","city_rome, ny","city_rutherford, nj","city_salem, ma","city_salem, oh","city_salem, or","city_salt lake city, ut","city_san antonio, tx","city_sandusky, oh","city_saratoga springs, ny","city_scranton, pa","city_shaker heights, oh","city_sharon, pa","city_sheboygan, wi","city_shorewood, wi","city_shreveport, la","city_sioux city, ia","city_somerville, ma","city_south milwaukee, wi","city_south orange, nj","city_spartanburg, sc","city_springfield, ma","city_springfield, oh","city_st. augustine, fl","city_st. cloud, mn","city_steubenville, oh","city_stevens point, wi","city_struthers, oh","city_sunbury, pa","city_superior, wi","city_syracuse, ny","city_taunton, ma","city_teaneck, nj","city_tiffin, oh","city_toledo, oh","city_tonawanda, ny","city_topeka, ks","city_trenton, nj","city_troy, ny","city_tuscaloosa, al","city_two rivers, wi","city_union, nj","city_uniontown, pa","city_utica, ny","city_waco, tx","city_waltham, ma","city_warren, oh","city_washington, pa","city_waterloo, ia","city_watertown, ny","city_watertown, wi","city_watervliet, ny","city_waukesha, wi","city_wausau, wi","city_wauwatosa, wi","city_west allis, wi","city_west orange, nj","city_westfield, ma","city_white plains, ny","city_williamsport, pa","city_woburn, ma","city_wooster, oh","city_worcester, ma","city_xenia, oh","city_yonkers, ny","city_york, pa","city_youngstown, oh","city_zanesville, oh"],"instruments":["treat_assign"],"se":"HC1","y":"govt"},"llm_name":"infer__iv_2sls","tool_id":"infer.iv_2sls","vendor_id":"script_1"}]},"response_id":null,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":6,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.048718Z","usage":{"cached":0,"input":0,"output":0,"thoughts":0},"vendor":false}
{"arguments":{"cluster":null,"dataset":"ref_iv","endog":["treat_actual"],"exog":["pop","YEAR_1860.0","YEAR_1870.0","YEAR_1880.0","YEAR_1900.0","YEAR_1910.0","YEAR_1920.0","YEAR_1930.0","YEAR_1940.0","city_albany, ny","city_alexandria, la","city_allentown, pa","city_alliance, oh","city_altoona, pa","city_ames, ia","city_amsterdam, ny","city_anniston, al","city_appleton, wi","city_arnold, pa","city_ashland, oh","city_ashland, wi","city_ashtabula, oh","city_atlantic city, nj","city_attleboro, ma","city_auburn, ny","city_augusta, ga","city_barberton, oh","city_batavia, ny","city_baton rouge, la","city_beacon, ny","city_beaver falls, pa","city_bellaire, oh","city_beloit, wi","city_benton harbor, mi","city_bethlehem, pa","city_beverly, ma","city_binghamton, ny","city_boise, id","city_boone, ia","city_boston, ma","city_bradford, pa","city_brainerd, mn","city_brockton, ma","city_bucyrus, oh","city_buffalo, ny","city_burlington, ia","city_butler, pa","city_cambridge, ma","city_cambridge, oh","city_camden, nj","city_campbell, oh","city_canton, oh","city_carbondale, pa","city_casper, wy","city_cedar rapids, ia","city_chelsea, ma","city_chester, pa","city_cheyenne, wy","city_chicopee, ma","city_chillicothe, oh","city_cincinnati, oh","city_cleveland heights, oh","city_cleveland, oh","city_clifton, nj","city_clinton, ia","city_coatesville, pa","city_coffeyville, ks","city_cohoes, ny","city_columbia, sc","city_columbus, oh","city_connellsville, pa","city_corning, ny","city_corpus christi, tx","city_cortland, ny","city_coshocton, oh","city_council bluffs, ia","city_cudahy, wi","city_cuyahoga falls, oh","city_dallas, tx","city_davenport, ia","city_dayton, oh","city_dearborn, mi","city_denver, co","city_des moines, ia","city_dover, nj","city_du bois, pa","city_dubuque, ia","city_dunkirk, ny","city_duquesne, pa","city_east cleveland, oh","city_east liverpool, oh","city_east orange, nj","city_easton, pa","city_eau claire, wi","city_el paso, tx","city_elizabeth, nj","city_elmira, ny","city_elyria, oh","city_endicott, ny","city_erie, pa","city_euclid, oh","city_eugene, or","city_everett, ma","city_fall river, ma","city_farrell, pa","city_findlay, oh","city_fitchburg, ma","city_floral park, ny","city_fond du lac, wi","city_fort dodge, ia","city_fort madison, ia","city_fort smith, ar","city_fostoria, oh","city_franklin, pa","city_freeport, ny","city_fremont, oh","city_fulton, ny","city_gadsden, al","city_gardner, ma","city_garfield heights, oh","city_gary, in","city_geneva, ny","city_glen cove, ny","city_glens falls, ny","city_gloucester, ma","city_gloversville, ny","city_greeley, co","city_green bay, wi","city_greensburg, pa","city_greenville, sc","city_hamilton, oh","city_harrisburg, pa","city_hastings, ne","city_haverhill, ma","city_hazleton, pa","city_hempstead, ny","city_hibbing, mn","city_holyoke, ma","city_hornell, ny","city_houston, tx","city_hudson, ny","city_hutchinson, ks","city_ilion, ny","city_indianapolis, in","city_iowa city, ia","city_ironton, oh","city_irvington, nj","city_ithaca, ny","city_jackson, mi","city_janesville, wi","city_jeannette, pa","city_jersey city, nj","city_johnson city, ny","city_johnstown, ny","city_johnstown, pa","city_kansas city, ks","city_kearny, nj","city_kenmore, ny","city_kenosha, wi","city_keokuk, ia","city_kingston, ny","city_klamath falls, or","city_la crosse, wi","city_lackawanna, ny","city_lafayette, la","city_lake charles, la","city_lakewood, oh","city_lancaster, oh","city_lancaster, pa","city_lawrence, ma","city_lebanon, pa","city_leominster, ma","city_lima, oh","city_little falls, ny","city_little rock, ar","city_lockport, ny","city_lorain, oh","city_lowell, ma","city_lynbrook, ny","city_lynn, ma","city_madison, wi","city_malden, ma","city_mamaroneck, ny","city_manitowoc, wi","city_mankato, mn","city_mansfield, oh","city_marietta, oh","city_marinette, wi","city_marion, oh","city_marlborough, ma","city_marshalltown, ia","city_martins ferry, oh","city_mason city, ia","city_massillon, oh","city_mckeesport, pa","city_meadville, pa","city_medford, ma","city_melrose, ma","city_middletown, ny","city_middletown, oh","city_milwaukee, wi","city_monroe, la","city_morristown, nj","city_muscatine, ia","city_nanticoke, pa","city_new bedford, ma","city_new castle, pa","city_new philadelphia, oh","city_new rochelle, ny","city_new york, ny","city_newark, nj","city_newark, oh","city_newburgh, ny","city_newburyport, ma","city_newton, ia","city_newton, ma","city_niagara falls, ny","city_niles, oh","city_north adams, ma","city_north little rock, ar","city_north tonawanda, ny","city_northampton, ma","city_norwood, oh","city_nutley, nj","city_ogdensburg, ny","city_oil city, pa","city_olean, ny","city_omaha, ne","city_oneida, ny","city_oneonta, ny","city_orange, nj","city_orlando, fl","city_oshkosh, wi","city_oskaloosa, ia","city_ossining, ny","city_oswego, ny","city_ottumwa, ia","city_painesville, oh","city_parma, oh","city_parsons, ks","city_paterson, nj","city_peabody, ma","city_peekskill, ny","city_philadelphia, pa","city_pine bluff, ar","city_piqua, oh","city_pittsburgh, pa","city_pittsfield, ma","city_pittston, pa","city_plattsburg, ny","city_pocatello, id","city_port chester, ny","city_port huron, mi","city_port jervis, ny","city_portland, or","city_portsmouth, oh","city_pottsville, pa","city_poughkeepsie, ny","city_quincy, ma","city_racine, wi","city_rahway, nj","city_reading, pa","city_revere, ma","city_rochester, mn","city_rochester, ny","city_rome, ny","city_rutherford, nj","city_salem, ma","city_salem, oh","city_salem, or","city_salt lake city, ut","city_san antonio, tx","city_sandusky, oh","city_saratoga springs, ny","city_scranton, pa","city_shaker heights, oh","city_sharon, pa","city_sheboygan, wi","city_shorewood, wi","city_shreveport, la","city_sioux city, ia","city_somerville, ma","city_south milwaukee, wi","city_south orange, nj","city_spartanburg, sc","city_springfield, ma","city_springfield, oh","city_st. augustine, fl","city_st. cloud, mn","city_steubenville, oh","city_stevens point, wi","city_struthers, oh","city_sunbury, pa","city_superior, wi","city_syracuse, ny","city_taunton, ma","city_teaneck, nj","city_tiffin, oh","city_toledo, oh","city_tonawanda, ny","city_topeka, ks","city_trenton, nj","city_troy, ny","city_tuscaloosa, al","city_two rivers, wi","city_union, nj","city_uniontown, pa","city_utica, ny","city_waco, tx","city_waltham, ma","city_warren, oh","city_washington, pa","city_waterloo, ia","city_watertown, ny","city_watertown, wi","city_watervliet, ny","city_waukesha, wi","city_wausau, wi","city_wauwatosa, wi","city_west allis, wi","city_west orange, nj","city_westfield, ma","city_white plains, ny","city_williamsport, pa","city_woburn, ma","city_wooster, oh","city_worcester, ma","city_xenia, oh","city_yonkers, ny","city_york, pa","city_youngstown, oh","city_zanesville, oh"],"instruments":["treat_assign"],"level":0.95,"se":"HC1","subset":null,"y":"govt"},"attempt":1,"cached":false,"call_id":"call_e4725933","card_version":"0.1.0","code_version":"62cdbe0860ad","dataset_digests":{"ref_iv":"7d61c3ca2820695850a004a3f562adc84c8c7616c63bd9cf034254497c8c4fda"},"decided_by":"model","duration_ms":176.16370785981417,"epoch":1,"error":null,"event":"tool","informed_by":[],"input_digest":"55e0a15120b32e7c3d225d8fb5853ce272e90ec892b164688414bf4c78910406","llm_name":"infer__iv_2sls","output_digest":"37f8d6e9bacd9499abb57b2e66bbc8697b4861c6b71ef3a4be07e99c131946ef","rationale":"IV2SLS.from_formula('govt ~ 1 + pop + C(YEAR) + C(city) + [treat_actual ~ treat_assign]').fit(cov_type='robust')","replay_class":"replayed","result":{"assumptions":["the instruments affect the outcome only through the endogenous regressors (exclusion restriction)","the instruments are as good as randomly assigned given the controls","errors are independent across observations; their variance may differ"],"call_id":"call_e4725933","datasets":{},"diagnostics":[{"flag":false,"name":"first_stage_F.treat_actual","note":"Wald F of the excluded instruments in the first stage for treat_actual (heteroskedasticity-robust standard errors (HC1))","value":27.566954027523366},{"flag":false,"name":"partial_r2.treat_actual","note":"share of the variation the instruments explain beyond the controls","value":0.023414745621849642},{"flag":false,"name":"weak_instrument","note":"every first-stage F is at least 10","value":false},{"flag":false,"name":"n_obs","note":"","value":1686},{"flag":false,"name":"se_type","note":"heteroskedasticity-robust standard errors (HC1)","value":"HC1"},{"flag":false,"name":"n_clusters","note":"errors not clustered","value":null}],"figures":[{"ci_high":0.04662495033414296,"ci_level":0.95,"ci_low":-0.3844163674878325,"derivation":{"note_pt":"","steps":[{"formula":"\u03b2 = \u03c1 / \u03c0","result":-0.16889570857684477,"terms":[{"note":"forma reduzida","symbol":"\u03c1","unit":"","value":-0.02540365727618334},{"note":"primeiro est\u00e1gio","symbol":"\u03c0","unit":"","value":0.15041031823863665}],"text_pt":"Com um instrumento e um regressor end\u00f3geno, o MQ2E \u00e9 a raz\u00e3o entre o coeficiente de treat_assign na forma reduzida (govt sobre treat_assign e os controles) e no primeiro est\u00e1gio (treat_actual sobre treat_assign e os controles).","unit":""},{"formula":"ep = \u221aV_jj","result":0.10986309995036375,"terms":[{"note":"diagonal da matriz de covari\u00e2ncia","symbol":"V_jj","unit":"","value":0.012069900730703615}],"text_pt":"Erro-padr\u00e3o robusto \u00e0 heterocedasticidade (HC1): a raiz da vari\u00e2ncia estimada do coeficiente.","unit":""},{"formula":"IC = \u03b2 \u00b1 c \u00b7 ep","result":null,"terms":[{"note":"","symbol":"\u03b2","unit":"","value":-0.16889570857684477},{"note":"quantil 0.975","symbol":"c","unit":"","value":1.9617201681762135},{"note":"","symbol":"ep","unit":"","value":0.10986309995036375}],"text_pt":"Intervalo de 95% de confian\u00e7a: a estimativa mais ou menos o valor cr\u00edtico da distribui\u00e7\u00e3o t de Student com 1352 graus de liberdade vezes o erro-padr\u00e3o.","unit":""}]},"key":"coef.treat_actual","label":"2SLS effect of treat_actual on govt","se":0.10986309995036375,"unit":"","value":-0.16889570857684477}],"notes":"","reason":"","status":"ok","tables":{"coefficients":[{"ci_high":0.570406589014986,"ci_low":0.1686693271574903,"coef":0.3695379580862381,"p":0.0003186286384262648,"se":0.1023941305122498,"t":3.608975985611098,"term":"Intercept"},{"ci_high":1.0157433429863065,"ci_low":0.5025700502468816,"coef":0.759156696616594,"p":8.052547110615557e-09,"se":0.1307967622152031,"t":5.804093952780995,"term":"pop"},{"ci_high":0.04241990695652239,"ci_low":-0.10629327433232902,"coef":-0.03193668368790332,"p":0.3996164659017908,"se":0.03790377029846927,"t":-0.8425727424058673,"term":"YEAR_1860.0"},{"ci_high":-0.10649247064005567,"ci_low":-0.23734470096424432,"coef":-0.17191858580215,"p":2.916639140681932e-07,"se":0.03335140058376428,"t":-5.154763601917255,"term":"YEAR_1870.0"},{"ci_high":-0.11652729032703599,"ci_low":-0.22361767483339737,"coef":-0.17007248258021668,"p":6.182455353009049e-10,"se":0.02729502052423765,"t":-6.230897772331564,"term":"YEAR_1880.0"},{"ci_high":-0.10048033538072586,"ci_low":-0.2781560737301517,"coef":-0.1893182045554388,"p":3.0952399699920735e-05,"se":0.045285699059364,"t":-4.1805295819164865,"term":"YEAR_1900.0"},{"ci_high":-0.17616701630689652,"ci_low":-0.4036375896402565,"coef":-0.2899023029735765,"p":6.475676363724667e-07,"se":0.057977324448072645,"t":-5.000270463208893,"term":"YEAR_1910.0"},{"ci_high":-0.004204816168142028,"ci_low":-0.34110840476934245,"coef":-0.17265661046874226,"p":0.04455669032772878,"se":0.0858694308359014,"t":-2.0106877242344052,"term":"YEAR_1920.0"},{"ci_high":0.08135559443469194,"ci_low":-0.28487198630122107,"coef":-0.10175819593326456,"p":0.27584227560082375,"se":0.09334348157219338,"t":-1.0901478519907477,"term":"YEAR_1930.0"},{"ci_high":0.24346177144417877,"ci_low":-0.23643890003134896,"coef":0.0035114357064148964,"p":0.9771018456975955,"se":0.12231629140095075,"t":0.02870783332454439,"term":"YEAR_1940.0"},{"ci_high":0.10063087794091741,"ci_low":-0.16632066290919645,"coef":-0.03284489248413952,"p":0.629367048957663,"se":0.06804016831266392,"t":-0.4827279722943644,"term":"city_albany, ny"},{"ci_high":0.018957755265573695,"ci_low":-0.566431725273463,"coef":-0.27373698500394467,"p":0.0667756875098501,"se":0.14920310501860873,"t":-1.8346601095855477,"term":"city_alexandria, la"},{"ci_high":0.16166679190833,"ci_low":-0.07475541256100818,"coef":0.04345568967366092,"p":0.4709420855115203,"se":0.06025890142352385,"t":0.7211497164250774,"term":"city_allentown, pa"},{"ci_high":0.20022961347614995,"ci_low":-0.0884989512622242,"coef":0.055865331106962866,"p":0.4479034399719279,"se":0.07359066023336078,"t":0.759136158444703,"term":"city_alliance, oh"},{"ci_high":0.12184338304985586,"ci_low":-0.09815330028212478,"coef":0.011845041383865534,"p":0.8327275305461189,"se":0.056072391695016516,"t":0.2112455171930587,"term":"city_altoona, pa"},{"ci_high":0.14261717716046232,"ci_low":-0.11510911097797674,"coef":0.013754033091242795,"p":0.8341819428203849,"se":0.06568885112142267,"t":0.20938154430223066,"term":"city_ames, ia"},{"ci_high":0.13676571546764074,"ci_low":-0.12911304621151157,"coef":0.0038263346280645945,"p":0.9549810641728234,"se":0.0677667401274506,"t":0.056463312546365836,"term":"city_amsterdam, ny"},{"ci_high":-0.04896428622340529,"ci_low":-0.534009944150767,"coef":-0.29148711518708614,"p":0.018526237448095874,"se":0.1236276370595462,"t":-2.35778279129196,"term":"city_anniston, al"},{"ci_high":0.01690978156366374,"ci_low":-0.2880956317258914,"coef":-0.13559292508111384,"p":0.08135129910790909,"se":0.07773927653838489,"t":-1.744201015482346,"term":"city_appleton, wi"},{"ci_high":-0.03260254967537646,"ci_low":-1.0230613729730962,"coef":-0.5278319613242363,"p":0.036726351829988596,"se":0.2524465108136541,"t":-2.0908665349463305,"term":"city_arnold, pa"},{"ci_high":0.1467691782614559,"ci_low":-0.09726825133112313,"coef":0.024750463465166392,"p":0.6907532081353979,"se":0.06219985743926402,"t":0.39791833107229146,"term":"city_ashland, oh"},{"ci_high":0.12105393693710248,"ci_low":-0.16211076029987637,"coef":-0.020528411681386936,"p":0.7761204682282842,"se":0.07217255086392711,"t":-0.2844351687124216,"term":"city_ashland, wi"},{"ci_high":0.16120428607289553,"ci_low":-0.1928170007747804,"coef":-0.015806357350942424,"p":0.8609691984764106,"se":0.09023236152402028,"t":-0.17517392966308099,"term":"city_ashtabula, oh"},{"ci_high":-0.0007349634546179318,"ci_low":-0.36269730862130134,"coef":-0.18171613603795964,"p":0.049078161851352546,"se":0.0922563653671347,"t":-1.9696867019941582,"term":"city_atlantic city, nj"},{"ci_high":0.05889748489747906,"ci_low":-0.28595937973477326,"coef":-0.11353094741864708,"p":0.19670162564621035,"se":0.0878965487093048,"t":-1.291642835649002,"term":"city_attleboro, ma"},{"ci_high":0.16666279537453757,"ci_low":-0.1053013091312655,"coef":0.030680743121636034,"p":0.6581185631689704,"se":0.06931776226745037,"t":0.442610120668059,"term":"city_auburn, ny"},{"ci_high":0.19724644204423764,"ci_low":-0.09355709434346034,"coef":0.05184467385038864,"p":0.4843762381720922,"se":0.07411952558403229,"t":0.6994739030218191,"term":"city_augusta, ga"},{"ci_high":-0.001608199211556749,"ci_low":-0.18715738782381564,"coef":-0.09438279351768619,"p":0.046164137871401924,"se":0.047292471072661095,"t":-1.9957255642800857,"term":"city_barberton, oh"},{"ci_high":0.17832930631759375,"ci_low":-0.017595662722822772,"coef":0.0803668217973855,"p":0.1077704032758603,"se":0.04993703287012783,"t":1.6093631755494362,"term":"city_batavia, ny"},{"ci_high":0.28188637798106914,"ci_low":-0.3749534179369108,"coef":-0.04653351997792082,"p":0.78108988812611,"se":0.16741424352297798,"t":-0.2779543663591204,"term":"city_baton rouge, la"},{"ci_high":0.17853546819882515,"ci_low":-0.150700013200337,"coef":0.01391772749924407,"p":0.868295804694146,"se":0.0839149963231627,"t":0.16585506892767887,"term":"city_beacon, ny"},{"ci_high":0.2351804539146006,"ci_low":-0.07203309211649897,"coef":0.08157368089905082,"p":0.29769912054028197,"se":0.07830208176855115,"t":1.041781764374669,"term":"city_beaver falls, pa"},{"ci_high":0.38933969207612795,"ci_low":0.05801845345928133,"coef":0.22367907276770466,"p":0.008172771849143794,"se":0.08444661068170387,"t":2.6487631766631314,"term":"city_bellaire, oh"},{"ci_high":0.06937683075977412,"ci_low":-0.1824093354174397,"coef":-0.0565162523288328,"p":0.3786580919298129,"se":0.06417484263601578,"t":-0.880660551820584,"term":"city_beloit, wi"},{"ci_high":0.21588461712638096,"ci_low":-0.22745546680501671,"coef":-0.005785424839317876,"p":0.959174151854718,"se":0.11299778916571097,"t":-0.05119945161788578,"term":"city_benton harbor, mi"},{"ci_high":0.24252232054825884,"ci_low":0.021349368105991917,"coef":0.13193584432712538,"p":0.019405712911755857,"se":0.056372197225226225,"t":2.340441757130674,"term":"city_bethlehem, pa"},{"ci_high":0.19492345701344813,"ci_low":-0.20552017424041394,"coef":-0.005298358613482915,"p":0.9586065525153146,"se":0.10206441207823985,"t":-0.05191191038675983,"term":"city_beverly, ma"},{"ci_high":0.20018927422889948,"ci_low":-0.03492021271741633,"coef":0.08263453075574158,"p":0.16812851741440302,"se":0.059924318146989876,"t":1.3789815772796155,"term":"city_binghamton, ny"},{"ci_high":0.1931800548473403,"ci_low":-0.16619033238141495,"coef":0.01349486123296266,"p":0.8828929858229075,"se":0.09159573140415266,"t":0.1473306782541926,"term":"city_boise, id"},{"ci_high":0.17048896685294304,"ci_low":-0.18311501856802212,"coef":-0.006313025857539552,"p":0.9441668754922461,"se":0.09012600042484814,"t":-0.07004666608725957,"term":"city_boone, ia"},{"ci_high":0.07339198802496397,"ci_low":-0.1450161056021568,"coef":-0.03581205878859641,"p":0.5201250399108074,"se":0.05566749457191237,"t":-0.6433208295791665,"term":"city_boston, ma"},{"ci_high":0.2473585732897635,"ci_low":0.00783427879337481,"coef":0.12759642604156915,"p":0.036800052737532236,"se":0.0610495570117606,"t":2.090046714294568,"term":"city_bradford, pa"},{"ci_high":0.0375012291129668,"ci_low":-0.17262056082116262,"coef":-0.06755966585409791,"p":0.20735034073348116,"se":0.05355549515746606,"t":-1.2614889593580678,"term":"city_brainerd, mn"},{"ci_high":0.08203157150971008,"ci_low":-0.26719908574390755,"coef":-0.09258375711709874,"p":0.29846339597451593,"se":0.08901133375671337,"t":-1.0401344773705958,"term":"city_brockton, ma"},{"ci_high":0.15345098995757178,"ci_low":-0.023634010204617042,"coef":0.06490848987647738,"p":0.1506392690787725,"se":0.04513513268480655,"t":1.4380923687486347,"term":"city_bucyrus, oh"},{"ci_high":-0.015327020300508323,"ci_low":-0.21705497654502776,"coef":-0.11619099842276803,"p":0.023991144861261377,"se":0.05141608867488561,"t":-2.2598179172567434,"term":"city_buffalo, ny"},{"ci_high":0.16494102971689895,"ci_low":-0.10050329910631062,"coef":0.032218865305294164,"p":0.6339975562819078,"se":0.0676560125978594,"t":0.47621584642890336,"term":"city_burlington, ia"},{"ci_high":0.2435141657139071,"ci_low":-0.040271096833945794,"coef":0.10162153443998066,"p":0.16026384677686797,"se":0.0723307195265481,"t":1.4049567750073568,"term":"city_butler, pa"},{"ci_high":0.06052235056596591,"ci_low":-0.13928490129792614,"coef":-0.03938127536598012,"p":0.4394825908504885,"se":0.050926542711147826,"t":-0.773295677842265,"term":"city_cambridge, ma"},{"ci_high":0.28122145361014694,"ci_low":0.045107833479248335,"coef":0.16316464354469765,"p":0.006787571047024277,"se":0.06018024995644778,"t":2.7112656338712333,"term":"city_cambridge, oh"},{"ci_high":0.0664523033744182,"ci_low":-0.20705288379584114,"coef":-0.07030029021071148,"p":0.3134142097751979,"se":0.06971055087447403,"t":-1.0084598289475488,"term":"city_camden, nj"},{"ci_high":-0.20502572272138234,"ci_low":-0.40091789006006895,"coef":-0.30297180639072563,"p":1.6779401428051846e-09,"se":0.04992867242650746,"t":-6.068092574195422,"term":"city_campbell, oh"},{"ci_high":0.19105259333151534,"ci_low":-0.13339124181414821,"coef":0.028830675758683567,"p":0.7274107820380823,"se":0.08269370943137494,"t":0.3486441224723302,"term":"city_canton, oh"},{"ci_high":0.23478207547494895,"ci_low":-0.036751544576665296,"coef":0.09901526544914183,"p":0.1527501029274836,"se":0.0692080410999841,"t":1.4306901896861313,"term":"city_carbondale, pa"},{"ci_high":0.028914426583002723,"ci_low":-0.27148916847451043,"coef":-0.12128737094575384,"p":0.11340904966805025,"se":0.07656637269952589,"t":-1.5840814533780947,"term":"city_casper, wy"},{"ci_high":0.1880880554000469,"ci_low":-0.08515544581025367,"coef":0.05146630479489661,"p":0.4600396506539322,"se":0.06964385278873174,"t":0.7389927859250167,"term":"city_cedar rapids, ia"},{"ci_high":0.1536680903243927,"ci_low":-0.08535825441827821,"coef":0.03415491795305723,"p":0.5751442747485064,"se":0.060922640400055295,"t":0.5606276702515709,"term":"city_chelsea, ma"},{"ci_high":0.1818315935920589,"ci_low":-0.13198347662168328,"coef":0.024924058485187816,"p":0.7553846320315277,"se":0.07998466736096517,"t":0.31161045369742296,"term":"city_chester, pa"},{"ci_high":0.13912441598711542,"ci_low":-0.1750012664638427,"coef":-0.01793842523836365,"p":0.822751055416941,"se":0.08006383569553573,"t":-0.22405153441035897,"term":"city_cheyenne, wy"},{"ci_high":0.17614838457877582,"ci_low":-0.19161767934894466,"coef":-0.007734647385084432,"p":0.9342489492750483,"se":0.09373560762991695,"t":-0.08251557311733708,"term":"city_chicopee, ma"},{"ci_high":0.15856263683043015,"ci_low":-0.04623206955373424,"coef":0.056165283638347954,"p":0.2821147820813266,"se":0.05219773689092452,"t":1.0760099380498862,"term":"city_chillicothe, oh"},{"ci_high":0.045238949153096925,"ci_low":-0.1913937341183903,"coef":-0.07307739248264669,"p":0.225860050475625,"se":0.060312547913365655,"t":-1.2116449231694997,"term":"city_cincinnati, oh"},{"ci_high":-0.0071915734556782795,"ci_low":-0.29769984271260286,"coef":-0.15244570808414057,"p":0.03970025166334397,"se":0.07404426838487531,"t":-2.058845490804795,"term":"city_cleveland heights, oh"},{"ci_high":-0.042646926085002757,"ci_low":-0.25801139126584494,"coef":-0.15032915867542385,"p":0.00625024460422574,"se":0.05489173957493229,"t":-2.738648106974469,"term":"city_cleveland, oh"},{"ci_high":0.042833229951168644,"ci_low":-0.2831029111625827,"coef":-0.120134840605707,"p":0.14837608647470416,"se":0.08307406591450044,"t":-1.4461172603415053,"term":"city_clifton, nj"},{"ci_high":0.06784693995880817,"ci_low":-0.1136127787587963,"coef":-0.022882919399994074,"p":0.6208469799894487,"se":0.046250153732758245,"t":-0.49476418029258284,"term":"city_clinton, ia"},{"ci_high":0.3410285588978411,"ci_low":-0.05160618782995588,"coef":0.14471118553394263,"p":0.14839764134095446,"se":0.100074096473409,"t":1.4460403904060657,"term":"city_coatesville, pa"},{"ci_high":0.09761812457015473,"ci_low":-0.22956169232728296,"coef":-0.06597178387856412,"p":0.42901654052860655,"se":0.08339105194641819,"t":-0.7911134628803269,"term":"city_coffeyville, ks"},{"ci_high":0.2396102950527042,"ci_low":-0.1380951132735555,"coef":0.05075759088957436,"p":0.5981079590423054,"se":0.09626893133219089,"t":0.5272478897104136,"term":"city_cohoes, ny"},{"ci_high":0.19977512633876535,"ci_low":-0.22130744084265827,"coef":-0.010766157251946452,"p":0.9201101062028326,"se":0.10732483001714224,"t":-0.10031376010776676,"term":"city_columbia, sc"},{"ci_high":0.0819821496572515,"ci_low":-0.14773441500868434,"coef":-0.03287613267571643,"p":0.5745447647137913,"se":0.05854977901346155,"t":-0.5615073742320645,"term":"city_columbus, oh"},{"ci_high":0.22914614927197913,"ci_low":-0.29235384011037663,"coef":-0.03160384541919874,"p":0.8120973744392612,"se":0.1329190569180893,"t":-0.23776760196752258,"term":"city_connellsville, pa"},{"ci_high":0.2800819586181569,"ci_low":-0.11837263028422974,"coef":0.08085466416696356,"p":0.4260863284485523,"se":0.10155744824523694,"t":0.7961470632042555,"term":"city_corning, ny"},{"ci_high":0.10632383067919256,"ci_low":-0.24763737183764584,"coef":-0.07065677057922663,"p":0.4336547861390168,"se":0.09021704732890411,"t":-0.7831864672053984,"term":"city_corpus christi, tx"},{"ci_high":0.23917781245240272,"ci_low":-0.11353117977626466,"coef":0.06282331633806902,"p":0.4847786323454487,"se":0.08989788603656362,"t":0.6988297401400214,"term":"city_cortland, ny"},{"ci_high":0.22792656037533665,"ci_low":-0.061669872617061125,"coef":0.08312834387913777,"p":0.260272560992386,"se":0.07381186106212895,"t":1.1262193187239506,"term":"city_coshocton, oh"},{"ci_high":0.17356588400404996,"ci_low":-0.024191558380756956,"coef":0.0746871628116465,"p":0.13863508937653574,"se":0.050404090652913944,"t":1.4817678851890708,"term":"city_council bluffs, ia"},{"ci_high":0.22245575090620356,"ci_low":-0.4679938541859631,"coef":-0.12276905163987979,"p":0.48552975164917594,"se":0.1759806562355091,"t":-0.6976281045092935,"term":"city_cudahy, wi"},{"ci_high":0.23231854288828024,"ci_low":-0.4052456547982304,"coef":-0.08646355595497505,"p":0.594758612815725,"se":0.162501310846808,"t":-0.5320791291122896,"term":"city_cuyahoga falls, oh"},{"ci_high":0.11064567734033834,"ci_low":-0.2455113838994589,"coef":-0.06743285327956028,"p":0.45770579220756846,"se":0.09077672417746308,"t":-0.7428429907619609,"term":"city_dallas, tx"},{"ci_high":-0.039928732420371926,"ci_low":-0.25315842523645654,"coef":-0.14654357882841423,"p":0.007096125020613664,"se":0.05434763231657081,"t":-2.6964114641611077,"term":"city_davenport, ia"},{"ci_high":0.07104339070191013,"ci_low":-0.1464795076410118,"coef":-0.037718058469550834,"p":0.4964201646644858,"se":0.05544187745827944,"t":-0.6803171212579163,"term":"city_dayton, oh"},{"ci_high":-0.005327221954849859,"ci_low":-0.36382591609453413,"coef":-0.184576569024692,"p":0.04357804169548741,"se":0.09137355570773786,"t":-2.0200217403716656,"term":"city_dearborn, mi"},{"ci_high":0.08432337704155501,"ci_low":-0.12428858715702423,"coef":-0.019982605057734602,"p":0.7071096397046293,"se":0.053170673264914016,"t":-0.37582004948808156,"term":"city_denver, co"},{"ci_high":0.1807388082052122,"ci_low":-0.042235850061148716,"coef":0.06925147907203175,"p":0.22323055388239832,"se":0.056831413033199746,"t":1.2185422704794697,"term":"city_des moines, ia"},{"ci_high":0.11095272004099499,"ci_low":-0.3943418740490041,"coef":-0.14169457700400456,"p":0.2714364408112585,"se":0.12878865250179009,"t":-1.100210105871207,"term":"city_dover, nj"},{"ci_high":0.1505128161691385,"ci_low":-0.21183094001072397,"coef":-0.030659061920792735,"p":0.7399597350143798,"se":0.09235357877691824,"t":-0.3319748116621475,"term":"city_du bois, pa"},{"ci_high":0.019631418863939015,"ci_low":-0.2649590615650341,"coef":-0.12266382135054754,"p":0.09105272810195142,"se":0.07253595213163183,"t":-1.6910761869913569,"term":"city_dubuque, ia"},{"ci_high":-0.15697331606231313,"ci_low":-0.31130322766751367,"coef":-0.2341382718649134,"p":3.363034507564575e-09,"se":0.03933535325496478,"t":-5.952362251516356,"term":"city_dunkirk, ny"},{"ci_high":-0.062093965247034255,"ci_low":-0.48658896947872965,"coef":-0.27434146736288195,"p":0.011336374370758441,"se":0.10819458634264413,"t":-2.5356302624427354,"term":"city_duquesne, pa"},{"ci_high":0.12029526902493179,"ci_low":-0.09541308390727793,"coef":0.012441092558826923,"p":0.8210128162889911,"se":0.05497938911765154,"t":0.22628648223435097,"term":"city_east cleveland, oh"},{"ci_high":0.24973595252439446,"ci_low":-0.045397370442990526,"coef":0.10216929104070196,"p":0.17462141161069333,"se":0.07522309444413948,"t":1.3582170714417057,"term":"city_east liverpool, oh"},{"ci_high":0.026976894114302902,"ci_low":-0.17076194241449907,"coef":-0.07189252415009809,"p":0.1539672217584749,"se":0.05039934842303152,"t":-1.426457412636799,"term":"city_east orange, nj"},{"ci_high":0.14732498613120987,"ci_low":-0.049407317322746835,"coef":0.048958834404231516,"p":0.32904687866319193,"se":0.050142804933502885,"t":0.9763880275377196,"term":"city_easton, pa"},{"ci_high":0.2171275717668592,"ci_low":-0.3674877843234681,"coef":-0.07518010627830447,"p":0.6139607786721192,"se":0.14900579745627962,"t":-0.5045448402795426,"term":"city_eau claire, wi"},{"ci_high":0.1821274857574257,"ci_low":-0.3058366891759479,"coef":-0.06185460170926111,"p":0.619032003236786,"se":0.12437150385904117,"t":-0.4973374108217362,"term":"city_el paso, tx"},{"ci_high":0.08446049347850156,"ci_low":-0.26686833177776814,"coef":-0.09120391914963329,"p":0.3086162307596644,"se":0.08954611135565162,"t":-1.0185134537824578,"term":"city_elizabeth, nj"},{"ci_high":0.1641428834890084,"ci_low":-0.08911085841455603,"coef":0.03751601253722618,"p":0.5612005158567,"se":0.06454889591592751,"t":0.5812030090505245,"term":"city_elmira, ny"},{"ci_high":0.15812086252267227,"ci_low":-0.10344512455774842,"coef":0.027337868982461922,"p":0.6818248002266214,"se":0.06666750725298279,"t":0.41006286433844114,"term":"city_elyria, oh"},{"ci_high":0.162712521594424,"ci_low":-0.05403814228120176,"coef":0.05433718965661113,"p":0.32550461112187784,"se":0.05524505161129483,"t":0.9835666375864496,"term":"city_endicott, ny"},{"ci_high":0.10372658286615521,"ci_low":-0.10841542844141855,"coef":-0.0023444227876316718,"p":0.9654219976542948,"se":0.05407040584814895,"t":-0.04335870520772004,"term":"city_erie, pa"},{"ci_high":-0.10127899117088199,"ci_low":-0.33851472998715015,"coef":-0.21989686057901608,"p":0.00028654433405573567,"se":0.06046625371569261,"t":-3.6366873597453746,"term":"city_euclid, oh"},{"ci_high":0.1666692437482763,"ci_low":-0.0897599620207863,"coef":0.03845464086374499,"p":0.5563842373377103,"se":0.06535825290705492,"t":0.5883670256368513,"term":"city_eugene, or"},{"ci_high":0.025103521392220884,"ci_low":-0.29188994799157875,"coef":-0.13339321329967893,"p":0.09896817859584976,"se":0.08079477249767597,"t":-1.6510129204648225,"term":"city_everett, ma"},{"ci_high":0.13198188144476478,"ci_low":-0.1254489182887407,"coef":0.0032664815780120327,"p":0.9603021469958891,"se":0.0656135375242728,"t":0.049783652905524924,"term":"city_fall river, ma"},{"ci_high":-0.08874946687001131,"ci_low":-0.5512712864443953,"coef":-0.3200103766572033,"p":0.006720867354262861,"se":0.11788679830018382,"t":-2.714556517535893,"term":"city_farrell, pa"},{"ci_high":0.23662082111539595,"ci_low":0.0019100167242659116,"coef":0.11926541891983093,"p":0.046391144574774695,"se":0.05982270259507443,"t":1.9936481259817034,"term":"city_findlay, oh"},{"ci_high":0.1184978511275515,"ci_low":-0.2844372261038528,"coef":-0.08296968748815066,"p":0.4192968847762772,"se":0.10269942771858434,"t":-0.8078885085465436,"term":"city_fitchburg, ma"},{"ci_high":0.20260554204513734,"ci_low":-0.2043771122155252,"coef":-0.0008857850851939368,"p":0.9931880101861263,"se":0.10373106747407027,"t":-0.008539245828308449,"term":"city_floral park, ny"},{"ci_high":0.20160582802651722,"ci_low":-0.08874854569535477,"coef":0.05642864116558123,"p":0.4458962986293379,"se":0.07400504374479944,"t":0.7624972341097582,"term":"city_fond du lac, wi"},{"ci_high":0.1962973696037122,"ci_low":-0.0931373370235244,"coef":0.051580016290093886,"p":0.48455083587429815,"se":0.07377064051299437,"t":0.6991943669108891,"term":"city_fort dodge, ia"},{"ci_high":0.24518010951762714,"ci_low":0.0035495224726297125,"coef":0.12436481599512843,"p":0.043647339251331525,"se":0.06158640538156834,"t":2.01935500577776,"term":"city_fort madison, ia"},{"ci_high":0.16828251721015128,"ci_low":-0.14598779313460622,"coef":0.011147362037772529,"p":0.8893390279880236,"se":0.08010069821449882,"t":0.13916685230285264,"term":"city_fort smith, ar"},{"ci_high":0.1880522841783215,"ci_low":0.013931947455187638,"coef":0.10099211581675457,"p":0.023022994174292773,"se":0.044379504158590405,"t":2.275647683125496,"term":"city_fostoria, oh"},{"ci_high":0.2304608294617057,"ci_low":-0.08066780903078412,"coef":0.0748965102154608,"p":0.34509774217897227,"se":0.0792999540759532,"t":0.9444710414803672,"term":"city_franklin, pa"},{"ci_high":0.1755991702530388,"ci_low":-0.06492062403599586,"coef":0.05533927310852147,"p":0.3668390513761894,"se":0.0613032883565251,"t":0.902712963563743,"term":"city_freeport, ny"},{"ci_high":0.2638659898853182,"ci_low":-0.029048277142538326,"coef":0.11740885637138992,"p":0.11603779412832929,"se":0.07465750512729223,"t":1.572633001480641,"term":"city_fremont, oh"},{"ci_high":0.1946213758935268,"ci_low":-0.05908918504852602,"coef":0.06776609542250038,"p":0.29484849003576147,"se":0.06466532919879299,"t":1.0479509848960185,"term":"city_fulton, ny"},{"ci_high":0.151375181134362,"ci_low":-0.33168536646107655,"coef":-0.09015509266335726,"p":0.46414664288993096,"se":0.12312167541319968,"t":-0.7322438746938289,"term":"city_gadsden, al"},{"ci_high":0.08069415416345779,"ci_low":-0.3950807786790168,"coef":-0.15719331225777952,"p":0.19509949609237587,"se":0.12126472994484136,"t":-1.2962822110706114,"term":"city_gardner, ma"},{"ci_high":-0.020196883804107307,"ci_low":-0.2721290707048072,"coef":-0.14616297725445726,"p":0.022986579881024184,"se":0.06421206015711152,"t":-2.2762542876966023,"term":"city_garfield heights, oh"},{"ci_high":0.05490692572338583,"ci_low":-0.30384585819980653,"coef":-0.12446946623821036,"p":0.17366478143840824,"se":0.09143831769255864,"t":-1.3612396791541128,"term":"city_gary, in"},{"ci_high":-0.0026513789413051825,"ci_low":-0.30227719820532123,"coef":-0.1524642885733132,"p":0.046086443089827844,"se":0.07636813448846132,"t":-1.996438561640516,"term":"city_geneva, ny"},{"ci_high":0.15990209832416247,"ci_low":-0.3694611715442728,"coef":-0.1047795366100552,"p":0.43753872928284715,"se":0.1349232368754657,"t":-0.776586294818637,"term":"city_glen cove, ny"},{"ci_high":0.18872140594476272,"ci_low":-0.003665054633891676,"coef":0.09252817565543552,"p":0.0593775374513717,"se":0.0490351436712591,"t":1.8869767421456323,"term":"city_glens falls, ny"},{"ci_high":0.34868254544436605,"ci_low":-0.024588187140532597,"coef":0.16204717915191671,"p":0.08874657417494929,"se":0.09513862849560335,"t":1.7032742821114497,"term":"city_gloucester, ma"},{"ci_high":0.19733536290193365,"ci_low":-0.16804866068979613,"coef":0.014643351106068755,"p":0.8750806267750345,"se":0.09312847711899264,"t":0.1572381677342213,"term":"city_gloversville, ny"},{"ci_high":0.19107256939600875,"ci_low":-0.11851410496929587,"coef":0.03627923221335643,"p":0.645753531068845,"se":0.07890694080316345,"t":0.45977238306394924,"term":"city_greeley, co"},{"ci_high":0.2694246487417666,"ci_low":-0.15829533049409922,"coef":0.05556465912383367,"p":0.6103517977866546,"se":0.10901656265111238,"t":0.5096900670190659,"term":"city_green bay, wi"},{"ci_high":0.17786740205527962,"ci_low":-0.011934532081508062,"coef":0.08296643498688577,"p":0.08657095228907119,"se":0.04837640383573263,"t":1.7150186539000993,"term":"city_greensburg, pa"},{"ci_high":-0.06197035114732202,"ci_low":-0.47724497401187976,"coef":-0.2696076625796009,"p":0.010968943486821479,"se":0.10584451075166172,"t":-2.547204958150068,"term":"city_greenville, sc"},{"ci_high":0.18718693245715542,"ci_low":-0.07486836507068331,"coef":0.056159283693236056,"p":0.40060544461820075,"se":0.06679222189255164,"t":0.8408057420754658,"term":"city_hamilton, oh"},{"ci_high":0.0670453517126029,"ci_low":-0.145938484643466,"coef":-0.03944656646543155,"p":0.4675617332877628,"se":0.054284968827658354,"t":-0.7266572555409373,"term":"city_harrisburg, pa"},{"ci_high":0.08000868459056368,"ci_low":-0.36176737703867956,"coef":-0.14087934622405793,"p":0.2110932445553357,"se":0.11259915374167684,"t":-1.2511581263502305,"term":"city_hastings, ne"},{"ci_high":0.05683240308759485,"ci_low":-0.19527961548718048,"coef":-0.06922360619979281,"p":0.28154833988877037,"se":0.06425789535751185,"t":-1.077277832002639,"term":"city_haverhill, ma"},{"ci_high":-0.002872120074708412,"ci_low":-0.26151437232895325,"coef":-0.13219324620183084,"p":0.045131222038038085,"se":0.06592231054409287,"t":-2.005288423763787,"term":"city_hazleton, pa"},{"ci_high":0.22372729939855696,"ci_low":-0.19731317010392663,"coef":0.013207064647315159,"p":0.9020705614162869,"se":0.10731410023018716,"t":0.12306923898151502,"term":"city_hempstead, ny"},{"ci_high":-0.12649856786643074,"ci_low":-0.4069890994303049,"coef":-0.26674383364836785,"p":0.0001985020042472847,"se":0.07149096392903038,"t":-3.731154526230286,"term":"city_hibbing, mn"},{"ci_high":0.03264608859999048,"ci_low":-0.23598212381220846,"coef":-0.10166801760610898,"p":0.13780108890088705,"se":0.06846751559421933,"t":-1.4849088173237697,"term":"city_holyoke, ma"},{"ci_high":0.22012325078132183,"ci_low":-0.07173322700309963,"coef":0.07419501188911111,"p":0.31874545569766294,"se":0.07438789755007635,"t":0.9974070290017889,"term":"city_hornell, ny"},{"ci_high":0.21000360707850585,"ci_low":-0.06964083045319837,"coef":0.07018138831265373,"p":0.32497114895026485,"se":0.07127531287800494,"t":0.9846521253828296,"term":"city_houston, tx"},{"ci_high":0.18918349153565503,"ci_low":-0.21287300431921588,"coef":-0.011844756391780432,"p":0.9079976403524506,"se":0.10247549634682548,"t":-0.11558623099216013,"term":"city_hudson, ny"},{"ci_high":0.14728358359736093,"ci_low":-0.12763403638607523,"coef":0.00982477360564286,"p":0.888512905471619,"se":0.07007054941965132,"t":0.14021259554855864,"term":"city_hutchinson, ks"},{"ci_high":0.06676547048521073,"ci_low":-0.13541533774249426,"coef":-0.03432493362864176,"p":0.5054633704805419,"se":0.0515315108412404,"t":-0.6660960074388445,"term":"city_ilion, ny"},{"ci_high":0.031201586997534628,"ci_low":-0.20301122913512576,"coef":-0.08590482106879557,"p":0.1503696512501713,"se":0.0596957761693415,"t":-1.4390435401175752,"term":"city_indianapolis, in"},{"ci_high":0.1699085596111948,"ci_low":-0.4906815422349352,"coef":-0.1603864913118702,"p":0.3409717161105246,"se":0.16837011531065418,"t":-0.9525828916607103,"term":"city_iowa city, ia"},{"ci_high":0.115434375950566,"ci_low":-0.14660069046929794,"coef":-0.015583157259365968,"p":0.8155436092054738,"se":0.0667870654211285,"t":-0.23332597653611145,"term":"city_ironton, oh"},{"ci_high":0.21668676678780313,"ci_low":-0.09204082500621087,"coef":0.06232297089079612,"p":0.4284841196124909,"se":0.07868797925471555,"t":0.7920265773893448,"term":"city_irvington, nj"},{"ci_high":0.2658240216576179,"ci_low":-0.17720901373018338,"coef":0.04430750396371726,"p":0.6948383990975066,"se":0.11291952913949076,"t":0.39238123202748837,"term":"city_ithaca, ny"},{"ci_high":0.1641085987028223,"ci_low":-0.12463101270397103,"coef":0.019738792999425627,"p":0.7885755936356653,"se":0.07359347578998254,"t":0.26821389786990396,"term":"city_jackson, mi"},{"ci_high":0.009960775986899012,"ci_low":-0.2922799568007163,"coef":-0.14115959040690862,"p":0.06710907260216752,"se":0.07703461933324686,"t":-1.8324175757429424,"term":"city_janesville, wi"},{"ci_high":-0.07102855356926413,"ci_low":-0.5877727922970954,"coef":-0.32940067293317976,"p":0.012501411872358216,"se":0.13170691903734716,"t":-2.501012667677497,"term":"city_jeannette, pa"},{"ci_high":0.09968802147461542,"ci_low":-0.14483850119852612,"coef":-0.022575239861955358,"p":0.7172436030793379,"se":0.06232451667672733,"t":-0.36222085730807124,"term":"city_jersey city, nj"},{"ci_high":0.10509180454472648,"ci_low":-0.15037659749285473,"coef":-0.02264239647406412,"p":0.7280910244322601,"se":0.06511336483711817,"t":-0.3477380800501454,"term":"city_johnson city, ny"},{"ci_high":0.26015407951451763,"ci_low":-0.0022444499815987007,"coef":0.12895481476645948,"p":0.0540443531245028,"se":0.06687970429035885,"t":1.9281606600202803,"term":"city_johnstown, ny"},{"ci_high":0.09547416751941373,"ci_low":-0.19819180564131667,"coef":-0.05135881906095147,"p":0.49272682418572594,"se":0.07484909874626715,"t":-0.6861648292527079,"term":"city_johnstown, pa"},{"ci_high":0.06376518427360299,"ci_low":-0.2731006982448375,"coef":-0.10466775698561727,"p":0.22303634519307175,"se":0.0858598203717354,"t":-1.2190539944347862,"term":"city_kansas city, ks"},{"ci_high":0.06956776072185708,"ci_low":-0.4742956538184645,"coef":-0.20236394654830372,"p":0.1445616618994259,"se":0.1386190098269583,"t":-1.4598571061856516,"term":"city_kearny, nj"},{"ci_high":0.17082453397458378,"ci_low":-0.27507597714879306,"coef":-0.052125721587104656,"p":0.6465594211209513,"se":0.11365038662418528,"t":-0.45864975153557536,"term":"city_kenmore, ny"},{"ci_high":0.16301892482958738,"ci_low":-0.22455130300839501,"coef":-0.030766189089403807,"p":0.755505467088752,"se":0.0987832602542649,"t":-0.31145144440680167,"term":"city_kenosha, wi"},{"ci_high":0.15451485413480012,"ci_low":-0.2528333285424298,"coef":-0.04915923720381484,"p":0.6359435014514492,"se":0.10382423275383268,"t":-0.47348519608492,"term":"city_keokuk, ia"},{"ci_high":0.12183339489619192,"ci_low":-0.07425671433332905,"coef":0.02378834028143144,"p":0.6341758305389837,"se":0.0499791235290769,"t":0.4759655352417662,"term":"city_kingston, ny"},{"ci_high":0.1986461437101758,"ci_low":-0.045164171077130014,"coef":0.0767409863165229,"p":0.21707111324530623,"se":0.06214197079239217,"t":1.234930037428392,"term":"city_klamath falls, or"},{"ci_high":0.07938869926087999,"ci_low":-0.1577895402321662,"coef":-0.0392004204856431,"p":0.5167978384454999,"se":0.06045159838305272,"t":-0.6484596195000318,"term":"city_la crosse, wi"},{"ci_high":0.12274968055746041,"ci_low":-0.09559637040665203,"coef":0.013576655075404195,"p":0.8073006092180677,"se":0.05565168124032339,"t":0.24395768057348455,"term":"city_lackawanna, ny"},{"ci_high":0.28701298520693735,"ci_low":-0.35687136086687116,"coef":-0.03492918782996688,"p":0.8314859806805959,"se":0.16411217984072102,"t":-0.21283726694671526,"term":"city_lafayette, la"},{"ci_high":0.1233122648334587,"ci_low":-0.28580252865110267,"coef":-0.08124513190882199,"p":0.43602967675166193,"se":0.10427450360183385,"t":-0.7791466667542415,"term":"city_lake charles, la"},{"ci_high":0.15309938585287852,"ci_low":-0.3036358543654264,"coef":-0.07526823425627395,"p":0.5180212658152826,"se":0.11641192450066054,"t":-0.6465680777904059,"term":"city_lakewood, oh"},{"ci_high":0.23711005781593997,"ci_low":-0.007159844669777121,"coef":0.11497510657308142,"p":0.06500623024878574,"se":0.06225910974673104,"t":1.8467194124811315,"term":"city_lancaster, oh"},{"ci_high":0.17475951903613385,"ci_low":-0.00026390749010916925,"coef":0.08724780577301233,"p":0.05069391960951408,"se":0.04460968219768064,"t":1.9558042441635808,"term":"city_lancaster, pa"},{"ci_high":0.19862130635785907,"ci_low":-0.017719101637730883,"coef":0.0904511023600641,"p":0.1011597298744732,"se":0.055140486269435386,"t":1.640375493209996,"term":"city_lawrence, ma"},{"ci_high":0.2422956767453745,"ci_low":0.03908313646096223,"coef":0.14068940660316837,"p":0.006685741218970458,"se":0.05179447700569251,"t":2.71630132663963,"term":"city_lebanon, pa"},{"ci_high":-0.07157107506320703,"ci_low":-0.4324693104615803,"coef":-0.2520201927623937,"p":0.0062286513674545425,"se":0.09198514682496634,"t":-2.7397922540902124,"term":"city_leominster, ma"},{"ci_high":0.16658630382126993,"ci_low":-0.04370321832506426,"coef":0.06144154274810284,"p":0.2518594326066605,"se":0.053598246466986604,"t":1.1463349418706683,"term":"city_lima, oh"},{"ci_high":0.22929634707606283,"ci_low":-0.17718035076288285,"coef":0.026057998156589983,"p":0.8014503595988761,"se":0.10360211013603483,"t":0.25151995574582897,"term":"city_little falls, ny"},{"ci_high":0.10354725455223712,"ci_low":-0.14804653503638932,"coef":-0.022249640242076096,"p":0.7286689331127083,"se":0.06412581000850137,"t":-0.3469685644380381,"term":"city_little rock, ar"},{"ci_high":0.24870993483056103,"ci_low":-0.06000134207759515,"coef":0.09435429637648295,"p":0.2306768189321917,"se":0.07868382094352458,"t":1.1991575300366497,"term":"city_lockport, ny"},{"ci_high":0.1879080379585472,"ci_low":-0.17229280251380263,"coef":0.007807617722372288,"p":0.9322394384844469,"se":0.09180739595679031,"t":0.08504345037786486,"term":"city_lorain, oh"},{"ci_high":0.08516918191477768,"ci_low":-0.1417307090018718,"coef":-0.028280763543547055,"p":0.6249090274283132,"se":0.057831869855218807,"t":-0.48901693156986814,"term":"city_lowell, ma"},{"ci_high":0.06788741084742606,"ci_low":-0.18009388772772392,"coef":-0.056103238440148924,"p":0.3748931991767012,"se":0.06320506425890882,"t":-0.8876383419267091,"term":"city_lynbrook, ny"},{"ci_high":0.08226595737298004,"ci_low":-0.15545983522009094,"coef":-0.03659693892355546,"p":0.5459462934409854,"se":0.06059115781382868,"t":-0.6039980129774474,"term":"city_lynn, ma"},{"ci_high":0.1482488888420577,"ci_low":-0.4845613674481932,"coef":-0.16815623930306775,"p":0.29733242262154486,"se":0.16128963410682742,"t":-1.042573133941716,"term":"city_madison, wi"},{"ci_high":0.023312846951852276,"ci_low":-0.23134789898302754,"coef":-0.10401752601558763,"p":0.10926764504805564,"se":0.06490751078214042,"t":-1.6025499169844684,"term":"city_malden, ma"},{"ci_high":0.33918035807364444,"ci_low":-0.24857026999280962,"coef":0.045305044040417394,"p":0.7623731220732416,"se":0.14980491040495303,"t":0.3024269626272509,"term":"city_mamaroneck, ny"},{"ci_high":0.15511598309273691,"ci_low":-0.0363592089761069,"coef":0.059378387058315,"p":0.22393134309359225,"se":0.04880288105689811,"t":1.2166983951026817,"term":"city_manitowoc, wi"},{"ci_high":0.001849773606408353,"ci_low":-0.2332294003605152,"coef":-0.11568981337705342,"p":0.05371076504705941,"se":0.05991659202481302,"t":-1.9308476912228796,"term":"city_mankato, mn"},{"ci_high":0.22477703629440599,"ci_low":-0.08902497112256626,"coef":0.06787603258591986,"p":0.39622720734928235,"se":0.07998133793687558,"t":0.8486483764436435,"term":"city_mansfield, oh"},{"ci_high":0.24147294509406012,"ci_low":0.030325778472692216,"coef":0.13589936178337617,"p":0.01167614453019477,"se":0.053816841475833106,"t":2.525219950791852,"term":"city_marietta, oh"},{"ci_high":0.03361620724754587,"ci_low":-0.21274022020011502,"coef":-0.08956200647628458,"p":0.15399738567818444,"se":0.06279091978666237,"t":-1.4263528354191866,"term":"city_marinette, wi"},{"ci_high":0.303357163713194,"ci_low":-0.12038723499345914,"coef":0.09148496435986743,"p":0.3971130797210951,"se":0.10800327324477756,"t":0.8470573308692858,"term":"city_marion, oh"},{"ci_high":0.07324301793049645,"ci_low":-0.18648545885185355,"coef":-0.05662122046067855,"p":0.39252765227502445,"se":0.06619916565975266,"t":-0.8553162248554252,"term":"city_marlborough, ma"},{"ci_high":0.16481257727109994,"ci_low":-0.05589552114055109,"coef":0.05445852806527442,"p":0.3331737366041618,"se":0.05625371599682348,"t":0.9680876560821255,"term":"city_marshalltown, ia"},{"ci_high":0.34851770347571276,"ci_low":-0.07716080761842309,"coef":0.13567844792864484,"p":0.2113202011718862,"se":0.10849623661918198,"t":1.2505359831500098,"term":"city_martins ferry, oh"},{"ci_high":0.16036444734826966,"ci_low":-0.1695266626912968,"coef":-0.004581107671513582,"p":0.9565578097263006,"se":0.08408210186936653,"t":-0.05448374350383132,"term":"city_mason city, ia"},{"ci_high":0.1412681355748271,"ci_low":-0.16415541817849777,"coef":-0.011443641301835337,"p":0.8831508841589004,"se":0.07784585148993836,"t":-0.14700386832192897,"term":"city_massillon, oh"},{"ci_high":0.04315434741877539,"ci_low":-0.13295202404406312,"coef":-0.04489883831264386,"p":0.31734788299980526,"se":0.04488570141646715,"t":-1.0002926744099376,"term":"city_mckeesport, pa"},{"ci_high":0.07328470386709539,"ci_low":-0.26267484370704564,"coef":-0.09469506991997513,"p":0.26897583167405864,"se":0.08562881521641244,"t":-1.1058785489516496,"term":"city_meadville, pa"},{"ci_high":-0.009340317074817,"ci_low":-0.22430287893552325,"coef":-0.11682159800517013,"p":0.03317044007712379,"se":0.05478930311976,"t":-2.1321971872834045,"term":"city_medford, ma"},{"ci_high":0.06875795183148492,"ci_low":-0.2376268321882568,"coef":-0.08443444017838594,"p":0.2797860856733397,"se":0.07809084827439577,"t":-1.0812334869471523,"term":"city_melrose, ma"},{"ci_high":0.26227098282204475,"ci_low":-0.11591774169959775,"coef":0.0731766205612235,"p":0.44789178883521563,"se":0.09639211816669035,"t":0.7591556441853428,"term":"city_middletown, ny"},{"ci_high":0.22564602975540282,"ci_low":-0.1246704467436236,"coef":0.05048779150588962,"p":0.5718627366995501,"se":0.08928808557458814,"t":0.5654482474452192,"term":"city_middletown, oh"},{"ci_high":-0.06173451957703552,"ci_low":-0.3607947375441707,"coef":-0.2112646285606031,"p":0.005654123767033618,"se":0.07622397496304677,"t":-2.77162964359998,"term":"city_milwaukee, wi"},{"ci_high":0.050252871804644994,"ci_low":-0.6229639659508206,"coef":-0.2863555470730878,"p":0.09537834836053713,"se":0.1715883969275156,"t":-1.6688514619904835,"term":"city_monroe, la"},{"ci_high":0.41211730687788967,"ci_low":-0.10310408252571618,"coef":0.15450661217608674,"p":0.23957161762824047,"se":0.13131877771400002,"t":1.1765766851149624,"term":"city_morristown, nj"},{"ci_high":0.0953771861587025,"ci_low":-0.15773011708511936,"coef":-0.03117646546320843,"p":0.6289827493400835,"se":0.06451157187192823,"t":-0.4832693508864052,"term":"city_muscatine, ia"},{"ci_high":-0.11704787051116111,"ci_low":-0.687954781721891,"coef":-0.402501326116526,"p":0.005750207644026699,"se":0.14551181164169166,"t":-2.7661075865624256,"term":"city_nanticoke, pa"},{"ci_high":0.15605848262649263,"ci_low":-0.34416103543592275,"coef":-0.09405127640471506,"p":0.4608337330400508,"se":0.12749512549678865,"t":-0.7376852725799624,"term":"city_new bedford, ma"},{"ci_high":0.16472016094746536,"ci_low":-0.04727216920496191,"coef":0.058723995871251725,"p":0.27730469066244917,"se":0.05403225536227062,"t":1.086832216747651,"term":"city_new castle, pa"},{"ci_high":0.2763420201935597,"ci_low":-0.022851545776455373,"coef":0.12674523720855216,"p":0.09673274702955406,"se":0.07625796248202198,"t":1.6620590569598905,"term":"city_new philadelphia, oh"},{"ci_high":0.007382431524182803,"ci_low":-0.41689860107020627,"coef":-0.20475808477301174,"p":0.058511018936651976,"se":0.10814004960473995,"t":-1.8934528467613803,"term":"city_new rochelle, ny"},{"ci_high":0.11717249107429281,"ci_low":-0.13060564346909448,"coef":-0.0067165761974008345,"p":0.9153176177890745,"se":0.06315328214567512,"t":-0.10635355707891425,"term":"city_new york, ny"},{"ci_high":0.054545571848715155,"ci_low":-0.17354028566119406,"coef":-0.05949735690623946,"p":0.306278505056787,"se":0.05813414706388979,"t":-1.0234493823544275,"term":"city_newark, nj"},{"ci_high":0.21005231341831143,"ci_low":0.008942708160227242,"coef":0.10949751078926934,"p":0.032843648382027024,"se":0.05125848439562439,"t":2.1361831525127273,"term":"city_newark, oh"},{"ci_high":0.23911354781442679,"ci_low":-0.06650421322444167,"coef":0.08630466729499256,"p":0.26807762807147745,"se":0.07789535072247267,"t":1.1079565916903154,"term":"city_newburgh, ny"},{"ci_high":0.07112077194158678,"ci_low":-0.15371498064552616,"coef":-0.04129710435196969,"p":0.4712526365944921,"se":0.05730576568322176,"t":-0.7206448401763672,"term":"city_newburyport, ma"},{"ci_high":0.13630434646952275,"ci_low":-0.11223044080654775,"coef":0.012036952831487506,"p":0.8493229731791538,"se":0.06334613654584847,"t":0.19001873654560505,"term":"city_newton, ia"},{"ci_high":-0.09554513454286058,"ci_low":-0.31870502418208896,"coef":-0.20712507936247476,"p":0.0002812610735763512,"se":0.056878624499919705,"t":-3.6415275717992643,"term":"city_newton, ma"},{"ci_high":0.3244427537995119,"ci_low":-0.26204493981167826,"coef":0.03119890699391679,"p":0.8347044699627264,"se":0.14948301575459672,"t":0.2087120522450217,"term":"city_niagara falls, ny"},{"ci_high":0.14675577543615484,"ci_low":-0.20101156316182292,"coef":-0.02712789386283405,"p":0.7596126472197209,"se":0.08863836551196103,"t":-0.3060513774836401,"term":"city_niles, oh"},{"ci_high":0.09516776967314458,"ci_low":-0.2342121012583084,"coef":-0.06952216579258191,"p":0.40774868014729265,"se":0.08395179808893775,"t":-0.8281200328661309,"term":"city_north adams, ma"},{"ci_high":0.1842337942150708,"ci_low":-0.4179229969264642,"coef":-0.11684460135569667,"p":0.44659990190607374,"se":0.15347672948210359,"t":-0.7613180301012443,"term":"city_north little rock, ar"},{"ci_high":0.04933341599499114,"ci_low":-0.25904937117080196,"coef":-0.10485797758790541,"p":0.18240580165872472,"se":0.07860009601993659,"t":-1.334069331942147,"term":"city_north tonawanda, ny"},{"ci_high":0.1484598384190453,"ci_low":-0.17217029827670377,"coef":-0.011855229928829238,"p":0.884678523734431,"se":0.08172168026233703,"t":-0.1450683575126262,"term":"city_northampton, ma"},{"ci_high":0.2180899050588585,"ci_low":0.016799314109721172,"coef":0.11744460958428984,"p":0.02222347536518556,"se":0.051304613729968085,"t":2.2891627291540844,"term":"city_norwood, oh"},{"ci_high":-0.0966419565350616,"ci_low":-0.3228574929544161,"coef":-0.20974972474473885,"p":0.00028525549515683306,"se":0.057657442710002886,"t":-3.6378603504790847,"term":"city_nutley, nj"},{"ci_high":0.06855753418427432,"ci_low":-0.12570475323483882,"coef":-0.028573609525282255,"p":0.5639746359256735,"se":0.04951325132159811,"t":-0.5770901478412548,"term":"city_ogdensburg, ny"},{"ci_high":0.08404167807679358,"ci_low":-0.15824098908273138,"coef":-0.0370996555029689,"p":0.5480880392153648,"se":0.061752606485351094,"t":-0.6007787786539771,"term":"city_oil city, pa"},{"ci_high":0.07098582801800962,"ci_low":-0.24625461786440261,"coef":-0.0876343949231965,"p":0.2786423539954209,"se":0.08085772146017815,"t":-1.083809849457059,"term":"city_olean, ny"},{"ci_high":0.11718872798423444,"ci_low":-0.24423871643200432,"coef":-0.06352499422388494,"p":0.4905707897041228,"se":0.09212003074634577,"t":-0.6895893727912684,"term":"city_omaha, ne"},{"ci_high":0.1685344605678778,"ci_low":-0.1678117039241825,"coef":0.00036137832184765376,"p":0.9966371992292572,"se":0.0857273554986074,"t":0.0042154376481789895,"term":"city_oneida, ny"},{"ci_high":0.08201286098006079,"ci_low":-0.21983887848050698,"coef":-0.06891300875022309,"p":0.3705592269153199,"se":0.07693547335581392,"t":-0.8957247644595848,"term":"city_oneonta, ny"},{"ci_high":0.0030809572081238468,"ci_low":-0.4140721971311147,"coef":-0.20549561996149543,"p":0.05347651408683897,"se":0.10632330775470912,"t":-1.9327429168736892,"term":"city_orange, nj"},{"ci_high":0.06282252156511128,"ci_low":-0.4449042845657014,"coef":-0.19104088150029505,"p":0.14010658578441834,"se":0.1294085706940659,"t":-1.476261429020291,"term":"city_orlando, fl"},{"ci_high":0.1826881149289377,"ci_low":-0.2028637653398501,"coef":-0.010087825205456211,"p":0.9182516999872515,"se":0.09826882715571775,"t":-0.10265539436499985,"term":"city_oshkosh, wi"},{"ci_high":0.2633576042952628,"ci_low":-0.10701120810863188,"coef":0.07817319809331547,"p":0.40775166738111235,"se":0.09439899186748482,"t":0.8281147557492271,"term":"city_oskaloosa, ia"},{"ci_high":0.2942535877306168,"ci_low":-0.3525941669955192,"coef":-0.029170289632451198,"p":0.859588517163534,"se":0.16486748854896624,"t":-0.17693172795428078,"term":"city_ossining, ny"},{"ci_high":0.12398959225155759,"ci_low":-0.1325290495460199,"coef":-0.004269728647231153,"p":0.9479405810557971,"se":0.06538104821445039,"t":-0.0653052950944807,"term":"city_oswego, ny"},{"ci_high":0.2651311961818778,"ci_low":0.03867166337430651,"coef":0.15190142977809215,"p":0.008592264233154972,"se":0.057719632106883995,"t":2.6317116764847754,"term":"city_ottumwa, ia"},{"ci_high":0.05853014185794761,"ci_low":-0.08674366756973534,"coef":-0.014106762855893861,"p":0.7032747452417727,"se":0.037027148872803346,"t":-0.3809843124663417,"term":"city_painesville, oh"},{"ci_high":0.00722571088200441,"ci_low":-0.2439458509106383,"coef":-0.11836007001431695,"p":0.06469759565256128,"se":0.0640181932844565,"t":-1.8488505211073265,"term":"city_parma, oh"},{"ci_high":0.15250249522587245,"ci_low":-0.27979344819593266,"coef":-0.06364547648503009,"p":0.5636068128469315,"se":0.11018287685335498,"t":-0.5776349129977553,"term":"city_parsons, ks"},{"ci_high":0.10772141586198192,"ci_low":-0.19422980603662549,"coef":-0.04325419508732178,"p":0.5741896235521501,"se":0.07696082927549439,"t":-0.5620287033613688,"term":"city_paterson, nj"},{"ci_high":0.2126783072517293,"ci_low":-0.03718533170530622,"coef":0.08774648777321153,"p":0.16848564996905369,"se":0.06368483206994058,"t":1.3778239640617365,"term":"city_peabody, ma"},{"ci_high":0.26901957776022556,"ci_low":0.04504212133402327,"coef":0.15703084954712443,"p":0.006025622226580914,"se":0.0570870045737541,"t":2.7507284839975608,"term":"city_peekskill, ny"},{"ci_high":0.1172060589635614,"ci_low":-0.06988656448067629,"coef":0.023659747241442555,"p":0.6198631942282592,"se":0.04768585919626226,"t":0.49615856021520666,"term":"city_philadelphia, pa"},{"ci_high":0.1745946661678919,"ci_low":-0.1839368175699768,"coef":-0.004671075701042454,"p":0.9592406560747834,"se":0.09138191306642651,"t":-0.05111597628347962,"term":"city_pine bluff, ar"},{"ci_high":0.15497863764583042,"ci_low":-0.1411918926170374,"coef":0.006893372514396506,"p":0.9272533485692935,"se":0.0754874561284176,"t":0.09131811916763564,"term":"city_piqua, oh"},{"ci_high":0.018238925207673173,"ci_low":-0.2391093697804053,"coef":-0.11043522228636607,"p":0.09247901231746505,"se":0.06559250885087549,"t":-1.683656018363933,"term":"city_pittsburgh, pa"},{"ci_high":0.11884383072378617,"ci_low":-0.23371264998879615,"coef":-0.057434409632505,"p":0.5228262373793001,"se":0.08985901415295884,"t":-0.6391613593127076,"term":"city_pittsfield, ma"},{"ci_high":0.1390632671571216,"ci_low":-0.053088662784499446,"coef":0.04298730218631108,"p":0.38024450587488434,"se":0.04897536688942294,"t":0.877733132318707,"term":"city_pittston, pa"},{"ci_high":0.2712284182487119,"ci_low":-0.028643720474337733,"coef":0.12129234888718708,"p":0.11275689074802239,"se":0.07643091598579958,"t":1.5869540136052078,"term":"city_plattsburg, ny"},{"ci_high":0.14418224933546395,"ci_low":-0.0754062430854453,"coef":0.034388003125009316,"p":0.5390420530808079,"se":0.05596835266903992,"t":0.6144187113806509,"term":"city_pocatello, id"},{"ci_high":-0.03171158260697576,"ci_low":-0.4874978706755974,"coef":-0.2596047266412866,"p":0.025600190181011083,"se":0.11617005714233962,"t":-2.2346956954940707,"term":"city_port chester, ny"},{"ci_high":-0.03766983005439595,"ci_low":-0.4028989281453459,"coef":-0.22028437909987092,"p":0.018103073205549103,"se":0.09308898996295145,"t":-2.3663848881327647,"term":"city_port huron, mi"},{"ci_high":0.161297984350535,"ci_low":-0.11313219337635493,"coef":0.02408289548709004,"p":0.730670136806013,"se":0.06994631094148973,"t":0.34430544174424643,"term":"city_port jervis, ny"},{"ci_high":0.20951715494285805,"ci_low":-0.10598198322565601,"coef":0.051767585858601015,"p":0.5198375690829158,"se":0.08041389982288595,"t":0.6437641498872793,"term":"city_portland, or"},{"ci_high":0.10713719669197541,"ci_low":-0.22515505349205778,"coef":-0.05900892840004118,"p":0.48609149373996463,"se":0.08469410050796417,"t":-0.6967300915427079,"term":"city_portsmouth, oh"},{"ci_high":0.22345986686412955,"ci_low":-0.03363934411755236,"coef":0.0949102613732886,"p":0.14774550466577388,"se":0.06552902273026631,"t":1.4483698584055305,"term":"city_pottsville, pa"},{"ci_high":0.05173530576007576,"ci_low":-0.1774539286380702,"coef":-0.06285931143899721,"p":0.28208578872689805,"se":0.05841537394480179,"t":-1.0760747932281425,"term":"city_poughkeepsie, ny"},{"ci_high":0.09740275503430958,"ci_low":-0.22276000998110618,"coef":-0.0626786274733983,"p":0.44256406971333706,"se":0.08160255733952794,"t":-0.7680963626251089,"term":"city_quincy, ma"},{"ci_high":0.08770933061946289,"ci_low":-0.31712204118777226,"coef":-0.1147063552841547,"p":0.2664727651217707,"se":0.10318275215154712,"t":-1.1116814864143434,"term":"city_racine, wi"},{"ci_high":0.22390116225584036,"ci_low":-0.20675862737791537,"coef":0.008571267438962487,"p":0.9377705405366469,"se":0.10976585667519917,"t":0.07808682680193671,"term":"city_rahway, nj"},{"ci_high":0.09251624809403701,"ci_low":-0.0932558789498371,"coef":-0.00036981542790005025,"p":0.9937694431810176,"se":0.047349293252305226,"t":-0.007810368487011062,"term":"city_reading, pa"},{"ci_high":0.019270478715941272,"ci_low":-0.22975453787821304,"coef":-0.10524202958113589,"p":0.09752727502739855,"se":0.06347108538565664,"t":-1.658109813967649,"term":"city_revere, ma"},{"ci_high":0.11437775711266537,"ci_low":-0.15067706515015225,"coef":-0.018149654018743445,"p":0.788233902684692,"se":0.06755673580835837,"t":-0.26865794804280496,"term":"city_rochester, mn"},{"ci_high":0.13951903743351282,"ci_low":-0.11993380801586687,"coef":0.00979261470882297,"p":0.882298787892421,"se":0.0661289132003444,"t":0.14808370854599148,"term":"city_rochester, ny"},{"ci_high":0.18362002041114284,"ci_low":-0.11580265500043142,"coef":0.0339086827053557,"p":0.6568842591594389,"se":0.07631635751849962,"t":0.44431736272444605,"term":"city_rome, ny"},{"ci_high":0.07231637631056181,"ci_low":-0.45646880591994105,"coef":-0.19207621480468962,"p":0.1543439044107556,"se":0.134775894852044,"t":-1.4251525839657715,"term":"city_rutherford, nj"},{"ci_high":0.15526806962924555,"ci_low":-0.0663600332445931,"coef":0.04445401819232622,"p":0.4314425816407425,"se":0.05648820521631367,"t":0.7869610659799827,"term":"city_salem, ma"},{"ci_high":0.35733800879558,"ci_low":-0.2628869448468385,"coef":0.047225531974370724,"p":0.7651836616368572,"se":0.15808191293130094,"t":0.29874089387375985,"term":"city_salem, oh"},{"ci_high":0.2534440786288371,"ci_low":-0.09745173954231715,"coef":0.07799616954326,"p":0.38331321622895054,"se":0.08943574722417665,"t":0.8720916631663781,"term":"city_salem, or"},{"ci_high":0.04720511539699583,"ci_low":-0.22974960485800378,"coef":-0.09127224473050398,"p":0.19623351353406618,"se":0.07058976217603985,"t":-1.2929954984532352,"term":"city_salt lake city, ut"},{"ci_high":-0.014799229969999966,"ci_low":-0.2906638468296602,"coef":-0.15273153839983006,"p":0.030013889898839734,"se":0.07031191842109877,"t":-2.172199846477227,"term":"city_san antonio, tx"},{"ci_high":0.15009885808107437,"ci_low":-0.16704440697871198,"coef":-0.008472774448818799,"p":0.9165355183664338,"se":0.08083295217243712,"t":-0.10481832249234482,"term":"city_sandusky, oh"},{"ci_high":0.15977180195993257,"ci_low":-0.15492598692235088,"coef":0.002422907518790843,"p":0.975906279803069,"se":0.08020965323888524,"t":0.030207181068029224,"term":"city_saratoga springs, ny"},{"ci_high":0.04389980186675345,"ci_low":-0.2128024935892297,"coef":-0.08445134586123813,"p":0.19700925969690378,"se":0.06542785755591127,"t":-1.2907551770141699,"term":"city_scranton, pa"},{"ci_high":0.21612605459171846,"ci_low":-0.16739423167919615,"coef":0.024365911456261168,"p":0.8031936338368748,"se":0.09775101782928311,"t":0.24926504089005927,"term":"city_shaker heights, oh"},{"ci_high":0.21232934683943472,"ci_low":-0.3357338046296111,"coef":-0.06170222889508819,"p":0.6587696580410525,"se":0.13968943184658525,"t":-0.44171007125902717,"term":"city_sharon, pa"},{"ci_high":0.25865460041202704,"ci_low":-0.19512213141714552,"coef":0.03176623449744075,"p":0.7836217828646357,"se":0.115657864763414,"t":0.27465693372794614,"term":"city_sheboygan, wi"},{"ci_high":-0.031178369741495016,"ci_low":-0.23544410097631563,"coef":-0.13331123535890532,"p":0.010557596430966482,"se":0.05206291257756805,"t":-2.5605796671533914,"term":"city_shorewood, wi"},{"ci_high":0.1243149225131801,"ci_low":-0.6951449915390333,"coef":-0.2854150345129266,"p":0.17200282783608595,"se":0.20886259094080042,"t":-1.3665206068128497,"term":"city_shreveport, la"},{"ci_high":0.05908276999363541,"ci_low":-0.17017548333684637,"coef":-0.05554635667160548,"p":0.3419775412089917,"se":0.05843296537640745,"t":-0.9505996540444711,"term":"city_sioux city, ia"},{"ci_high":0.031490202135220385,"ci_low":-0.3572029171514147,"coef":-0.16285635750809718,"p":0.10043755016942812,"se":0.09906946097414042,"t":-1.6438603370478286,"term":"city_somerville, ma"},{"ci_high":0.08291989942861015,"ci_low":-0.12602297798912082,"coef":-0.021551539280255338,"p":0.6857726262106721,"se":0.053255015880267605,"t":-0.40468562301641814,"term":"city_south milwaukee, wi"},{"ci_high":0.04960505198848171,"ci_low":-0.27989141391506056,"coef":-0.11514318096328942,"p":0.17058570219718433,"se":0.08398151562306437,"t":-1.3710538576141977,"term":"city_south orange, nj"},{"ci_high":0.22792820374906367,"ci_low":-0.21497215407850614,"coef":0.0064780248352787565,"p":0.9542464392785839,"se":0.11288571250183167,"t":0.05738569294297225,"term":"city_spartanburg, sc"},{"ci_high":0.038531197237327924,"ci_low":-0.225654770437041,"coef":-0.09356178659985653,"p":0.16491219740138652,"se":0.0673352835842992,"t":-1.3894912387607832,"term":"city_springfield, ma"},{"ci_high":0.16430005131935557,"ci_low":-0.1231966188029602,"coef":0.02055171625819768,"p":0.7791618715121021,"se":0.07327667696601137,"t":0.28046736163718755,"term":"city_springfield, oh"},{"ci_high":0.2426019301319057,"ci_low":-0.20228127257447556,"coef":0.020160328778715077,"p":0.8589108937910835,"se":0.11339109673322663,"t":0.177794636082813,"term":"city_st. augustine, fl"},{"ci_high":0.10419517696334024,"ci_low":-0.16997406891829653,"coef":-0.032889445977478136,"p":0.6379613447243493,"se":0.06987980506325947,"t":-0.4706573801644781,"term":"city_st. cloud, mn"},{"ci_high":0.21078914054945797,"ci_low":-0.05488025370044726,"coef":0.07795444342450535,"p":0.2498364861885961,"se":0.0677133769025005,"t":1.1512414088688976,"term":"city_steubenville, oh"},{"ci_high":0.1302680197345185,"ci_low":-0.5081671477903514,"coef":-0.1889495640279165,"p":0.24577737276733774,"se":0.16272330220227463,"t":-1.161170904662696,"term":"city_stevens point, wi"},{"ci_high":-0.11282947619448308,"ci_low":-0.30649118649946167,"coef":-0.20966033134697237,"p":2.3089257850310096e-05,"se":0.04936017721758538,"t":-4.247560344501304,"term":"city_struthers, oh"},{"ci_high":0.19236368704928056,"ci_low":0.0006936996092348491,"coef":0.0965286933292577,"p":0.04836687401031654,"se":0.048852530179734774,"t":1.9759200388212477,"term":"city_sunbury, pa"},{"ci_high":0.03420676539916774,"ci_low":-0.2075641846397619,"coef":-0.08667870962029708,"p":0.1597712691873741,"se":0.061622180869889576,"t":-1.4066154166681055,"term":"city_superior, wi"},{"ci_high":0.026655745769054842,"ci_low":-0.19463805454368238,"coef":-0.08399115438731378,"p":0.1366874931020712,"se":0.05640299873107572,"t":-1.4891256897133403,"term":"city_syracuse, ny"},{"ci_high":0.15303959812388196,"ci_low":-0.0506814571324649,"coef":0.05117907049570852,"p":0.3244803522531385,"se":0.05192408646278632,"t":0.9856518233091738,"term":"city_taunton, ma"},{"ci_high":0.1021827241288059,"ci_low":-0.25491168839362527,"coef":-0.07636448213240969,"p":0.40160305264176943,"se":0.09101563472592968,"t":-0.8390259801226659,"term":"city_teaneck, nj"},{"ci_high":0.2095029651862853,"ci_low":-0.11243801189339908,"coef":0.04853247664644312,"p":0.5543130665538435,"se":0.08205578509675741,"t":0.5914570994502735,"term":"city_tiffin, oh"},{"ci_high":0.047349079749824774,"ci_low":-0.2210154219764588,"coef":-0.08683317111331701,"p":0.20448653505861608,"se":0.06840030144966563,"t":-1.269485210927261,"term":"city_toledo, oh"},{"ci_high":0.1867165742442693,"ci_low":-0.12204232708469598,"coef":0.03233712357978666,"p":0.6812020919964846,"se":0.07869595937732916,"t":0.41091212097355,"term":"city_tonawanda, ny"},{"ci_high":0.05763082049418196,"ci_low":-0.24508847741110013,"coef":-0.09372882845845908,"p":0.22465945682387736,"se":0.07715659522089646,"t":-1.2147869950730321,"term":"city_topeka, ks"},{"ci_high":0.1484443717900563,"ci_low":-0.05346859002753002,"coef":0.04748789088126313,"p":0.35630028144272996,"se":0.05146324259012493,"t":0.9227535711163173,"term":"city_trenton, nj"},{"ci_high":0.06269366806601277,"ci_low":-0.15219491680131542,"coef":-0.04475062436765133,"p":0.4140393199688156,"se":0.05477044798573576,"t":-0.8170578480443695,"term":"city_troy, ny"},{"ci_high":0.24090965328284047,"ci_low":-0.5241771017836321,"coef":-0.14163372425039578,"p":0.4677734236674109,"se":0.1950040498838741,"t":-0.7263117065247587,"term":"city_tuscaloosa, al"},{"ci_high":-0.0979916289199024,"ci_low":-0.34442098649345265,"coef":-0.2212063077066775,"p":0.0004427884571760982,"se":0.06280950809682823,"t":-3.5218602152664853,"term":"city_two rivers, wi"},{"ci_high":0.4337854355371209,"ci_low":0.2635064865477882,"coef":0.34864596104245454,"p":2.049390355236279e-15,"se":0.04340041759055749,"t":8.033239779663054,"term":"city_union, nj"},{"ci_high":0.12205448049100921,"ci_low":-0.2665186027584846,"coef":-0.07223206113373769,"p":0.4659258763886055,"se":0.09903886638703044,"t":-0.7293304514559426,"term":"city_uniontown, pa"},{"ci_high":0.1463724925635468,"ci_low":-0.11566618201246218,"coef":0.015353155275542315,"p":0.8182205679063326,"se":0.06678798506201397,"t":0.22987900086050814,"term":"city_utica, ny"},{"ci_high":0.22721388465807235,"ci_low":-0.11769342243851683,"coef":0.05476023110977776,"p":0.5334443598305028,"se":0.08790940540139452,"t":0.6229166362773407,"term":"city_waco, tx"},{"ci_high":0.0989373226556062,"ci_low":-0.26820479667496977,"coef":-0.0846337370096818,"p":0.3659270194421038,"se":0.09357657766038655,"t":-0.904432916074783,"term":"city_waltham, ma"},{"ci_high":0.13604787793410777,"ci_low":-0.11108996150818302,"coef":0.012478958212962379,"p":0.8429888767289886,"se":0.06299008478667265,"t":0.19810988118566017,"term":"city_warren, oh"},{"ci_high":0.18478205751542118,"ci_low":-0.06428794168470309,"coef":0.06024705791535904,"p":0.3427732515586018,"se":0.06348255047805353,"t":0.9490333558067579,"term":"city_washington, pa"},{"ci_high":0.23684541371221646,"ci_low":-0.05896156525372648,"coef":0.08894192422924499,"p":0.23833402708162704,"se":0.0753947947736478,"t":1.17968255628613,"term":"city_waterloo, ia"},{"ci_high":0.08861481094887469,"ci_low":-0.17862756073780556,"coef":-0.045006374894465434,"p":0.5088865883683816,"se":0.06811429479647245,"t":-0.660747865465624,"term":"city_watertown, ny"},{"ci_high":-0.057722111153950484,"ci_low":-0.22471237171292863,"coef":-0.14121724143343956,"p":0.0009310731348993083,"se":0.04256220210913845,"t":-3.3179026092524255,"term":"city_watertown, wi"},{"ci_high":0.4716791711348193,"ci_low":-0.10130015190300543,"coef":0.18518950961590694,"p":0.20498996551544701,"se":0.1460400245490967,"t":1.2680736680761697,"term":"city_watervliet, ny"},{"ci_high":0.1296394738042384,"ci_low":-0.22434443575137675,"coef":-0.047352480973569165,"p":0.5997810203727713,"se":0.09022283486148525,"t":-0.5248392055765831,"term":"city_waukesha, wi"},{"ci_high":0.3308496705883756,"ci_low":-0.23513520244495947,"coef":0.047857234071708075,"p":0.7401300995038539,"se":0.14425729067146312,"t":0.3317491535363707,"term":"city_wausau, wi"},{"ci_high":0.07842417875156178,"ci_low":-0.26599561595187704,"coef":-0.09378571860015762,"p":0.2855510406052694,"se":0.08778514904693098,"t":-1.068355178733235,"term":"city_wauwatosa, wi"},{"ci_high":0.08686717398480863,"ci_low":-0.12487048823965512,"coef":-0.019001657127423244,"p":0.7248215510354313,"se":0.05396734602094487,"t":-0.3520954526844557,"term":"city_west allis, wi"},{"ci_high":0.10386367438233751,"ci_low":-0.5911949742805427,"coef":-0.24366564994910256,"p":0.16922462240155603,"se":0.17715540165676824,"t":-1.375434492374076,"term":"city_west orange, nj"},{"ci_high":0.29094894521619463,"ci_low":0.0351901534889322,"coef":0.16306954935256343,"p":0.012482512992087932,"se":0.06518737888213642,"t":2.5015509466549526,"term":"city_westfield, ma"},{"ci_high":0.11246076988188101,"ci_low":-0.2929082127927025,"coef":-0.09022372145541076,"p":0.3826833424082338,"se":0.10331977752246131,"t":-0.8732473454639067,"term":"city_white plains, ny"},{"ci_high":0.12212948126519135,"ci_low":-0.15727539251322747,"coef":-0.01757295562401806,"p":0.805130055730731,"se":0.07121425326380215,"t":-0.24676177617030923,"term":"city_williamsport, pa"},{"ci_high":-0.08339439089445669,"ci_low":-0.4188018592027508,"coef":-0.25109812504860374,"p":0.003367678929937194,"se":0.08548810216395904,"t":-2.9372289089658175,"term":"city_woburn, ma"},{"ci_high":0.21876703214659426,"ci_low":-0.06702871864325284,"coef":0.0758691567516707,"p":0.29781055269503237,"se":0.07284314945274478,"t":1.0415414122214603,"term":"city_wooster, oh"},{"ci_high":0.03484799551768823,"ci_low":-0.2026270190471779,"coef":-0.08388951176474484,"p":0.16598172115404988,"se":0.06052723992373583,"t":-1.3859794675991408,"term":"city_worcester, ma"},{"ci_high":0.26277020980128935,"ci_low":-0.06922088177319313,"coef":0.0967746640140481,"p":0.2529612635178951,"se":0.08461734169841624,"t":1.1436741224861642,"term":"city_xenia, oh"},{"ci_high":0.012380412888841008,"ci_low":-0.21991292146452543,"coef":-0.10376625428784221,"p":0.07989482589513082,"se":0.0592065418202145,"t":-1.7526146790153174,"term":"city_yonkers, ny"},{"ci_high":0.15467121454269728,"ci_low":-0.021038884389669207,"coef":0.06681616507651403,"p":0.13594769812916851,"se":0.044784700127674666,"t":1.491941776678885,"term":"city_york, pa"},{"ci_high":-0.05865913043893156,"ci_low":-0.3294630004165899,"coef":-0.19406106542776072,"p":0.005001061786663765,"se":0.06902204360508289,"t":-2.8115809861861254,"term":"city_youngstown, oh"},{"ci_high":0.1479793961969207,"ci_low":-0.05984351625428217,"coef":0.044067939971319255,"p":0.4055850040673728,"se":0.05296956105732786,"t":0.8319483698123424,"term":"city_zanesville, oh"},{"ci_high":0.04662495033414296,"ci_low":-0.3844163674878325,"coef":-0.16889570857684477,"p":0.12444679491507872,"se":0.10986309995036375,"t":-1.5373288087915962,"term":"treat_actual"}],"first_stage":[{"ci_high":0.20660824528259575,"ci_low":0.09421239119467756,"coef":0.15041031823863665,"endog":"treat_actual","instrument":"treat_assign","p":1.7605899673074598e-07,"se":0.028647269858170236,"t":5.250424175961726}],"reduced_form":[{"ci_high":0.006303855283519944,"ci_low":-0.05711116983588663,"coef":-0.02540365727618334,"instrument":"treat_assign","p":0.11625288212587427,"se":0.016163116979717528,"t":-1.57170534050217}]},"tool":"infer.iv_2sls","version":"0.1.0","warnings":[]},"result_for_model_ref":"64ff7406ad39482c25353bd96c57cb3e1cdffa06089cd6e3f6534ed893d6590e","result_sha256":"d18a4eeb1588a54a287377b97c40c799e101a415a70bf35b8df12ef9ad9b1c7c","run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":7,"synthetic":false,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.051452Z","tool_id":"infer.iv_2sls","turn_id":"call_7cab9deb"}
{"attempt":1,"attempts":[],"call_id":"call_eaa3fed6","epoch":1,"event":"model","finish_reason":"tool_use","latency_ms":0.0,"model_reported":"reference","model_requested":"reference","provider":"scripted","request":{"config":{},"contents_refs":[],"messages_refs":["3cd6d0361e36ea0ca3ad9caef752058bb923038e1baab70b1b2b0e4a21e23709","8c6f23dff2f069ce131aa452d0c23235b84455f99d57bfb8c7d6cf593655cdd8","5241665f8f451d79b36f72288feb030944133ff0cb791fc47897b36f4cc6681a"],"system_stable_ref":"433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420","system_task_ref":"b2d8bd4b0d3515c1fd43a0f2b1d0c30cdee6df462a9d8fe09c9ed979b694cb67","tools_ref":"52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b"},"response":{"text":"","thoughts":null,"tool_calls":[{"args":{"answer":"Estimativa (infer.iv_2sls): coef.treat_actual = -0,1689. Reference path transcribed from the item's own estimation script.","caveats":[],"figure_refs":["call_e4725933:coef.treat_actual"]},"llm_name":"submit_answer","tool_id":null,"vendor_id":"script_2"}]},"response_id":null,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":8,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.229543Z","usage":{"cached":0,"input":0,"output":0,"thoughts":0},"vendor":false}
{"attempt":1,"call_id":"call_c010a2dc","epoch":1,"event":"guard","numbers_found":["-0,1689"],"retries_left":1,"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":9,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.231458Z","turn_id":"call_eaa3fed6","unbacked":[],"uncited":[],"verdict":"accepted"}
{"answer":"Estimativa (infer.iv_2sls): coef.treat_actual = -0,1689. Reference path transcribed from the item's own estimation script.","answer_figure":{"call_id":"call_e4725933","ci_high":0.04662495033414296,"ci_low":-0.3844163674878325,"formatted":-0.16889570857684477,"key":"coef.treat_actual","ref":"call_e4725933:coef.treat_actual","se":0.10986309995036375,"tool_id":"infer.iv_2sls","unit":"","value":-0.16889570857684477},"attempt":1,"caveats":[],"epoch":1,"event":"answer","figure_refs":["call_e4725933:coef.treat_actual"],"run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":10,"stopped":"answered","task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.231944Z"}
{"attempt":1,"check":{"check_index":0,"detail":"every number backed","expected":null,"failure_class":null,"kind":"answer_backed","observed":[],"passed":true,"required":true,"source_id":null,"tolerance":null,"trace_call_id":null,"weight":1.0},"epoch":1,"event":"score","run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":11,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.231944Z"}
{"attempt":1,"check":{"check_index":1,"detail":"-0.1688957086 in [-0.3617225472, 0.02393113006]?","expected":[-0.36172254721849234,0.02393113006444131],"failure_class":null,"kind":"answer_figure_close","observed":-0.16889570857684477,"passed":true,"required":true,"source_id":null,"tolerance":{"abs_tol":null,"interval":[-0.36172254721849234,0.02393113006444131],"min_lre":null,"open_interval":false,"rel_tol":null,"rule":"interval"},"trace_call_id":"call_e4725933","weight":1.0},"epoch":1,"event":"score","run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":12,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.231944Z"}
{"attempt":1,"check":{"check_index":2,"detail":"-0.1688957086 vs -0.16889570857702552","expected":-0.16889570857702552,"failure_class":null,"kind":"answer_figure_close","observed":-0.16889570857684477,"passed":true,"required":false,"source_id":"crb_papers.q074.gold","tolerance":{"abs_tol":9.838104012319735e-08,"interval":null,"min_lre":null,"open_interval":false,"rel_tol":1e-06,"rule":null},"trace_call_id":"call_e4725933","weight":1.0},"epoch":1,"event":"score","run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":13,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.231944Z"}
{"attempt":1,"check":{"check_index":3,"detail":"0.1098631 vs 0.09838104012319736","expected":0.09838104012319736,"failure_class":null,"kind":"answer_figure_close","observed":0.10986309995036375,"passed":false,"required":false,"source_id":"crb_papers.q074.gold","tolerance":{"abs_tol":9.838104012319735e-08,"interval":null,"min_lre":null,"open_interval":false,"rel_tol":1e-06,"rule":null},"trace_call_id":"call_e4725933","weight":1.0},"epoch":1,"event":"score","run_id":"20261015T170050Z-suite-crb_papers-scripted-8b13b2","seq":14,"task_id":"crb_papers.q074","timestamp":"2026-10-15T17:00:55.231944Z"}