Pular para o conteúdo

Tarefa crb_papers.q066

crb_papersagentT2publicépoca 1, tentativa 1Execução: 20261015T171027Z-suite-crb_papers-naive-54c3f2

Veredito

falhouDecidida pela verificação 1: figura da resposta próxima, fora da tolerância.
-0.02591471205 in [-0.149966335, -0.04607354069]?

Família do método (das chamadas de ferramentas): ols (regression)

Pergunta feita ao analista

What is the causal effect of an additional unit of educational attainment (one category on the 7-point edu scale, ~2-4 years) on noncontentious political participation (the participation scale, 0-1) for individuals born 1959-1971 who were induced to attain more schooling by the 1980 expansion of secondary education (i.e., the complier population among these cohorts)?

Resposta

Estimativa ingênua (infer.ols): coef.edu = -0,02591.

Valores esperados e de onde vêm

crb_papers.q066.gold

Fonte
CausalReasoningBenchmark, causal_queries.json, index 66 (revision edd0fe1c1d1c)
Tipo
benchmark_gold
Localização
causal_queries.json['66'].effect and .standard_error
Trecho
index 66: effect -0.0980199, standard_error 0.0265033
Valor como publicado
-0.09801993782056861
Erro-padrão como publicado
0.026503263844653523
Valor
-0,0980199-0.09801993782056861 (se 0,02650330.026503263844653523)
Conferido por
arquivo do benchmark · Read from the catalog at the pinned revision by scripts/freeze_crb_papers.py; the catalog states the value its estimation script prints.
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json
Licença
MIT
  • #2 figura da resposta próxima: -0,0980199-0.09801993782056861 · relativa 0.000001 · absoluta 2.6503263844653523e-8
  • #3 figura da resposta próxima: 0,02650330.026503263844653523 · relativa 0.000001 · absoluta 2.6503263844653523e-8

crb_papers.q066.script

Fonte
CausalReasoningBenchmark reference estimation script for index 66
Tipo
software
Localização
solutions/research_papers/IV/Croke2016/question/estimation.py
Valor
—
Conferido por
arquivo do benchmark · sha256 of the script's 486 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
Implementação
independente da ferramenta
sha256 da cópia lida
5204e70c5d76350f8ef32eca973385ec5256acd4e0f4a4d3e3e73de5be45ad1c (identifica a cópia lida, não um arquivo canônico)
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/IV/Croke2016/question/estimation.py
Licença
MIT

    Verificações

    Cada verificação, o que esperava, o que observou e a chamada que leu
    #VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
    0resposta com lastro
    every number backed
    obrigatóriapassou—[]———
    1figura da resposta próxima
    -0.02591471205 in [-0.149966335, -0.04607354069]?
    obrigatóriafalhou[-0.14996633495608952,-0.04607354068504771]-0,0259147-0.02591471204941924interval · [-0.14996633495608952, -0.04607354068504771]—call_bcee0872
    2figura da resposta próxima
    -0.02591471205 vs -0.09801993782056861
    registradafalhou-0,0980199-0.09801993782056861-0,0259147-0.02591471204941924relativa 0.000001 · absoluta 2.6503263844653523e-8crb_papers.q066.goldcall_bcee0872
    3figura da resposta próxima
    0.00563020315 vs 0.026503263844653523
    registradafalhou0,02650330.0265032638446535230,00563020.005630203149506356relativa 0.000001 · absoluta 2.6503263844653523e-8crb_papers.q066.goldcall_bcee0872

    Caminho de referência e caminho do agente

    A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

    caminho de referência do item · benchmark_script

    Referência: infer.iv_2slsChamada do agente: infer.ols (call_bcee0872)diferente
    Argumentos da referência e do agente
    ArgumentoReferênciaAgente
    cluster"district"—diferente
    controls—[]não fixado pela referência
    dataset"ref_iv""ds_0036"diferente
    endog["edu"]—ausente
    exog["year_survey_2004.0","year_survey_2005.0","year_survey_2009.0","year_survey_2010.0","year_survey_2012.0"]—ausente
    fe—[]não fixado pela referência
    instruments["treatment"]—ausente
    intercept—truenão fixado pela referência
    level—0,950.95não fixado pela referência
    se—"HC1"não fixado pela referência
    subset——não fixado pela referência
    weights——não fixado pela referência
    x—["edu"]não fixado pela referência
    y"part_scale""part_scale"igual

    Pendências do caminho de referência: needs_op:iv_cluster_cr0

    Trajetória

    Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

    1. 0Início

      What is the causal effect of an additional unit of educational attainment (one category on the 7-point edu scale, ~2-4 years) on noncontentious political participation (the participation scale, 0-1) for individuals born 1959-1971 who were induced to attain more schooling by the 1980 expansion of secondary education (i.e., the complier population among these cohorts)?

      ds_0036 (agent)

      | Variable Name | Description | |---------------|-------------| | row_id | Internal row/case identifier (original CSV index). | | age | Respondent age in years at the time of interview. | | year_survey | Survey round year (e.g., 2004, 2005, 2009, 2010, 2012). | | voted | Binary indicator for whether the respondent reported voting in the most recent national election. | | contacted_local_govt | Binary indicator for whether the respondent reported contacting their local government/councilor. | | district | Name of the respondent’s sampled administrative district. | | events | Count of recorded political/conflict events linked to the respondent’s district (administrative-level event tally). | | d_incumbent | District-level share (proportion) of votes for the incumbent party/candidate at the most recent relevant election. | | d_turnout | District-level turnout proportion at the most recent relevant election. | | year_birth | Respondent birth year. | | good_own_liv_cond | Self-reported indicator that respondent rates their living conditions as good. | | gift_for_vote | Binary indicator for whether the respondent reported receiving a gift linked to voting or campaign activity. | | freedom_vote | Indicator capturing the respondent’s perception that their vote was free (perceived electoral freedom). | | find_out_vote | Indicator of whether the respondent sought out information about the election/voting (e.g., to find out results or how to vote). | | att_comm_meet | Binary indicator for attendance at a local/community meeting in the past 12 months. | | raise_issue | Binary indicator for whether the respondent reports raising an issue at a community meeting. | | close_inc_party | Indicator for feeling close to the incumbent party (self-reported party closeness to ruling party). | | close_main_opp_party | Indicator for feeling close to the main opposition party (self-reported closeness). | | fear | Self-reported indicator of fear of political violence or repression (response to safety/fear question). | | int_pub_aff | Indicator of interest in public affairs or politics (self-reported political interest). | | employed | Binary indicator for current employment status. | | supp_demo | Indicator for expressed support for democracy (attitudinal item). | | only_national_identity | Indicator that respondent identifies only with a national identity (vs. ethnic/local identity). | | some_national_identity | Indicator that respondent expresses some national identity (as opposed to exclusively local/ethnic). | | ndebele | Binary indicator for membership in the Ndebele ethnic group. | | shona | Binary indicator for membership in the Shona ethnic group. | | running | Numerically coded running variable derived from birth year relative to the cohort cutoff (standardized cohort position). | | post | Binary indicator for observations surveyed after the 2008 election period (e.g., surveys 2009+). | | treatment | Cohort-based indicator (numeric) denoting eligibility/assignment for the post-independence secondary-school expansion (coded per replication file). | | partial | Numeric/continuous indicator capturing partial exposure/dosage of cohort-level schooling eligibility (fractional exposure). | | any_treatment | Indicator for any exposure to the expanded secondary-schooling cohorts (partially or fully exposed). | | edu | Ordinal education attainment measure (categories from no schooling through completed college). | | a_l_incomplete_primary | Indicator for attained level = incomplete primary (individual-level attained-level dummy). | | a_l_complete_primary | Indicator for attained level = completed primary. | | a_l_incomplete_high | Indicator for attained level = incomplete secondary/high school. | | a_l_complete_high | Indicator for attained level = completed secondary/high school. | | a_l_incomplete_college | Indicator for attained level = incomplete college/university. | | a_l_complete_college | Indicator for attained level = completed college/university. | | male | Binary indicator for respondent sex (male = 1). | | weight_cohort | Cohort-specific sampling/analysis weight (applied in cohort-based aggregation or adjustment). | | comp | Computed/internal variable used in the replication (not explicitly described in the paper). | | closest_border_rebel | Distance (regional/geographic measure) to the closest border used historically by rebel groups entering the country. | | ZIPRA | Geographic distance or proximity measure specifically to the ZIPRA rebel entry border/axis (numeric). | | ZANLA | Geographic distance or proximity measure specifically to the ZANLA rebel entry border/axis (numeric). | | multi | Indicator for multiple local affiliations/memberships (e.g., membership in more than one association or multi‑affiliation flag). | | poverty | Objective deprivation/poverty scale combining items such as going without food, medicine, or cash in the past year. | | incumbent_overall | Composite index summarizing trust in and perceived performance of incumbent authorities (multi-item scale). | | corruption | Perceived corruption index (composite of items asking whether officials/politicians are corrupt). | | news | News-consumption index (frequency of obtaining political news via radio, TV, newspapers). | | part_scale | Summative participation scale combining multiple non-contentious political participation items (composite index). | | view_govt_scale | Aggregate index summarizing overall views of government (trust, performance, and related attitudinal items). | | economic_scale | Composite economic outcomes scale combining employment, living-conditions and poverty indicators. | | mean_incomplete_primary | District-/cohort-level mean proportion of respondents with incomplete primary (contextual aggregate). | | mean_complete_primary | District-/cohort-level mean proportion of respondents with completed primary. | | mean_edu | District-/cohort-level mean of the ordinal education variable (average educational attainment). | | mean_a_l_incomplete_primary | District-level mean of the a_l_incomplete_primary indicator (contextual aggregate). | | mean_a_l_complete_primary | District-level mean of the a_l_complete_primary indicator. | | mean_a_l_incomplete_high | District-level mean of the a_l_incomplete_high indicator. | | mean_a_l_complete_high | District-level mean of the a_l_complete_high indicator. | | mean_a_l_incomplete_college | District-level mean of the a_l_incomplete_college indicator. | | mean_a_l_complete_college | District-level mean of the a_l_complete_college indicator. | | mean_no_schooling | District-level mean proportion with no schooling. | | mean_part_scale | District-/cohort-level mean of the participation scale. | | mean_voted | District-level mean proportion reporting having voted. | | mean_contacted_local_govt | District-level mean of contacting local government. | | mean_att_comm_meet | District-level mean of attending community meetings. | | mean_raise_issue | District-level mean of raising issues at meetings. | | mean_economic_scale | District-level mean of the economic outcomes scale. | | mean_employed | District-level mean employment rate. | | mean_good_own_liv_cond | District-level mean proportion reporting good living conditions. | | mean_poverty | District-level mean of the poverty index. | | mean_news | District-level mean of news-consumption index. | | mean_int_pub_aff | District-level mean proportion interested in public affairs. | | mean_view_govt_scale | District-level mean of the view_govt_scale. | | mean_close_inc_party | District-level mean proportion feeling close to the incumbent party. | | mean_close_main_opp_party | District-level mean proportion feeling close to the main opposition party. | | mean_incumbent_overall | District-level mean of the incumbent_overall composite. | | mean_corruption | District-level mean perception of corruption. | | mean_supp_demo | District-level mean of support-for-democracy indicator. | | mean_multi | District-level mean proportion reporting multiple affiliations/memberships. | | mean_shona | District-level proportion of respondents identifying as Shona. | | mean_ndebele | District-level proportion identifying as Ndebele. | | mean_male | District-level proportion of male respondents. | | mean_d_incumbent | District-level mean of d_incumbent (aggregate incumbent vote share). | | mean_d_turnout | District-level mean turnout. | | mean_closest_border_rebel | District-level mean distance to rebel border. | | mean_ZIPRA | District-level mean distance to ZIPRA border. | | mean_ZANLA | District-level mean distance to ZANLA border. | | mean_gift_for_vote | District-level mean proportion reporting receiving vote-related gifts. | | mean_freedom_vote | District-level mean perception that voting was free. | | mean_find_out_vote | District-level mean of finding out about voting/election info. | | mean_fear | District-level mean of fear/repression indicator. | | mean_age | District-/cohort-level mean age. | | mean_only_national_identity | District-level mean proportion identifying only with national identity. | | mean_some_national_identity | District-level mean proportion expressing some national identity. | | _Iyear_surv_2004 | Survey-year dummy = 1 if observation comes from the 2004 Afrobarometer round. | | _Iyear_surv_2005 | Survey-year dummy = 1 if observation comes from the 2005 round. | | _Iyear_surv_2009 | Survey-year dummy = 1 if observation comes from the 2009 round. | | _Iyear_surv_2010 | Survey-year dummy = 1 if observation comes from the 2010 round. | | _Iyear_surv_2012 | Survey-year dummy = 1 if observation comes from the 2012 round. | Data Description: This dataset is a pooled individual-level compilation used to study political attitudes and social outcomes in Zimbabwe, built from several Zimbabwe rounds of the Afrobarometer (the paper focuses on rounds including 1999, 2004, 2005, 2009, 2010 and 2012). It combines respondent-level survey items (demographics, education categories, political attitudes, civic behaviors, economic self-reports) with district- and cohort-level contextual measures (electoral aggregates, conflict/event tallies, geographic proximity to historical rebel entry borders) and several constructed summary scales (participation, economic outcomes, government views, corruption, news consumption). The sample follows Afrobarometer’s nationally representative multi‑stage survey design; variables are a mixture of self-reported answers, derived attainment-category dummies, cohort indicators (based on birth year), and administrative/geographic linkages merged into the individual file for analysis and robustness checks.

      file d3ada3e174d60cc0240447a6ae594b6bdcbcb786b3a4eb25667528967c0b70e4 · frame —
      ref_iv (reference)
      file d3ada3e174d60cc0240447a6ae594b6bdcbcb786b3a4eb25667528967c0b70e4 · frame —
      1. filter {"query":"year_birth >= 1959 and year_birth <= 1971"}
      2. select {"columns":["part_scale","edu","treatment","year_survey","district"]}
      3. dropna {"columns":["part_scale","edu","treatment","year_survey","district"]}
      4. dummies {"column":"year_survey","drop_first":true,"prefix":"year_survey"}
    2. 1Turno do modelo
      call_93c36efbnaive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Texto visível

      Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Chamadas pedidas
      • infer.ols
        {
          "dataset": "ds_0036",
          "x": [
            "edu"
          ],
          "y": "part_scale"
        }
    3. 2Ferramenta
      infer.olsv0.1.0call_bcee0872decidido pelo modeloreexecutável

      Motivo: Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Argumentos
      {
        "cluster": null,
        "controls": [],
        "dataset": "ds_0036",
        "fe": [],
        "intercept": true,
        "level": 0.95,
        "se": "HC1",
        "subset": null,
        "weights": null,
        "x": [
          "edu"
        ],
        "y": "part_scale"
      }
      Figuras call_bcee0872
      ChaveValorValor brutoErro-padrãoIC
      coef.edu
      Coefficient on edu in the regression of part_scale
      -0,0259147 -0.025914712049419240,00563020.005630203149506356-0,036957 – -0,0148725
      Diagnósticos
      • n_obs = 1.8421842
      • k = 22
      • r2 = 0,01224210.01224205869736561
      • df_resid = 1.8401840
      • se_type = "HC1"
      • n_clusters = —
      Tabelas (1)
      {
        "coefficients": [
          {
            "ci_high": 0.7571145415831686,
            "ci_low": 0.6889888145089926,
            "coef": 0.7230516780460806,
            "p": 1.7702389336633377e-267,
            "se": 0.017367899242829974,
            "t": 41.631498889802664,
            "term": "Intercept"
          },
          {
            "ci_high": -0.014872453058488512,
            "ci_low": -0.036956971040349965,
            "coef": -0.02591471204941924,
            "p": 0.000004453484767947193,
            "se": 0.005630203149506356,
            "t": -4.60280230770916,
            "term": "edu"
          }
        ]
      }
      Digests dos dados
      ds_0036 5bd9a3b32ef1a0364ff60921f4089fff68d5b66574ebae911e9d78e16d0a362a
      sha256 do resultado
      361c0e64d33bf4cfb85e4a2f9f20e7b122ad831148f2b237bdf2b30744cf256b
    4. 3Turno do modelo
      call_d67de4e8naive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Chamadas pedidas
      • submit_answer (meta-ferramenta)
        {
          "answer": "Estimativa ingênua (infer.ols): coef.edu = -0,02591.",
          "caveats": [],
          "figure_refs": [
            "call_bcee0872:coef.edu"
          ]
        }
    5. 4Guarda
      resposta aceita
      Números encontrados
      -0,02591
      Sem lastro
      —
      Não citados
      —
      1 nova(s) tentativa(s) restante(s)
    6. 5Resposta

      Estimativa ingênua (infer.ols): coef.edu = -0,02591.

      Figuras citadas: call_bcee0872:coef.edu · Parada: answered
      Figura da resposta: call_bcee0872:coef.edu = -0,0259147-0.02591471204941924 (se 0,00563020.005630203149506356)
    7. 6Pontuação
      #0resposta com lastropassouobrigatóriaevery number backed
    8. 7Pontuação
      #1figura da resposta próximafalhouobrigatória-0.02591471205 in [-0.149966335, -0.04607354069]?
    9. 8Pontuação
      #2figura da resposta próximafalhouregistrada-0.02591471205 vs -0.09801993782056861
    10. 9Pontuação
      #3figura da resposta próximafalhouregistrada0.00563020315 vs 0.026503263844653523

    Épocas × verificações

    Resultado de cada verificação em cada época pontuada
    #0123
    Época 1passoufalhoufalhoufalhou

    Tentativas

    Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

    Downloads desta tarefa

    Pacote da tarefa (.zip)
    112,1 KB · sha256 b3591f70aba2205d26a9d1a5a0b42feec9400bc54ccb6a886b229e54ecc51ba5

    O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

    Downloads desta tarefa
    ArquivoTamanhosha256
    attachments/0f361a9e281e62e6c6187bca4f6de5082c237b25dde56c7ef27cfb69fac5725d.json226 B0f361a9e281e62e6c6187bca4f6de5082c237b25dde56c7ef27cfb69fac5725d
    attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
    attachments/50cda876be57ae95d7a8fa90f1f67015bc1e573c93472e969122cb8c46474d92.json394 B50cda876be57ae95d7a8fa90f1f67015bc1e573c93472e969122cb8c46474d92
    attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
    attachments/6fa1185b7a2d22e6f3026d44936cfb311a42c852c5c7400993ce0cf9ddbbcf71.json14,3 KB6fa1185b7a2d22e6f3026d44936cfb311a42c852c5c7400993ce0cf9ddbbcf71
    attachments/d66a3104a6223c488f097e45fca6403beb05fbd404273d8c227a1aafb7e16215.json985 Bd66a3104a6223c488f097e45fca6403beb05fbd404273d8c227a1aafb7e16215
    attachments/f567f545b7b89e25aa597895d5d5d0b01bc4f0617d45469b1497bbc13733938e.json879 Bf567f545b7b89e25aa597895d5d5d0b01bc4f0617d45469b1497bbc13733938e
    native/crb_papers/crb_papers.q066.e1.a1.json4,1 KBdef5bc173b2051d2edf842b2a938c15d3460646caad65f47da9f8482141fb7a9
    sources/crb_papers.q066.gold.json1,1 KB612594e7c68b88d298ef1d174906185cc29b74561eb537b3a994c50af8b87fda
    sources/crb_papers.q066.script.json1,1 KB85e4df2cef484d1c753ae3643cc243181e1abf6d865f2b41a98d81a46e7cfbb7
    specs/crb_papers.q066.json17,5 KB8690d4e8edf4f2bc2b146afa0a67f3ebc77da0f521f1fc4962e10036f5bdee27
    traces/crb_papers.q066.e1.a1.jsonl25,3 KB9e0c695b69442d579c0ff88f611c3ef3ac18d146b98ffe82f2c736a56476d1f5
    trajectories/crb_papers.q066.e1.a1.jsonl20,9 KB844a2b4c38128daf3b0be6f74ca688d1602bd547469dea2218fcb884f33394d6