Pular para o conteúdo

Tarefa crb_papers.q073

crb_papersagentT2publicépoca 1, tentativa 1Execução: 20261015T171027Z-suite-crb_papers-naive-54c3f2

Veredito

falhouDecidida pela verificação 1: figura da resposta próxima, fora da tolerância.
-4.418688874 in [1.801054993, 6.056270442]?

Família do método (das chamadas de ferramentas): ols (regression)

Pergunta feita ao analista

What is the causal effect of having municipal direct-democracy institutions (versus representative councils) on women's parliamentary turnout, estimated for municipalities whose institutional status was marginally determined by the 1918 municipal reform?

Resposta

Estimativa ingênua (infer.ols): coef.direct = -4,419.

Valores esperados e de onde vêm

crb_papers.q073.gold

Fonte
CausalReasoningBenchmark, causal_queries.json, index 73 (revision edd0fe1c1d1c)
Tipo
benchmark_gold
Localização
causal_queries.json['73'].effect and .standard_error
Trecho
index 73: effect 3.92866, standard_error 1.08551
Valor como publicado
3.9286627174509476
Erro-padrão como publicado
1.0855141453627462
Valor
3,928663.9286627174509476 (se 1,085511.0855141453627462)
Conferido por
arquivo do benchmark · Read from the catalog at the pinned revision by scripts/freeze_crb_papers.py; the catalog states the value its estimation script prints.
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json
Licença
MIT
  • #2 figura da resposta próxima: 3,928663.9286627174509476 · relativa 0.000001 · absoluta 0.000001085514145362746
  • #3 figura da resposta próxima: 1,085511.0855141453627462 · relativa 0.000001 · absoluta 0.000001085514145362746

crb_papers.q073.script

Fonte
CausalReasoningBenchmark reference estimation script for index 73
Tipo
software
Localização
solutions/research_papers/IV/Kim2019_fuzzyRDD/question/estimation.py
Valor
—
Conferido por
arquivo do benchmark · sha256 of the script's 472 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
Implementação
independente da ferramenta
sha256 da cópia lida
69c7c14e5895cf70cc2afc4b13966602777024a0472d6cd5205f1dc8584016e8 (identifica a cópia lida, não um arquivo canônico)
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/IV/Kim2019_fuzzyRDD/question/estimation.py
Licença
MIT

    Verificações

    Cada verificação, o que esperava, o que observou e a chamada que leu
    #VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
    0resposta com lastro
    every number backed
    obrigatóriapassou—[]———
    1figura da resposta próxima
    -4.418688874 in [1.801054993, 6.056270442]?
    obrigatóriafalhou[1.801054992539965,6.05627044236193]-4,41869-4.418688874133635interval · [1.801054992539965, 6.05627044236193]—call_c662ffd4
    2figura da resposta próxima
    -4.418688874 vs 3.9286627174509476
    registradafalhou3,928663.9286627174509476-4,41869-4.418688874133635relativa 0.000001 · absoluta 0.000001085514145362746crb_papers.q073.goldcall_c662ffd4
    3figura da resposta próxima
    0.5983102935 vs 1.0855141453627462
    registradafalhou1,085511.08551414536274620,598310.5983102935232996relativa 0.000001 · absoluta 0.000001085514145362746crb_papers.q073.goldcall_c662ffd4

    Caminho de referência e caminho do agente

    A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

    caminho de referência do item · benchmark_script

    Referência: infer.iv_2slsChamada do agente: infer.ols (call_c662ffd4)diferente
    Argumentos da referência e do agente
    ArgumentoReferênciaAgente
    cluster——não fixado pela referência
    controls—[]não fixado pela referência
    dataset"ref_iv""ds_0043"diferente
    endog["direct"]—ausente
    exog["left","wm_voters","enep","year_1924","year_1928","year_1932","year_1936","year_1940","year_1944"]—ausente
    fe—[]não fixado pela referência
    instruments["new"]—ausente
    intercept—truenão fixado pela referência
    level—0,950.95não fixado pela referência
    se"HC1""HC1"igual
    subset——não fixado pela referência
    weights——não fixado pela referência
    x—["direct"]não fixado pela referência
    y"wm_turnout""wm_turnout"igual

    Trajetória

    Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

    1. 0Início

      What is the causal effect of having municipal direct-democracy institutions (versus representative councils) on women's parliamentary turnout, estimated for municipalities whose institutional status was marginally determined by the 1918 municipal reform?

      ds_0043 (agent)

      | Variable Name | Description | | --- | --- | | (Unnamed) | Unlabeled column from the original data export (often an empty field or row index placeholder). | | direct | Municipality institutional type indicator for the given observation year: 1 = direct-democracy town meeting as the highest local decision-making body; 0 = representative municipal council. | | area1918 | Municipality land area circa 1918 (units as recorded in historical registers). | | nr_poor_relief1917 | Number of individuals receiving poor relief in 1917 in the municipality (count). | | shareagri1917 | Share of local workforce/economic activity in agriculture in 1917 (proportion). | | taxbase1918 | Municipal tax base in 1918 (monetary taxable-capacity measure as recorded in historical accounts; units as in source). | | year | Observation year (parliamentary election year) for turnout and vote-based variables (e.g., 1921, 1924, 1928, …, 1944). | | wm_voters | Number of eligible female voters in the municipality for the election year `year` (count). | | m_turnout | Men’s turnout in parliamentary elections in `year` (percent, 0–100): (number of male votes cast ÷ number of eligible male voters) × 100. | | wm_turnout | Women’s turnout in parliamentary elections in `year` (percent, 0–100): (number of female votes cast ÷ number of eligible female voters) × 100. | | wv_share | Share of total votes cast that were cast by women in `year` (percent, 0–100): (female votes cast ÷ total votes cast) × 100. | | left | Support for leftist parties in the municipality in `year` (vote share; coding as in source, typically a proportion). | | enep | Effective number of electoral parties in the municipality in `year` (Laakso–Taagepera index computed from party vote shares). | | municipality | Municipality identifier (name or code as provided in the source data). | | county | County identifier (name or code as provided in the source data). | | population | Municipality population size (number of inhabitants) measured in the year *prior* to the election/observation year: Population\_{t−1} for election year t = `year`. This is the population figure used in the statutory 1,500-person benchmark in contemporaneous municipal governance rules. | | over1500 | Indicator based on `population` (i.e., Population\_{t−1} relative to 1,500): 1 if `population` > 1,500; 0 otherwise. | | nr_organized | Number of organized local associations/organizations in the municipality (count from historical records; year as recorded in source). | | zeropop | Distance of lagged population from the 1,500-person benchmark: `population` − 1500, where `population` is Population\_{t−1} for election year t = `year`. | | c_m | Unclear/undocumented field carried over from the source file (may be empty or auxiliary). | | new | Indicator for being below the 1,500-person benchmark based on `population` (i.e., Population\_{t−1}): 1 if `zeropop` < 0 (equivalently, `population` < 1,500); 0 otherwise. | Dataset Context: This dataset is a municipality × election-year panel covering Swedish municipalities in the early decades after the introduction of universal suffrage, with election-year observations spanning 1921–1944. It combines historical municipal administrative and demographic measures (e.g., population, land area, tax base, poor relief counts, agriculture share, number of local organizations) with parliamentary electoral statistics disaggregated by gender (numbers of eligible voters and turnout measures for men and women, and women’s share of total votes), as well as local political context indicators (e.g., left-party support and party-system fragmentation). Several variables encode municipality population relative to a 1,500-person benchmark used in contemporaneous municipal governance statutes. In this panel setting, the population measure used for the benchmark is recorded as the population in the year preceding the election/observation year (Population\_{t−1} relative to election year t), and the derived threshold/distance indicators are computed from that same lagged population. The data were assembled from Swedish national electoral statistics and historical municipal registers/census and fiscal records; year-suffixed variables denote the historical measurement year (e.g., area1918, taxbase1918).

      file df43b8c482e8aabc4ea5bbac74e9748f76d0487bdf0307c9106b7c1ebe91fee1 · frame —
      ref_iv (reference)
      file df43b8c482e8aabc4ea5bbac74e9748f76d0487bdf0307c9106b7c1ebe91fee1 · frame —
      1. select {"columns":["wm_turnout","direct","new","year","left","wm_voters","enep"]}
      2. dropna {"columns":["wm_turnout","direct","new","year","left","wm_voters","enep"]}
      3. dummies {"column":"year","drop_first":true,"prefix":"year"}
    2. 1Turno do modelo
      call_aa9ea409naive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Texto visível

      Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Chamadas pedidas
      • infer.ols
        {
          "dataset": "ds_0043",
          "x": [
            "direct"
          ],
          "y": "wm_turnout"
        }
    3. 2Ferramenta
      infer.olsv0.1.0call_c662ffd4decidido pelo modeloreexecutável

      Motivo: Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Argumentos
      {
        "cluster": null,
        "controls": [],
        "dataset": "ds_0043",
        "fe": [],
        "intercept": true,
        "level": 0.95,
        "se": "HC1",
        "subset": null,
        "weights": null,
        "x": [
          "direct"
        ],
        "y": "wm_turnout"
      }
      Figuras call_c662ffd4
      ChaveValorValor brutoErro-padrãoIC
      coef.direct
      Coefficient on direct in the regression of wm_turnout
      -4,41869 -4.4186888741336350,598310.5983102935232996-5,59187 – -3,24551
      Diagnósticos
      • n_obs = 2.7492749
      • k = 22
      • r2 = 0,01928230.01928229705882567
      • df_resid = 2.7472747
      • se_type = "HC1"
      • n_clusters = —
      Tabelas (1)
      {
        "coefficients": [
          {
            "ci_high": 59.03330622791996,
            "ci_low": 57.728093683040804,
            "coef": 58.38069995548038,
            "p": 0,
            "se": 0.3328217930307023,
            "t": 175.41128969909386,
            "term": "Intercept"
          },
          {
            "ci_high": -3.2455053308839528,
            "ci_low": -5.591872417383318,
            "coef": -4.418688874133635,
            "p": 2.006805539007109e-13,
            "se": 0.5983102935232996,
            "t": -7.385279715167664,
            "term": "direct"
          }
        ]
      }
      • 1 rows were dropped because one of 'wm_turnout', 'direct' was missing
      Digests dos dados
      ds_0043 60daee4b992c2a8c0fc1040bc2e87793b668776b0f837d37ea027f6525e3bf51
      sha256 do resultado
      6356eb4e98ce71f495c279a5cc879cfba22e88c05371fa5f4d9c4918229d5c73
    4. 3Turno do modelo
      call_b4e2ceb5naive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Chamadas pedidas
      • submit_answer (meta-ferramenta)
        {
          "answer": "Estimativa ingênua (infer.ols): coef.direct = -4,419.",
          "caveats": [],
          "figure_refs": [
            "call_c662ffd4:coef.direct"
          ]
        }
    5. 4Guarda
      resposta aceita
      Números encontrados
      -4,419
      Sem lastro
      —
      Não citados
      —
      1 nova(s) tentativa(s) restante(s)
    6. 5Resposta

      Estimativa ingênua (infer.ols): coef.direct = -4,419.

      Figuras citadas: call_c662ffd4:coef.direct · Parada: answered
      Figura da resposta: call_c662ffd4:coef.direct = -4,41869-4.418688874133635 (se 0,598310.5983102935232996)
    7. 6Pontuação
      #0resposta com lastropassouobrigatóriaevery number backed
    8. 7Pontuação
      #1figura da resposta próximafalhouobrigatória-4.418688874 in [1.801054993, 6.056270442]?
    9. 8Pontuação
      #2figura da resposta próximafalhouregistrada-4.418688874 vs 3.9286627174509476
    10. 9Pontuação
      #3figura da resposta próximafalhouregistrada0.5983102935 vs 1.0855141453627462

    Épocas × verificações

    Resultado de cada verificação em cada época pontuada
    #0123
    Época 1passoufalhoufalhoufalhou

    Tentativas

    Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

    Downloads desta tarefa

    Pacote da tarefa (.zip)
    105,3 KB · sha256 7ce546845e794b6715e18206b2f8a040aa4a83c9ec6be005b6e755260b2fae87

    O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

    Downloads desta tarefa
    ArquivoTamanhosha256
    attachments/0abca454d4915d62d0e371c2486dff591aba34d2f6f49ef517e573ebc29b7260.json1,0 KB0abca454d4915d62d0e371c2486dff591aba34d2f6f49ef517e573ebc29b7260
    attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
    attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
    attachments/b2ac45525a055d7798f4529ce9cf02e6ad7e8deda39dc0f72c560851e12ce9c7.json947 Bb2ac45525a055d7798f4529ce9cf02e6ad7e8deda39dc0f72c560851e12ce9c7
    attachments/bffab46dcaaa2a64d5402317197812e262140dfd588bc77f1c1dec14cf50d689.json5,1 KBbffab46dcaaa2a64d5402317197812e262140dfd588bc77f1c1dec14cf50d689
    attachments/e4e1652480bab1025657ac8481204a516ce851b296553d6077fae79c07d69ab7.json279 Be4e1652480bab1025657ac8481204a516ce851b296553d6077fae79c07d69ab7
    attachments/e5ba7c62793bbb14e4eb7680ccd49b8aadf03ace017a3259e8cb2e56815c4da5.json229 Be5ba7c62793bbb14e4eb7680ccd49b8aadf03ace017a3259e8cb2e56815c4da5
    native/crb_papers/crb_papers.q073.e1.a1.json4,1 KBc175f0befee86ca0e221d8160d86badf7f91fbf6ddd9acf60fa405836e2ec1d2
    sources/crb_papers.q073.gold.json1,1 KBc307979c8b21792108fb0147c2e0b867be5d28aa4404df545a531fb16cf5a2b5
    sources/crb_papers.q073.script.json1,1 KB096cbf15e8c74781d5aa409387d0615469d290aeffe49df6e0b4273f9a75a059
    specs/crb_papers.q073.json10,5 KB2b61c4eaf60db56fcdd9c4a81d7d2cba9db977cc9cdad689819c33d7ece2a922
    traces/crb_papers.q073.e1.a1.jsonl15,9 KB622cc2131f3a96d64ca8079f143147257033823c4a1ed12dbef351fa3cfad144
    trajectories/crb_papers.q073.e1.a1.jsonl14,5 KB84a379bff33a0859a03cabbb50be24a9ac86f1cd26b030b325d442416d916eee