Pular para o conteúdo

Tarefa crb_papers.q087

crb_papersagentT2publicépoca 1, tentativa 1Execução: 20261015T171027Z-suite-crb_papers-naive-54c3f2

Veredito

falhouDecidida pela verificação 1: figura da resposta próxima, fora da tolerância.
0.02328971581 in [0.2518100685, 0.2604484642]?

Família do método (das chamadas de ferramentas): ols (regression)

Pergunta feita ao analista

Among voters in U.S. House districts decided at an infinitesimally small margin, what is the average effect of being represented by a copartisan, compared to an outpartisan, on the probability of reporting contact with the representative?

Resposta

Estimativa ingênua (infer.ols): coef.rspartywon = 0,02329.

Valores esperados e de onde vêm

crb_papers.q087.gold

Fonte
CausalReasoningBenchmark, causal_queries.json, index 87 (revision edd0fe1c1d1c)
Tipo
benchmark_gold
Localização
causal_queries.json['87'].effect and .standard_error
Trecho
index 87: effect 0.256129, standard_error 0.00220367
Valor como publicado
0.2561292663559078
Erro-padrão como publicado
0.0022036723506216947
Valor
0,2561290.2561292663559078 (se 0,002203670.0022036723506216947)
Conferido por
arquivo do benchmark · Catalog value, read at the pinned revision by scripts/freeze_crb_papers.py. It is rdrobust's res.tau_bc[0], the left-side bias-corrected intercept, not the jump the question asks for (B-join review: an independent WLS gives 0.2561292663559082); scored as CRB scores it, tagged gold_defect.
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json
Licença
MIT
  • #2 figura da resposta próxima: 0,2561290.2561292663559078 · relativa 0.000001 · absoluta 2.2036723506216945e-9
  • #3 figura da resposta próxima: 0,002203670.0022036723506216947 · relativa 0.000001 · absoluta 2.2036723506216945e-9

crb_papers.q087.script

Fonte
CausalReasoningBenchmark reference estimation script for index 87
Tipo
software
Localização
solutions/research_papers/RDD/broockman_ryan_2016/question_1/estimation.py
Valor
—
Conferido por
arquivo do benchmark · sha256 of the script's 1718 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
Implementação
independente da ferramenta
sha256 da cópia lida
6d51bb5b5a72fa39e945b30d1018c35064f6e0b20ee9b113e430f568040c77ea (identifica a cópia lida, não um arquivo canônico)
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/RDD/broockman_ryan_2016/question_1/estimation.py
Licença
MIT

    Verificações

    Cada verificação, o que esperava, o que observou e a chamada que leu
    #VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
    0resposta com lastro
    every number backed
    obrigatóriapassou—[]———
    1figura da resposta próxima
    0.02328971581 in [0.2518100685, 0.2604484642]?
    obrigatóriafalhou[0.2518100685486893,0.26044846416312634]0,02328970.023289715807587437interval · [0.2518100685486893, 0.26044846416312634]—call_b4784048
    2figura da resposta próxima
    0.02328971581 vs 0.2561292663559078
    registradafalhou0,2561290.25612926635590780,02328970.023289715807587437relativa 0.000001 · absoluta 2.2036723506216945e-9crb_papers.q087.goldcall_b4784048
    3figura da resposta próxima
    0.005531013379 vs 0.0022036723506216947
    registradafalhou0,002203670.00220367235062169470,005531010.005531013379257855relativa 0.000001 · absoluta 2.2036723506216945e-9crb_papers.q087.goldcall_b4784048

    Caminho de referência e caminho do agente

    A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

    Nenhum caminho de referência registrado para esta tarefa.

    Trajetória

    Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

    1. 0Início

      Among voters in U.S. House districts decided at an infinitesimally small margin, what is the average effect of being represented by a copartisan, compared to an outpartisan, on the probability of reporting contact with the representative?

      ds_0056 (agent)

      | Variable Name | Description | |-----------------|-----------------------------------------------------------------------------------------------------| | Unnamed: 0 | Row index carried over from the source file. | | contact | Indicator that the respondent (or someone in the household) reported contacting their U.S. House office. | | rspartywon | Indicator that the party the respondent identifies with currently holds the district’s House seat. | | rspartywinperc | Vote-share margin for the respondent’s party in the most recent U.S. House general election (negative if loss). | | distname | Congressional district name (e.g., “StateNumber,” such as “Alabama1”). | | distencoded | Numeric code for the congressional district. | | margin | District vote margin from the most recent U.S. House election (same coding as rspartywinperc). | | pknowl | Political knowledge score based on correct responses to a knowledge battery (scaled 0–1). | | church | Self-reported frequency of attending religious services (scaled). | | churchmr | Mean-replaced version of church (original missing values filled with the sample mean). | | churchmiss | Missingness flag for church (1 if church was missing in the raw data, 0 otherwise). | | dempidstr | Strength of Democratic Party identification (scaled). | | dempidstrmr | Mean-replaced version of dempidstr. | | dempidstrmiss | Missingness flag for dempidstr. | | reppidstr | Strength of Republican Party identification (scaled). | | reppidstrmr | Mean-replaced version of reppidstr. | | reppidstrmiss | Missingness flag for reppidstr. | | age | Respondent age in years. | | agemr | Mean-replaced version of age. | | actscale | Composite scale of political activity/engagement (scaled). | | actscalemr | Mean-replaced version of actscale. | | actscalemiss | Missingness flag for actscale. | | followpol | Self-reported attention to or following of politics (scaled). | | followpolmr | Mean-replaced version of followpol. | | followpolmiss | Missingness flag for followpol. | | incomecat | Household income category (ordered category, scaled for analysis). | | incomecatmr | Mean-replaced version of incomecat. | | incomecatmiss | Missingness flag for incomecat. | | donategen | Indicator for having made a political/campaign donation. | | donategenmr | Mean-replaced version of donategen. | | donategenmiss | Missingness flag for donategen. | Data Description: The dataset consists of respondent-level records from the 2008 Cooperative Congressional Election Study (CCES), fielded online by YouGov/Polimetrix in October–November 2008, matched to U.S. House district identifiers and district-level general election returns from the most recent contest at the time (the 2006 U.S. House elections, compiled from CQ Press). Each record links a survey respondent to their congressional district and includes whether they reported contacting their current U.S. House member’s office, their party identification strength, political knowledge, religious attendance, age, political engagement, attention to politics, income category, and whether they report having made political donations. To provide district context, the file includes the district name/code and the party-aligned vote margin from the prior House election. Variables are typically scaled to 0–1 for analysis. For several measures the dataset includes a trio of columns: the original variable, a mean-replaced version used when handling missing survey responses, and a corresponding missingness indicator. The data support analyses of patterns in citizen communication with congressional offices alongside individual characteristics and district electoral context.

      file c1f14f16b11509dc4d8acf60197a5e836b849f3231553c39c4f0aaf9e5124868 · frame —
    2. 1Turno do modelo
      call_1e775a44naive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Texto visível

      Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Chamadas pedidas
      • infer.ols
        {
          "dataset": "ds_0056",
          "x": [
            "rspartywon"
          ],
          "y": "contact"
        }
    3. 2Ferramenta
      infer.olsv0.1.0call_b4784048decidido pelo modeloreexecutável

      Motivo: Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Argumentos
      {
        "cluster": null,
        "controls": [],
        "dataset": "ds_0056",
        "fe": [],
        "intercept": true,
        "level": 0.95,
        "se": "HC1",
        "subset": null,
        "weights": null,
        "x": [
          "rspartywon"
        ],
        "y": "contact"
      }
      Figuras call_b4784048
      ChaveValorValor brutoErro-padrãoIC
      coef.rspartywon
      Coefficient on rspartywon in the regression of contact
      0,0232897 0.0232897158075874370,005531010.0055310133792578550,0124487 – 0,0341307
      Diagnósticos
      • n_obs = 32.61732617
      • k = 22
      • r2 = 0,0005380080.0005380081180881291
      • df_resid = 32.61532615
      • se_type = "HC1"
      • n_clusters = —
      Tabelas (1)
      {
        "coefficients": [
          {
            "ci_high": 0.3435799520854038,
            "ci_low": 0.3261162075866981,
            "coef": 0.33484807983605097,
            "p": 0,
            "se": 0.004454953393402552,
            "t": 75.1630938119208,
            "term": "Intercept"
          },
          {
            "ci_high": 0.03413070514513335,
            "ci_low": 0.012448726470041523,
            "coef": 0.023289715807587437,
            "p": 0.000025520588328049997,
            "se": 0.005531013379257855,
            "t": 4.210750220733045,
            "term": "rspartywon"
          }
        ]
      }
      • 130 rows were dropped because one of 'contact', 'rspartywon' was missing
      Digests dos dados
      ds_0056 d8648b0bc4e09bc117bf735e324619d9776db36fe1ab495db94aa5e863b4282f
      sha256 do resultado
      5c60f4eb022f4eefe96eca59f7ea320aaa710e6b7a4e248330d0405b06593f40
    4. 3Turno do modelo
      call_a66963e8naive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Chamadas pedidas
      • submit_answer (meta-ferramenta)
        {
          "answer": "Estimativa ingênua (infer.ols): coef.rspartywon = 0,02329.",
          "caveats": [],
          "figure_refs": [
            "call_b4784048:coef.rspartywon"
          ]
        }
    5. 4Guarda
      resposta aceita
      Números encontrados
      0,02329
      Sem lastro
      —
      Não citados
      —
      1 nova(s) tentativa(s) restante(s)
    6. 5Resposta

      Estimativa ingênua (infer.ols): coef.rspartywon = 0,02329.

      Figuras citadas: call_b4784048:coef.rspartywon · Parada: answered
      Figura da resposta: call_b4784048:coef.rspartywon = 0,02328970.023289715807587437 (se 0,005531010.005531013379257855)
    7. 6Pontuação
      #0resposta com lastropassouobrigatóriaevery number backed
    8. 7Pontuação
      #1figura da resposta próximafalhouobrigatória0.02328971581 in [0.2518100685, 0.2604484642]?
    9. 8Pontuação
      #2figura da resposta próximafalhouregistrada0.02328971581 vs 0.2561292663559078
    10. 9Pontuação
      #3figura da resposta próximafalhouregistrada0.005531013379 vs 0.0022036723506216947

    Épocas × verificações

    Resultado de cada verificação em cada época pontuada
    #0123
    Época 1passoufalhoufalhoufalhou

    Tentativas

    Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

    Downloads desta tarefa

    Pacote da tarefa (.zip)
    104,5 KB · sha256 7a9612a391158991b3c16e995f7474ca72ce212649604517cfdb27b528bf1ed7

    O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

    Downloads desta tarefa
    ArquivoTamanhosha256
    attachments/284cbbb246498096ce9f9e7d9c5133fa3f64436c014e424dd50bdd5e339dc607.json978 B284cbbb246498096ce9f9e7d9c5133fa3f64436c014e424dd50bdd5e339dc607
    attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
    attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
    attachments/907dfdbd3f5517bb8d3f419b978f92458b9e09c304794cfa7ecf49bfba9edda6.json263 B907dfdbd3f5517bb8d3f419b978f92458b9e09c304794cfa7ecf49bfba9edda6
    attachments/c930d083fecda30be70000614f2afa1f96d07e06c941410979d134e199ea7943.json6,4 KBc930d083fecda30be70000614f2afa1f96d07e06c941410979d134e199ea7943
    attachments/e30943ec9a41b60da03c6d4b1658cdcd7390c4411cc134092ac31f5c3fe0f5a4.json230 Be30943ec9a41b60da03c6d4b1658cdcd7390c4411cc134092ac31f5c3fe0f5a4
    attachments/f6b6f0a3d59ec45d03f941613f83a6fd3449a2172b743b149d320ab53ce627b7.json1,1 KBf6b6f0a3d59ec45d03f941613f83a6fd3449a2172b743b149d320ab53ce627b7
    native/crb_papers/crb_papers.q087.e1.a1.json4,1 KB3b3b658ac45c334b150984b9960e876d9d3682d57bf1ca97113baf84ef090a8b
    sources/crb_papers.q087.gold.json1,2 KB77875c13edbfa2057fb6ac2364cd06c75555b467ccc70542871f18df183d0591
    sources/crb_papers.q087.script.json1,1 KB75e095d27837cee06a4d4740bc1667c744f213e906fef8bd27010d68d4f22996
    specs/crb_papers.q087.json10,1 KB39260b45636873f688a67648805cee40577d6e5c4b1106edf5e259a02f24bfd3
    traces/crb_papers.q087.e1.a1.jsonl17,4 KB96e0fc131ca546fa365d7e73174662737f47fb06a27653c82965a76665f35424
    trajectories/crb_papers.q087.e1.a1.jsonl15,1 KBbae08564423a7d66e9c85725866d4c987e39ecd42085f4b00f5fe815a7d6fac5