Pular para o conteúdo

Tarefa crb_papers.q086

crb_papersagentT2publicépoca 1, tentativa 1Execução: 20261015T171027Z-suite-crb_papers-naive-54c3f2

Veredito

falhouDecidida pela verificação 1: figura da resposta próxima, fora da tolerância.
0.02598374672 in [0.3204267171, 0.9410954993]?

Família do método (das chamadas de ferramentas): ols (regression)

Pergunta feita ao analista

What is the average causal effect, at the alignment threshold, of an MLA being from the MP's party on per-project MPLADS expenditure for projects proposed within two years after a state election?

Resposta

Estimativa ingênua (infer.ols): coef.mp_aligned = 0,02598.

Valores esperados e de onde vêm

crb_papers.q086.gold

Fonte
CausalReasoningBenchmark, causal_queries.json, index 86 (revision edd0fe1c1d1c)
Tipo
benchmark_gold
Localização
causal_queries.json['86'].effect and .standard_error
Trecho
index 86: effect 0.630761, standard_error 0.158334
Valor como publicado
0.6307611082021989
Erro-padrão como publicado
0.1583338729913449
Valor
0,6307610.6307611082021989 (se 0,1583340.1583338729913449)
Conferido por
arquivo do benchmark · Read from the catalog at the pinned revision by scripts/freeze_crb_papers.py; the catalog states the value its estimation script prints.
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json
Licença
MIT
  • #2 figura da resposta próxima: 0,6307610.6307611082021989 · relativa 0.000001 · absoluta 1.583338729913449e-7
  • #3 figura da resposta próxima: 0,1583340.1583338729913449 · relativa 0.000001 · absoluta 1.583338729913449e-7

crb_papers.q086.script

Fonte
CausalReasoningBenchmark reference estimation script for index 86
Tipo
software
Localização
solutions/research_papers/RDD/bohlken_2018/question_1/estimation.py
Valor
—
Conferido por
arquivo do benchmark · sha256 of the script's 1101 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
Implementação
independente da ferramenta
sha256 da cópia lida
5090108040b5ff9a227cc2e3ae25ff04f961c0357a1c847c8fd9f9a6dce17f42 (identifica a cópia lida, não um arquivo canônico)
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/RDD/bohlken_2018/question_1/estimation.py
Licença
MIT

    Verificações

    Cada verificação, o que esperava, o que observou e a chamada que leu
    #VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
    0resposta com lastro
    every number backed
    obrigatóriapassou—[]———
    1figura da resposta próxima
    0.02598374672 in [0.3204267171, 0.9410954993]?
    obrigatóriafalhou[0.3204267171391629,0.941095499265235]0,02598370.02598374671506448interval · [0.3204267171391629, 0.941095499265235]—call_fcad5137
    2figura da resposta próxima
    0.02598374672 vs 0.6307611082021989
    registradafalhou0,6307610.63076110820219890,02598370.02598374671506448relativa 0.000001 · absoluta 1.583338729913449e-7crb_papers.q086.goldcall_fcad5137
    3figura da resposta próxima
    0.05331470952 vs 0.1583338729913449
    registradafalhou0,1583340.15833387299134490,05331470.05331470952163866relativa 0.000001 · absoluta 1.583338729913449e-7crb_papers.q086.goldcall_fcad5137

    Caminho de referência e caminho do agente

    A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

    Nenhum caminho de referência registrado para esta tarefa.

    Trajetória

    Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

    1. 0Início

      What is the average causal effect, at the alignment threshold, of an MLA being from the MP's party on per-project MPLADS expenditure for projects proposed within two years after a state election?

      ds_0055 (agent)

      | Variable Name | Description | |---------------------------|-----------------------------------------------------------------------------------------------| | Unnamed: 0 | Row index from the original file. | | st_name | Indian state name. | | lsrs | Parliamentary term label for the MP (e.g., “14th Lok Sabha”). | | constituency | Lok Sabha (parliamentary) constituency name. | | mp | Name of the Member of Parliament for the constituency/year. | | blockurban | Administrative block or urban ward where the project is located. | | costsanctionedbydistrict | Project cost sanctioned by the district authority (INR). | | gp_missing | Indicator that the Gram Panchayat/local area name was missing in the source record. | | matched | Indicator that the project location was successfully matched to an assembly constituency via GIS. | | ac_name_GIS | State assembly constituency name obtained from the GIS match. | | elecyear_missing | Indicator that the relevant state election year information was missing. | | project_id | Unique project identifier from the MPLADS portal. | | windiffsh_pc | - | | party_mp | Political party of the MP. | | project_year | Calendar year in which the project proposal was received/sanctioned. | | electerm | Year of the most recent state assembly election for the matched assembly constituency. | | windiffsh_l | - | | project_bef_elec | Indicator that the project was proposed before the most recent state assembly election. | | project_bef_elec_1yr | Indicator that the project was proposed within 1 year before the state assembly election. | | project_bef_elec_2yr | Indicator that the project was proposed within 2 years before the state assembly election. | | project_bef_elec_3yr | Indicator that the project was proposed within 3 years before the state assembly election. | | project_aft_elec | Indicator that the project was proposed after the most recent state assembly election. | | project_aft_elec_1yr | Indicator that the project was proposed within 1 year after the state assembly election. | | project_aft_elec_2yr | Indicator that the project was proposed within 2 years after the state assembly election. | | project_bef_ls_elec | Indicator that the project was proposed before the most recent national (Lok Sabha) election. | | project_bef_ls_elec_1yr | Indicator that the project was proposed within 1 year before the national election. | | project_bef_ls_elec_2yr | Indicator that the project was proposed within 2 years before the national election. | | project_bef_ls_elec_3yr | Indicator that the project was proposed within 3 years before the national election. | | project_aft_ls_elec | Indicator that the project was proposed after the most recent national election. | | project_aft_ls_elec_1yr | Indicator that the project was proposed within 1 year after the national election. | | project_aft_ls_elec_2yr | Indicator that the project was proposed within 2 years after the national election. | | mp_aligned | Indicator that the assembly constituency’s MLA belongs to the same party as the MP at that time. | | forcing | Vote margin share of the MP’s party’s candidate in the most recent state assembly election for the matched assembly constituency (positive if that candidate won). | | forcing_sq | Square of forcing. | | forcing_cub | Cube of forcing. | | forcing_qua | Fourth power of forcing. | | forcing_aligned | Product of forcing and mp_aligned. | | forcing_sq_aligned | Product of forcing_sq and mp_aligned. | | forcing_cub_aligned | Product of forcing_cub and mp_aligned. | | forcing_qua_aligned | Product of forcing_qua and mp_aligned. | | project_expenditure | Amount sanctioned for the project in lakh rupees (INR 100,000 units). | | allot_increase | Indicator that the project was proposed after the 2012 increase in MPLADS annual allotment. | | urban | Indicator that the project is located in an urban area. | | multiple | Indicator that the project benefits multiple villages/towns. | | indiv_benefit | Indicator that the project description specifies a benefit to a named individual household. | | mp_state_ruling | Indicator that the MP’s party was the ruling party in the state government at that time. | | incomplete | Indicator that the project was ongoing/discontinued/not yet started at the time of data scrape. | | incomplete2 | Alternative incompleteness coding that excludes records with missing status. | | road | Indicator that the project is classified as road/pathway/bridge. | | timetosanction | Number of days between proposal receipt and sanction by the district authority. | | complete | Indicator that the project was reported complete at the time of data scrape. | | urban_perc_ac | Share of the assembly constituency population living in urban areas (Census). | | scst_perc_ac | Share of Scheduled Castes/Scheduled Tribes population in the assembly constituency (Census). | | lit_perc_ac | Literacy rate of the assembly constituency (Census). | | aglb_perc_ac | Share of agricultural laborers in the assembly constituency (Census). | | party_same | Indicator that the MP and the MLA are from the same party. | | mp_aligned_sameparty | Same-party alignment check variable (duplicate alignment flag). | | party_turnover_previous | Indicator that the party holding the assembly seat changed from the previous state election. | | cand_new | Indicator that the current MLA is a newcomer (not previously in office in that seat). | | mp_aligned_candnew | Indicator that the MLA is both a newcomer and from the MP’s party. | | regional_party | Indicator that the MLA’s party is a regional (non-national) party. | | safe | - | | monthscat | - | | complete_mean | - | | mean_indivbenefit | - | Data Description: This dataset contains project-level records from India’s Member of Parliament Local Area Development Scheme (MPLADS) for the period spanning the 13th–15th Lok Sabhas (approximately 1999–2014). Project details were scraped from the MPLADS Online Works Monitoring System, where district authorities upload information on sanctioned works. Each project was georeferenced by matching the listed village cluster or urban ward to state assembly constituency boundaries using GIS. The file integrates project attributes (costs, sector, location, status), MP information (name, party, parliamentary term), and time stamps, and it augments projects with the timing of nearby state and national elections. Election-year information and party labels for state legislators were compiled from official election data to create calendar-based indicators that situate each project relative to recent elections. Assembly-constituency demographic measures (urban share, SC/ST share, literacy, and agricultural labor share) were merged from Census sources. The data focus on seven northern Indian states (Rajasthan, Madhya Pradesh, Uttar Pradesh, Bihar, Chhattisgarh, Uttarakhand, and Jharkhand) and were assembled to study patterns in how MPs deploy local development funds across space and political contexts, with special attention to interactions between national and state-level actors in the delivery of public works.

      file 619cdfc04fb21bc0967e4dbc5b1948c4b1ad8ddcdff93bd8641af2fdd2930723 · frame —
    2. 1Turno do modelo
      call_a918190fnaive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Texto visível

      Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Chamadas pedidas
      • infer.ols
        {
          "dataset": "ds_0055",
          "x": [
            "mp_aligned"
          ],
          "y": "project_expenditure"
        }
    3. 2Ferramenta
      infer.olsv0.1.0call_fcad5137decidido pelo modeloreexecutável

      Motivo: Linha de base ingênua: regressão do resultado no tratamento, sem controles.

      Argumentos
      {
        "cluster": null,
        "controls": [],
        "dataset": "ds_0055",
        "fe": [],
        "intercept": true,
        "level": 0.95,
        "se": "HC1",
        "subset": null,
        "weights": null,
        "x": [
          "mp_aligned"
        ],
        "y": "project_expenditure"
      }
      Figuras call_fcad5137
      ChaveValorValor brutoErro-padrãoIC
      coef.mp_aligned
      Coefficient on mp_aligned in the regression of project_expenditure
      0,0259837 0.025983746715064480,05331470.05331470952163866-0,078517 – 0,130484
      Diagnósticos
      • n_obs = 21.77321773
      • k = 22
      • r2 = 0,00001085660.000010856589089502933
      • df_resid = 21.77121771
      • se_type = "HC1"
      • n_clusters = —
      Tabelas (1)
      {
        "coefficients": [
          {
            "ci_high": 2.3943571686814926,
            "ci_low": 2.240056675546301,
            "coef": 2.317206922113897,
            "p": 0,
            "se": 0.03936090560392502,
            "t": 58.87077257396303,
            "term": "Intercept"
          },
          {
            "ci_high": 0.13048446696434668,
            "ci_low": -0.07851697353421773,
            "coef": 0.02598374671506448,
            "p": 0.6260042895003537,
            "se": 0.05331470952163866,
            "t": 0.487365437197375,
            "term": "mp_aligned"
          }
        ]
      }
      Digests dos dados
      ds_0055 92369d0ff95246c6e80e8cd7f653f2dd140ef45b07d8dd9bdf0516175fb22622
      sha256 do resultado
      714d8c7f1b78d20ff5d73511e6a2700b41fb83216c1e93638f15959696f95a74
    4. 3Turno do modelo
      call_49e787bfnaive-olsFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Chamadas pedidas
      • submit_answer (meta-ferramenta)
        {
          "answer": "Estimativa ingênua (infer.ols): coef.mp_aligned = 0,02598.",
          "caveats": [],
          "figure_refs": [
            "call_fcad5137:coef.mp_aligned"
          ]
        }
    5. 4Guarda
      resposta aceita
      Números encontrados
      0,02598
      Sem lastro
      —
      Não citados
      —
      1 nova(s) tentativa(s) restante(s)
    6. 5Resposta

      Estimativa ingênua (infer.ols): coef.mp_aligned = 0,02598.

      Figuras citadas: call_fcad5137:coef.mp_aligned · Parada: answered
      Figura da resposta: call_fcad5137:coef.mp_aligned = 0,02598370.02598374671506448 (se 0,05331470.05331470952163866)
    7. 6Pontuação
      #0resposta com lastropassouobrigatóriaevery number backed
    8. 7Pontuação
      #1figura da resposta próximafalhouobrigatória0.02598374672 in [0.3204267171, 0.9410954993]?
    9. 8Pontuação
      #2figura da resposta próximafalhouregistrada0.02598374672 vs 0.6307611082021989
    10. 9Pontuação
      #3figura da resposta próximafalhouregistrada0.05331470952 vs 0.1583338729913449

    Épocas × verificações

    Resultado de cada verificação em cada época pontuada
    #0123
    Época 1passoufalhoufalhoufalhou

    Tentativas

    Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

    Downloads desta tarefa

    Pacote da tarefa (.zip)
    108,1 KB · sha256 b22197da2d57ea8f73c4af4dc3b209dd6d23f2f7e3cb68a014117e17e1eafe0c

    O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

    Downloads desta tarefa
    ArquivoTamanhosha256
    attachments/08ae660edaaaf022e57805ea5d1cd3d467fbd6ad9c8626ca051ca54ef651b6ea.json242 B08ae660edaaaf022e57805ea5d1cd3d467fbd6ad9c8626ca051ca54ef651b6ea
    attachments/29158af3dfc96f3a2a4300b836a37b8e2a73f62f8c3de116dd7858f70c038e7f.json894 B29158af3dfc96f3a2a4300b836a37b8e2a73f62f8c3de116dd7858f70c038e7f
    attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
    attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
    attachments/672694fcf173bccb0e9d11b5880b760e4f66d7a11563b02fde2029cf27df13a4.json1000 B672694fcf173bccb0e9d11b5880b760e4f66d7a11563b02fde2029cf27df13a4
    attachments/70bd24fbe25e781f5cc62daaeea31930ac269a0c11cf527a0e700ae2b4ab83e4.json12,3 KB70bd24fbe25e781f5cc62daaeea31930ac269a0c11cf527a0e700ae2b4ab83e4
    attachments/b07859119e69142736958bbcc87912e9b719120494145e6d98b45716f404fc24.json220 Bb07859119e69142736958bbcc87912e9b719120494145e6d98b45716f404fc24
    native/crb_papers/crb_papers.q086.e1.a1.json4,1 KBa6463de1d9fc71f8987428a5184d7e13c73a0a5033b15a26b112374031b32bd5
    sources/crb_papers.q086.gold.json1,1 KB918f24c98b7462a50de1ecf0db5b69a72c675f578cfb8fefa1c83da89ad44b12
    sources/crb_papers.q086.script.json1,1 KBe9b57c95ac284e90a4b4ec45eebace2f023add46f0b740479679365370db5d79
    specs/crb_papers.q086.json14,1 KBa8216cb03c10cdba271908172e8882c4924eb36420c7b87691fde168d976305c
    traces/crb_papers.q086.e1.a1.jsonl23,1 KBa4e7d6d0dc3361ffa179485750041ea604806dfcb0478e430e460cd24480e560
    trajectories/crb_papers.q086.e1.a1.jsonl19,6 KB5f90bc1a37d04c48cd6eb1f6d55973acd9ffbb120a2380df544eb3a56da21b2b