Tarefa crb_papers.q086
Veredito
0.02598374672 in [0.3204267171, 0.9410954993]?Família do método (das chamadas de ferramentas): ols (regression)
Pergunta feita ao analista
What is the average causal effect, at the alignment threshold, of an MLA being from the MP's party on per-project MPLADS expenditure for projects proposed within two years after a state election?
Estimativa ingênua (infer.ols): coef.mp_aligned = 0,02598.
Valores esperados e de onde vêm
crb_papers.q086.gold
- Fonte
- CausalReasoningBenchmark, causal_queries.json, index 86 (revision edd0fe1c1d1c)
- Tipo
- benchmark_gold
- Localização
- causal_queries.json['86'].effect and .standard_error
- Trecho
index 86: effect 0.630761, standard_error 0.158334
- Valor como publicado
0.6307611082021989- Erro-padrão como publicado
0.1583338729913449- Valor
- 0,630761
0.6307611082021989(se 0,1583340.1583338729913449) - Conferido por
- arquivo do benchmark · Read from the catalog at the pinned revision by scripts/freeze_crb_papers.py; the catalog states the value its estimation script prints.
- Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json- Licença
- MIT
- #2 figura da resposta próxima: 0,630761
0.6307611082021989· relativa 0.000001 · absoluta 1.583338729913449e-7 - #3 figura da resposta próxima: 0,158334
0.1583338729913449· relativa 0.000001 · absoluta 1.583338729913449e-7
crb_papers.q086.script
- Fonte
- CausalReasoningBenchmark reference estimation script for index 86
- Tipo
- software
- Localização
- solutions/research_papers/RDD/bohlken_2018/question_1/estimation.py
- Valor
- —
- Conferido por
- arquivo do benchmark · sha256 of the script's 1101 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
- Implementação
- independente da ferramenta
- sha256 da cópia lida
5090108040b5ff9a227cc2e3ae25ff04f961c0357a1c847c8fd9f9a6dce17f42(identifica a cópia lida, não um arquivo canônico)- Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/RDD/bohlken_2018/question_1/estimation.py- Licença
- MIT
Verificações
| # | Verificação | Obrigatória | Resultado | Esperado | Observado | Tolerância | Fonte | Chamada |
|---|---|---|---|---|---|---|---|---|
| 0 | resposta com lastro every number backed | obrigatória | passou | — | [] | — | — | — |
| 1 | figura da resposta próxima 0.02598374672 in [0.3204267171, 0.9410954993]? | obrigatória | falhou | [0.3204267171391629,0.941095499265235] | 0,02598370.02598374671506448 | interval · [0.3204267171391629, 0.941095499265235] | — | call_fcad5137 |
| 2 | figura da resposta próxima 0.02598374672 vs 0.6307611082021989 | registrada | falhou | 0,6307610.6307611082021989 | 0,02598370.02598374671506448 | relativa 0.000001 · absoluta 1.583338729913449e-7 | crb_papers.q086.gold | call_fcad5137 |
| 3 | figura da resposta próxima 0.05331470952 vs 0.1583338729913449 | registrada | falhou | 0,1583340.1583338729913449 | 0,05331470.05331470952163866 | relativa 0.000001 · absoluta 1.583338729913449e-7 | crb_papers.q086.gold | call_fcad5137 |
Caminho de referência e caminho do agente
A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.
Nenhum caminho de referência registrado para esta tarefa.
Trajetória
Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.
- 0Início
What is the average causal effect, at the alignment threshold, of an MLA being from the MP's party on per-project MPLADS expenditure for projects proposed within two years after a state election?
ds_0055(agent)| Variable Name | Description | |---------------------------|-----------------------------------------------------------------------------------------------| | Unnamed: 0 | Row index from the original file. | | st_name | Indian state name. | | lsrs | Parliamentary term label for the MP (e.g., “14th Lok Sabha”). | | constituency | Lok Sabha (parliamentary) constituency name. | | mp | Name of the Member of Parliament for the constituency/year. | | blockurban | Administrative block or urban ward where the project is located. | | costsanctionedbydistrict | Project cost sanctioned by the district authority (INR). | | gp_missing | Indicator that the Gram Panchayat/local area name was missing in the source record. | | matched | Indicator that the project location was successfully matched to an assembly constituency via GIS. | | ac_name_GIS | State assembly constituency name obtained from the GIS match. | | elecyear_missing | Indicator that the relevant state election year information was missing. | | project_id | Unique project identifier from the MPLADS portal. | | windiffsh_pc | - | | party_mp | Political party of the MP. | | project_year | Calendar year in which the project proposal was received/sanctioned. | | electerm | Year of the most recent state assembly election for the matched assembly constituency. | | windiffsh_l | - | | project_bef_elec | Indicator that the project was proposed before the most recent state assembly election. | | project_bef_elec_1yr | Indicator that the project was proposed within 1 year before the state assembly election. | | project_bef_elec_2yr | Indicator that the project was proposed within 2 years before the state assembly election. | | project_bef_elec_3yr | Indicator that the project was proposed within 3 years before the state assembly election. | | project_aft_elec | Indicator that the project was proposed after the most recent state assembly election. | | project_aft_elec_1yr | Indicator that the project was proposed within 1 year after the state assembly election. | | project_aft_elec_2yr | Indicator that the project was proposed within 2 years after the state assembly election. | | project_bef_ls_elec | Indicator that the project was proposed before the most recent national (Lok Sabha) election. | | project_bef_ls_elec_1yr | Indicator that the project was proposed within 1 year before the national election. | | project_bef_ls_elec_2yr | Indicator that the project was proposed within 2 years before the national election. | | project_bef_ls_elec_3yr | Indicator that the project was proposed within 3 years before the national election. | | project_aft_ls_elec | Indicator that the project was proposed after the most recent national election. | | project_aft_ls_elec_1yr | Indicator that the project was proposed within 1 year after the national election. | | project_aft_ls_elec_2yr | Indicator that the project was proposed within 2 years after the national election. | | mp_aligned | Indicator that the assembly constituency’s MLA belongs to the same party as the MP at that time. | | forcing | Vote margin share of the MP’s party’s candidate in the most recent state assembly election for the matched assembly constituency (positive if that candidate won). | | forcing_sq | Square of forcing. | | forcing_cub | Cube of forcing. | | forcing_qua | Fourth power of forcing. | | forcing_aligned | Product of forcing and mp_aligned. | | forcing_sq_aligned | Product of forcing_sq and mp_aligned. | | forcing_cub_aligned | Product of forcing_cub and mp_aligned. | | forcing_qua_aligned | Product of forcing_qua and mp_aligned. | | project_expenditure | Amount sanctioned for the project in lakh rupees (INR 100,000 units). | | allot_increase | Indicator that the project was proposed after the 2012 increase in MPLADS annual allotment. | | urban | Indicator that the project is located in an urban area. | | multiple | Indicator that the project benefits multiple villages/towns. | | indiv_benefit | Indicator that the project description specifies a benefit to a named individual household. | | mp_state_ruling | Indicator that the MP’s party was the ruling party in the state government at that time. | | incomplete | Indicator that the project was ongoing/discontinued/not yet started at the time of data scrape. | | incomplete2 | Alternative incompleteness coding that excludes records with missing status. | | road | Indicator that the project is classified as road/pathway/bridge. | | timetosanction | Number of days between proposal receipt and sanction by the district authority. | | complete | Indicator that the project was reported complete at the time of data scrape. | | urban_perc_ac | Share of the assembly constituency population living in urban areas (Census). | | scst_perc_ac | Share of Scheduled Castes/Scheduled Tribes population in the assembly constituency (Census). | | lit_perc_ac | Literacy rate of the assembly constituency (Census). | | aglb_perc_ac | Share of agricultural laborers in the assembly constituency (Census). | | party_same | Indicator that the MP and the MLA are from the same party. | | mp_aligned_sameparty | Same-party alignment check variable (duplicate alignment flag). | | party_turnover_previous | Indicator that the party holding the assembly seat changed from the previous state election. | | cand_new | Indicator that the current MLA is a newcomer (not previously in office in that seat). | | mp_aligned_candnew | Indicator that the MLA is both a newcomer and from the MP’s party. | | regional_party | Indicator that the MLA’s party is a regional (non-national) party. | | safe | - | | monthscat | - | | complete_mean | - | | mean_indivbenefit | - | Data Description: This dataset contains project-level records from India’s Member of Parliament Local Area Development Scheme (MPLADS) for the period spanning the 13th–15th Lok Sabhas (approximately 1999–2014). Project details were scraped from the MPLADS Online Works Monitoring System, where district authorities upload information on sanctioned works. Each project was georeferenced by matching the listed village cluster or urban ward to state assembly constituency boundaries using GIS. The file integrates project attributes (costs, sector, location, status), MP information (name, party, parliamentary term), and time stamps, and it augments projects with the timing of nearby state and national elections. Election-year information and party labels for state legislators were compiled from official election data to create calendar-based indicators that situate each project relative to recent elections. Assembly-constituency demographic measures (urban share, SC/ST share, literacy, and agricultural labor share) were merged from Census sources. The data focus on seven northern Indian states (Rajasthan, Madhya Pradesh, Uttar Pradesh, Bihar, Chhattisgarh, Uttarakhand, and Jharkhand) and were assembled to study patterns in how MPs deploy local development funds across space and political contexts, with special attention to interactions between national and state-level actors in the delivery of public works.
file619cdfc04fb21bc0967e4dbc5b1948c4b1ad8ddcdff93bd8641af2fdd2930723· frame — - 1Turno do modelo
call_a918190fnaive-olsFim:tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cacheTexto visívelLinha de base ingênua: regressão do resultado no tratamento, sem controles.
Chamadas pedidasinfer.ols{ "dataset": "ds_0055", "x": [ "mp_aligned" ], "y": "project_expenditure" }
- 2Ferramenta
infer.olsv0.1.0call_fcad5137decidido pelo modeloreexecutávelMotivo: Linha de base ingênua: regressão do resultado no tratamento, sem controles.
Argumentos
{ "cluster": null, "controls": [], "dataset": "ds_0055", "fe": [], "intercept": true, "level": 0.95, "se": "HC1", "subset": null, "weights": null, "x": [ "mp_aligned" ], "y": "project_expenditure" }Figuras call_fcad5137 Chave Valor Valor bruto Erro-padrão IC coef.mp_aligned Coefficient on mp_aligned in the regression of project_expenditure0,0259837 0.025983746715064480,0533147 0.05331470952163866-0,078517 – 0,130484 Diagnósticosn_obs= 21.77321773k= 22r2= 0,00001085660.000010856589089502933df_resid= 21.77121771se_type="HC1"n_clusters= —
Tabelas (1)
{ "coefficients": [ { "ci_high": 2.3943571686814926, "ci_low": 2.240056675546301, "coef": 2.317206922113897, "p": 0, "se": 0.03936090560392502, "t": 58.87077257396303, "term": "Intercept" }, { "ci_high": 0.13048446696434668, "ci_low": -0.07851697353421773, "coef": 0.02598374671506448, "p": 0.6260042895003537, "se": 0.05331470952163866, "t": 0.487365437197375, "term": "mp_aligned" } ] }- Digests dos dados
ds_005592369d0ff95246c6e80e8cd7f653f2dd140ef45b07d8dd9bdf0516175fb22622- sha256 do resultado
714d8c7f1b78d20ff5d73511e6a2700b41fb83216c1e93638f15959696f95a74
- 3Turno do modelo
call_49e787bfnaive-olsFim:tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cacheChamadas pedidassubmit_answer(meta-ferramenta){ "answer": "Estimativa ingênua (infer.ols): coef.mp_aligned = 0,02598.", "caveats": [], "figure_refs": [ "call_fcad5137:coef.mp_aligned" ] }
- 4Guardaresposta aceita
- Números encontrados
- 0,02598
- Sem lastro
- —
- Não citados
- —
1 nova(s) tentativa(s) restante(s) - 5Resposta
Estimativa ingênua (infer.ols): coef.mp_aligned = 0,02598.
Figuras citadas:call_fcad5137:coef.mp_aligned· Parada:answeredFigura da resposta:call_fcad5137:coef.mp_aligned= 0,02598370.02598374671506448(se 0,05331470.05331470952163866) - 6Pontuação#0resposta com lastropassouobrigatória
every number backed - 7Pontuação#1figura da resposta próximafalhouobrigatória
0.02598374672 in [0.3204267171, 0.9410954993]? - 8Pontuação#2figura da resposta próximafalhouregistrada
0.02598374672 vs 0.6307611082021989 - 9Pontuação#3figura da resposta próximafalhouregistrada
0.05331470952 vs 0.1583338729913449
Épocas × verificações
| # | 0 | 1 | 2 | 3 |
|---|---|---|---|---|
| Época 1 | passou | falhou | falhou | falhou |
Tentativas
Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.
- época 1, tentativa 1falhoupontuada(exibindo)
Downloads desta tarefa
b22197da2d57ea8f73c4af4dc3b209dd6d23f2f7e3cb68a014117e17e1eafe0cO hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.
| Arquivo | Tamanho | sha256 |
|---|---|---|
| attachments/08ae660edaaaf022e57805ea5d1cd3d467fbd6ad9c8626ca051ca54ef651b6ea.json | 242 B | 08ae660edaaaf022e57805ea5d1cd3d467fbd6ad9c8626ca051ca54ef651b6ea |
| attachments/29158af3dfc96f3a2a4300b836a37b8e2a73f62f8c3de116dd7858f70c038e7f.json | 894 B | 29158af3dfc96f3a2a4300b836a37b8e2a73f62f8c3de116dd7858f70c038e7f |
| attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json | 2,4 KB | 433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420 |
| attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json | 64,0 KB | 52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b |
| attachments/672694fcf173bccb0e9d11b5880b760e4f66d7a11563b02fde2029cf27df13a4.json | 1000 B | 672694fcf173bccb0e9d11b5880b760e4f66d7a11563b02fde2029cf27df13a4 |
| attachments/70bd24fbe25e781f5cc62daaeea31930ac269a0c11cf527a0e700ae2b4ab83e4.json | 12,3 KB | 70bd24fbe25e781f5cc62daaeea31930ac269a0c11cf527a0e700ae2b4ab83e4 |
| attachments/b07859119e69142736958bbcc87912e9b719120494145e6d98b45716f404fc24.json | 220 B | b07859119e69142736958bbcc87912e9b719120494145e6d98b45716f404fc24 |
| native/crb_papers/crb_papers.q086.e1.a1.json | 4,1 KB | a6463de1d9fc71f8987428a5184d7e13c73a0a5033b15a26b112374031b32bd5 |
| sources/crb_papers.q086.gold.json | 1,1 KB | 918f24c98b7462a50de1ecf0db5b69a72c675f578cfb8fefa1c83da89ad44b12 |
| sources/crb_papers.q086.script.json | 1,1 KB | e9b57c95ac284e90a4b4ec45eebace2f023add46f0b740479679365370db5d79 |
| specs/crb_papers.q086.json | 14,1 KB | a8216cb03c10cdba271908172e8882c4924eb36420c7b87691fde168d976305c |
| traces/crb_papers.q086.e1.a1.jsonl | 23,1 KB | a4e7d6d0dc3361ffa179485750041ea604806dfcb0478e430e460cd24480e560 |
| trajectories/crb_papers.q086.e1.a1.jsonl | 19,6 KB | 5f90bc1a37d04c48cd6eb1f6d55973acd9ffbb120a2380df544eb3a56da21b2b |