Pular para o conteúdo

Tarefa causcibench_real.q099

causcibench_realagentT2publicépoca 1, tentativa 1Execução: 20261015T171059Z-suite-causcibench_real-scripted-ded01d

Veredito

falhouDecidida pela verificação 1: figura da resposta próxima, fora da tolerância.
-0.008225022341 vs -0.009

Família do método (das chamadas de ferramentas): ols (regression)

Pergunta feita ao analista

Does winning a voucher affect whether students get married a few years later?

Resposta

Estimativa (infer.ols): coef.VOUCH0 = -0,008225.

Valores esperados e de onde vêm

causcibench_real.gold.q099

Fonte
CauSciBench real split, data/metadata_json/real_input.json at d9bb43a, id 99
Tipo
benchmark_gold
Localização
real_input.json, record id 99: fields effect and std_error
Trecho
id 99 effect -0.009 std_error 0.006
Valor como publicado
-0.009
Erro-padrão como publicado
0.006
Valor
-0,009-0.009 (se 0,0060.006)
Conferido por
arquivo do benchmark · Written by scripts/freeze_causcibench_real.py from the pinned file; equal to the `answer` and `std_error` of the same id in data/metadata_csv/real_input.csv at the pin.
sha256 da cópia lida
c1f4c8930675afff63d816d8ed066941ae92697e7bfc31e9d38519398dd80438 (identifica a cópia lida, não um arquivo canônico)
Endereço
https://raw.githubusercontent.com/causalNLP/CauSciBench/d9bb43a2d90f261978cc5ac0b628c0484f6e8956/data/metadata_json/real_input.json
Licença
CauSciBench repository (MIT for code; metadata as published in the repository)
  • #1 figura da resposta próxima: -0,009-0.009 · relativa 0.05

Verificações

Cada verificação, o que esperava, o que observou e a chamada que leu
#VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
0resposta com lastro
every number backed
obrigatóriapassou—[]———
1figura da resposta próxima
-0.008225022341 vs -0.009
obrigatóriafalhou-0,009-0.009-0,00822502-0.00822502234106659relativa 0.05causcibench_real.gold.q099call_a78b4916

Caminho de referência e caminho do agente

A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

caminho de referência do item · metadata_rule

Referência: infer.olsChamada do agente: infer.ols (call_a78b4916)igual
Argumentos da referência e do agente
ArgumentoReferênciaAgente
cluster——não fixado pela referência
controls["SVY","HSVISIT","DJAMUNDI","PHONE","AGE","SEX2","DBOGOTA","D1993","D1995","D1997","DMONTH1","DMONTH2","DMONTH3","DMONTH4","DMONTH5","DMONTH6","DMONTH7","DMONTH8","DMONTH9","DMONTH10","DMONTH11","STRATA1","STRATA2","STRATA3","STRATA4","STRATA5","STRATAMS","SEX_MISS"]["SVY","HSVISIT","DJAMUNDI","PHONE","AGE","SEX2","DBOGOTA","D1993","D1995","D1997","DMONTH1","DMONTH2","DMONTH3","DMONTH4","DMONTH5","DMONTH6","DMONTH7","DMONTH8","DMONTH9","DMONTH10","DMONTH11","STRATA1","STRATA2","STRATA3","STRATA4","STRATA5","STRATAMS","SEX_MISS"]igual
dataset"angrist_vouchers""angrist_vouchers"igual
fe—[]não fixado pela referência
intercept—truenão fixado pela referência
level—0,950.95não fixado pela referência
se—"HC1"não fixado pela referência
subset——não fixado pela referência
weights——não fixado pela referência
x["VOUCH0"]["VOUCH0"]igual
y"MARRIED""MARRIED"igual

Trajetória

Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

  1. 0Início

    Does winning a voucher affect whether students get married a few years later?

    angrist_vouchers (agent)

    This dataset is an individual-level microdata file on applicants to Colombia's PACES secondary-school voucher program, combining lottery assignment records, follow-up survey responses, and achievement test participation indicators for cohorts in Bogota (1995, 1997) and Jamundi (1993). It is structured to support analysis of schooling trajectories, private versus public school attendance, household background, labor and family formation outcomes, and test-taking behavior for voucher-eligible youth, without embedding specific modeling choices. Variables include: ID: Numeric identifier linking each record to the original PACES applicant list, stable within the file and used to join administrative lottery status, survey outcomes, and test participation. BOG95SMP: Indicator for membership in the Bogota 1995 applicant cohort analysis sample (1 = Bogota 1995 cohort, 0 otherwise), aligning each individual with that specific city-year sampling frame. BOG97SMP: Indicator for membership in the Bogota 1997 applicant cohort analysis sample (1 = Bogota 1997 cohort, 0 otherwise), distinguishing this later application year within Bogota. JAM93SMP: Indicator for membership in the Jamundi 1993 applicant cohort analysis sample (1 = Jamundi 1993 cohort, 0 otherwise), identifying applicants from the suburban Cali site. SEX: Binary sex indicator at the individual level, derived from survey or name-based coding and used for gender-disaggregated description and outcome analysis. AGE: Applicant's age in completed years, typically imputed from the Colombian national ID at the time of program application and used as a key demographic control. AGE2: Square of age, capturing non-linear relationships between age and schooling outcomes or other behaviors such as work and marriage. HSVISIT: Indicator for interview mode (1 = household visit, 0 = telephone interview), reflecting fieldwork logistics and used to control for mode-related response differences. SCYFNSH: Measure summarizing schooling completion within the secondary cycle (for example, highest grade completed by survey date), constructed from detailed grade histories. INSCHL: Binary indicator for current school enrollment at the survey date (1 = currently in school, 0 = not enrolled), derived from self-reported enrollment status. PRSCH_C: Binary indicator for current private secondary school attendance (1 = enrolled in a private school at survey time, 0 = public school or not enrolled), used to describe current sector of schooling. PRSCHA_1: Indicator capturing private-school attendance at a key grade or early stage of secondary schooling (1 = attended a participating private secondary school at that stage, 0 otherwise), constructed from retrospective schooling histories. PRSCHA_2: Complementary indicator for private-school attendance at an additional grade or later stage of secondary schooling, allowing distinctions between initial and subsequent private enrollment episodes. VOUCH0: Binary lottery-assignment indicator for the PACES voucher offer (1 = offered a PACES scholarship via lottery, 0 = not offered), taken from administrative lottery records and used to distinguish voucher winners from losers. BOG95ASD: Indicator for inclusion in the Bogota 1995 achievement-test subsample (1 = invited/test sample for Bogota 1995, 0 otherwise), identifying records with linked standardized test scores. BOG97ASD: Indicator for inclusion in any Bogota 1997 achievement-related subsample if present, parallel in structure to BOG95ASD but for the 1997 cohort. JAM93ASD: Indicator for inclusion in any Jamundi 1993 achievement-test subsample if collected, flagging Jamundi test-takers within the broader applicant frame. DBOGOTA: City dummy for Bogota (1 = Bogota, 0 = other sites), aligning individuals with the capital city context for descriptive and regression controls. DJAMUNDI: City dummy for Jamundi (1 = Jamundi, 0 = other sites), capturing the suburban Cali site as distinct from Bogota. D1995: Application-year dummy (1 = applied in 1995, 0 otherwise), marking the Bogota 1995 cohort in pooled analyses across years. D1997: Application-year dummy (1 = applied in 1997, 0 otherwise), identifying the later Bogota cohort in multi-cohort analyses. D1993: Application-year dummy (1 = applied in 1993, 0 otherwise), corresponding to the Jamundi 1993 cohort. RESPONSE: Indicator that a valid 1998 follow-up survey interview was completed for the applicant (1 = interviewed, 0 = in sampling frame but not interviewed), capturing differential follow-up. TEST_TAK: Indicator that the applicant took the 1999 standardized achievement test (1 = test-taker, 0 = not tested), linking survey records to test-score availability. SEX_NAME: Auxiliary indicator of sex coded from first names in the application list, used to impute sex where direct survey information is missing. SVY: Survey-form or instrument indicator that flags the questionnaire version or survey group, enabling control for minor differences in question wording or survey conditions. PHONE: Indicator for having a telephone contact at application (1 = phone number recorded, 0 = no phone), reflecting contactability and part of the implicit sampling frame for telephone interviews. DAREA1-DAREA19: Set of neighborhood or large-area dummies for Bogota (and analogous groupings where applicable), capturing 19 residential areas used as geographic strata or controls. DMONTH1-DMONTH12: Interview-month dummies (1 = interviewed in the corresponding calendar month, 0 otherwise), representing survey timing over the fieldwork period. BOG95: Indicator for being in the Bogota 1995 cohort in contexts where this cohort is contrasted with others, often overlapping conceptually with BOG95SMP but used in some outcome subsamples. BOG97: Indicator for being in the Bogota 1997 cohort, similarly used as a cohort marker in pooled models. MOM_SCH: Mother's highest completed grade of schooling in years, as reported in the survey, serving as a parental human-capital measure. MOM_AGE: Mother's age in years at the time of survey, capturing parental lifecycle stage. MOM_MW: Indicator that the mother's wage exceeds a threshold multiple of the minimum wage (for example, more than two minimum wages), proxying maternal earnings capacity. DAD_SCH: Father's highest completed grade of schooling in years, measuring paternal education as part of family background. DAD_AGE: Father's age in years at the time of survey, capturing paternal lifecycle stage. DAD_MW: Indicator that the father's wage exceeds a threshold multiple of the minimum wage, summarizing paternal earnings potential. SEX2: Harmonized or alternative sex indicator used in the main analytic regressions, combining name-based and survey-based sex coding where necessary. STRATA1-STRATA6: Set of dummies for the six official Colombian socioeconomic residential strata, derived from utility-bill based classification in the application and used to capture household socioeconomic status. STRATAMS: Indicator for missing or unspecified socioeconomic stratum, preserving individuals with incomplete strata information in analyses. REPT6: Indicator that the applicant repeated sixth grade at least once, summarizing early grade repetition at the entry to secondary schooling. TOTSCYRS: Total number of calendar years spent in school since the time of application, aggregating enrollment histories into a duration-style schooling exposure measure. HASCHILD: Indicator that the applicant has at least one child at the time of survey, measuring early fertility outcomes. MARRIED: Indicator that the applicant is married or cohabiting with a partner at the time of survey, capturing early union formation. WORKING: Binary indicator that the applicant is engaged in paid work at the time of survey, summarizing labor-force participation. REPT: Indicator that the applicant has repeated at least one grade after the lottery, capturing any post-application grade repetition. NREPT: Count of grades repeated since the lottery, providing a more granular measure of cumulative repetition. FINISH6: Indicator that the applicant has successfully completed grade 6, the first year of Colombian secondary school. FINISH7: Indicator that the applicant has successfully completed grade 7, reflecting progression through early secondary schooling. FINISH8: Indicator that the applicant has successfully completed grade 8, used to summarize lower-secondary completion. SEX_MISS: Indicator that sex information is missing in the primary coding, flagging records relying on imputation or with unresolved sex classification. USNGSCH: Indicator that the applicant is using any scholarship (PACES voucher or other scholarship) in the survey year, capturing current scholarship utilization. HOURSUM: Total number of hours worked per week by the applicant at the time of survey, computed from reported work schedules and used to quantify labor supply. TAB3SMPL: Indicator that an observation is included in the analysis sample corresponding to a specific table (for example, Table 3) in the original study, marking the main balanced analytic subsample. WORKING3: Alternative working-status indicator defined for the Table 3 sample or using a particular coding of work (e.g., excluding very low-intensity work), complementing WORKING.

    file 40d8713a6c7abe4501d9e215e3af62cada0199b2782dd0d6fbabbee355d8535a · frame —
  2. 1Turno do modelo
    call_29bb0043referenceFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
    Texto visível

    causcibench_metadata_rule/1: ols

    Chamadas pedidas
    • infer.ols
      {
        "controls": [
          "SVY",
          "HSVISIT",
          "DJAMUNDI",
          "PHONE",
          "AGE",
          "SEX2",
          "DBOGOTA",
          "D1993",
          "D1995",
          "D1997",
          "DMONTH1",
          "DMONTH2",
          "DMONTH3",
          "DMONTH4",
          "DMONTH5",
          "DMONTH6",
          "DMONTH7",
          "DMONTH8",
          "DMONTH9",
          "DMONTH10",
          "DMONTH11",
          "STRATA1",
          "STRATA2",
          "STRATA3",
          "STRATA4",
          "STRATA5",
          "STRATAMS",
          "SEX_MISS"
        ],
        "dataset": "angrist_vouchers",
        "x": [
          "VOUCH0"
        ],
        "y": "MARRIED"
      }
  3. 2Ferramenta
    infer.olsv0.1.0call_a78b4916decidido pelo modeloreexecutável

    Motivo: causcibench_metadata_rule/1: ols

    Argumentos
    {
      "cluster": null,
      "controls": [
        "SVY",
        "HSVISIT",
        "DJAMUNDI",
        "PHONE",
        "AGE",
        "SEX2",
        "DBOGOTA",
        "D1993",
        "D1995",
        "D1997",
        "DMONTH1",
        "DMONTH2",
        "DMONTH3",
        "DMONTH4",
        "DMONTH5",
        "DMONTH6",
        "DMONTH7",
        "DMONTH8",
        "DMONTH9",
        "DMONTH10",
        "DMONTH11",
        "STRATA1",
        "STRATA2",
        "STRATA3",
        "STRATA4",
        "STRATA5",
        "STRATAMS",
        "SEX_MISS"
      ],
      "dataset": "angrist_vouchers",
      "fe": [],
      "intercept": true,
      "level": 0.95,
      "se": "HC1",
      "subset": null,
      "weights": null,
      "x": [
        "VOUCH0"
      ],
      "y": "MARRIED"
    }
    Figuras call_a78b4916
    ChaveValorValor brutoErro-padrãoIC
    coef.VOUCH0
    Coefficient on VOUCH0 in the regression of MARRIED
    -0,00822502 -0.008225022341066590,004881150.004881150746083452-0,017798 – 0,00134795
    Diagnósticos
    • n_obs = 1.9301930
    • k = 2929
    • r2 = 0,08278560.0827855830270281
    • df_resid = 1.9011901
    • se_type = "HC1"
    • n_clusters = —
    Tabelas (1)
    {
      "coefficients": [
        {
          "ci_high": -0.007084655740565715,
          "ci_low": -0.21075761248033437,
          "coef": -0.10892113411045004,
          "p": 0.03606762619695911,
          "se": 0.05192526020969755,
          "t": -2.0976521575544833,
          "term": "Intercept"
        },
        {
          "ci_high": 0.0013479523607691415,
          "ci_low": -0.017797997042902323,
          "coef": -0.00822502234106659,
          "p": 0.09214150506803258,
          "se": 0.004881150746083452,
          "t": -1.6850580465408083,
          "term": "VOUCH0"
        },
        {
          "ci_high": 0.02402005982426781,
          "ci_low": -0.023018802958425476,
          "coef": 0.0005006284329211654,
          "p": 0.9667056808474467,
          "se": 0.011992290135407502,
          "t": 0.04174585731903274,
          "term": "SVY"
        },
        {
          "ci_high": 0.03199749214336561,
          "ci_low": -0.004749577965322266,
          "coef": 0.013623957089021673,
          "p": 0.14604564599972703,
          "se": 0.0093684562147128,
          "t": 1.4542371525017934,
          "term": "HSVISIT"
        },
        {
          "ci_high": 0.9722224329416844,
          "ci_low": 0.8932365971508416,
          "coef": 0.932729515046263,
          "p": 0,
          "se": 0.020136988935454177,
          "t": 46.31921475628629,
          "term": "DJAMUNDI"
        },
        {
          "ci_high": 0.05804041526416849,
          "ci_low": -0.042503906938825026,
          "coef": 0.007768254162671736,
          "p": 0.7618815804943834,
          "se": 0.025633202250157697,
          "t": 0.30305437794546114,
          "term": "PHONE"
        },
        {
          "ci_high": 0.011750663399564255,
          "ci_low": 0.0024794920123776334,
          "coef": 0.007115077705970944,
          "p": 0.0026448525887102317,
          "se": 0.0023636323370287158,
          "t": 3.01023031141772,
          "term": "AGE"
        },
        {
          "ci_high": -0.012037789976854086,
          "ci_low": -0.030995545328613025,
          "coef": -0.021516667652733554,
          "p": 0.00000900628445855606,
          "se": 0.004833171744492382,
          "t": -4.451873177743533,
          "term": "SEX2"
        },
        {
          "ci_high": 0.01635253959921413,
          "ci_low": -0.04377594062099276,
          "coef": -0.013711700510889319,
          "p": 0.37118370643154497,
          "se": 0.015329413543286893,
          "t": -0.8944699986187007,
          "term": "DBOGOTA"
        },
        {
          "ci_high": -0.8644033022210391,
          "ci_low": -0.9737230491395368,
          "coef": -0.919063175680288,
          "p": 5.556771188536576e-189,
          "se": 0.027870446796989537,
          "t": -32.97626271924574,
          "term": "D1993"
        },
        {
          "ci_high": 0.05309755095908691,
          "ci_low": -0.01724459977347905,
          "coef": 0.017926475592803928,
          "p": 0.3176227519582797,
          "se": 0.017933330663849837,
          "t": 0.9996177469107996,
          "term": "D1995"
        },
        {
          "ci_high": 0.06418999351284253,
          "ci_low": -0.008604941351714291,
          "coef": 0.02779252608056412,
          "p": 0.13441602796949872,
          "se": 0.018558654007363583,
          "t": 1.497550742070884,
          "term": "D1997"
        },
        {
          "ci_high": 0.1615172526257007,
          "ci_low": -0.026824983483825324,
          "coef": 0.06734613457093769,
          "p": 0.16091311466056488,
          "se": 0.048016780308045036,
          "t": 1.4025541516713083,
          "term": "DMONTH1"
        },
        {
          "ci_high": 0.11907917253164776,
          "ci_low": -0.02982664690697301,
          "coef": 0.04462626281233738,
          "p": 0.23993014351508724,
          "se": 0.037962690505680165,
          "t": 1.1755295058884243,
          "term": "DMONTH2"
        },
        {
          "ci_high": 0.04232096670301985,
          "ci_low": -0.014463673946115587,
          "coef": 0.013928646378452132,
          "p": 0.3361078254093566,
          "se": 0.014476920690987341,
          "t": 0.9621276979933627,
          "term": "DMONTH3"
        },
        {
          "ci_high": 0.03558663799824346,
          "ci_low": -0.016408359836630186,
          "coef": 0.009589139080806636,
          "p": 0.469529066329134,
          "se": 0.013255828537060307,
          "t": 0.72339039796702,
          "term": "DMONTH4"
        },
        {
          "ci_high": 0.045564039523669025,
          "ci_low": -0.012801512167066115,
          "coef": 0.016381263678301457,
          "p": 0.27108218276659796,
          "se": 0.014879964956251941,
          "t": 1.1008939689349693,
          "term": "DMONTH5"
        },
        {
          "ci_high": 0.03589769379522019,
          "ci_low": -0.021797383528824172,
          "coef": 0.007050155133198008,
          "p": 0.6317747245145285,
          "se": 0.014709031335453017,
          "t": 0.4793079144651148,
          "term": "DMONTH6"
        },
        {
          "ci_high": 0.016740961013023192,
          "ci_low": -0.01350411076878614,
          "coef": 0.001618425122118525,
          "p": 0.8337756676695387,
          "se": 0.0077108087763365874,
          "t": 0.2098904497651724,
          "term": "DMONTH7"
        },
        {
          "ci_high": 0.03617934700801392,
          "ci_low": -0.0046617343659952,
          "coef": 0.01575880632100936,
          "p": 0.13032039275577265,
          "se": 0.010412201067520402,
          "t": 1.5134942380403167,
          "term": "DMONTH8"
        },
        {
          "ci_high": 0.013679700975410032,
          "ci_low": -0.019487210049801303,
          "coef": -0.0029037545371956353,
          "p": 0.7313300187541231,
          "se": 0.008455715048789846,
          "t": -0.34340733107026955,
          "term": "DMONTH9"
        },
        {
          "ci_high": 0.028671106957570164,
          "ci_low": -0.010312219680752488,
          "coef": 0.009179443638408837,
          "p": 0.3558027190479542,
          "se": 0.009938577079336394,
          "t": 0.9236174922357955,
          "term": "DMONTH10"
        },
        {
          "ci_high": 0.020632851643097583,
          "ci_low": -0.011551698074125672,
          "coef": 0.004540576784485955,
          "p": 0.5800728275806863,
          "se": 0.008205267628799796,
          "t": 0.5533733925446763,
          "term": "DMONTH11"
        },
        {
          "ci_high": 0.015686345035341165,
          "ci_low": -0.02210166376009773,
          "coef": -0.0032076593623782826,
          "p": 0.7392030105785423,
          "se": 0.009633837603764602,
          "t": -0.33295759118098794,
          "term": "STRATA1"
        },
        {
          "ci_high": 0.017210084259161026,
          "ci_low": -0.015283038056509999,
          "coef": 0.0009635231013255133,
          "p": 0.9074173807648732,
          "se": 0.008283936455159768,
          "t": 0.11631222747071764,
          "term": "STRATA2"
        },
        {
          "ci_high": 0.015196793371286607,
          "ci_low": -0.01735559265318056,
          "coef": -0.001079399640946976,
          "p": 0.8965302579494413,
          "se": 0.008299045400154186,
          "t": -0.1300631083337515,
          "term": "STRATA3"
        },
        {
          "ci_high": 0.24362660803926292,
          "ci_low": -0.09197567094557571,
          "coef": 0.0758254685468436,
          "p": 0.3756074083435747,
          "se": 0.08555988945317185,
          "t": 0.886226817629819,
          "term": "STRATA4"
        },
        {
          "ci_high": 0.030012156646930264,
          "ci_low": -0.059054201723992235,
          "coef": -0.014521022538530985,
          "p": 0.5225770251869502,
          "se": 0.022706960749086524,
          "t": -0.6394965270336829,
          "term": "STRATA5"
        },
        {
          "ci_high": 0.03935029257387182,
          "ci_low": -0.0019630991895663863,
          "coef": 0.018693596692152717,
          "p": 0.07608599211217408,
          "se": 0.010532613911048686,
          "t": 1.7748297668580808,
          "term": "STRATAMS"
        }
      ]
    }
    • 23400 rows were dropped because one of 'MARRIED', 'VOUCH0', 'SVY', 'HSVISIT', 'DJAMUNDI', 'PHONE', 'AGE', 'SEX2', 'DBOGOTA', 'D1993', 'D1995', 'D1997', 'DMONTH1', 'DMONTH2', 'DMONTH3', 'DMONTH4', 'DMONTH5', 'DMONTH6', 'DMONTH7', 'DMONTH8', 'DMONTH9', 'DMONTH10', 'DMONTH11', 'STRATA1', 'STRATA2', 'STRATA3', 'STRATA4', 'STRATA5', 'STRATAMS', 'SEX_MISS' was missing
    • dropped as collinear with the other regressors: ['SEX_MISS']
    Digests dos dados
    angrist_vouchers e48260ecfdd86708973880a3dbe8646bab534cb52d58ab93016082782907a7e9
    sha256 do resultado
    3be1c6120262dc5a4f7424752966cd69ed3d7a8d95a2aaf22b938defe42dffe8
  4. 3Turno do modelo
    call_57d510e7referenceFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
    Chamadas pedidas
    • submit_answer (meta-ferramenta)
      {
        "answer": "Estimativa (infer.ols): coef.VOUCH0 = -0,008225.",
        "caveats": [],
        "figure_refs": [
          "call_a78b4916:coef.VOUCH0"
        ]
      }
  5. 4Guarda
    resposta aceita
    Números encontrados
    -0,008225
    Sem lastro
    —
    Não citados
    —
    1 nova(s) tentativa(s) restante(s)
  6. 5Resposta

    Estimativa (infer.ols): coef.VOUCH0 = -0,008225.

    Figuras citadas: call_a78b4916:coef.VOUCH0 · Parada: answered
    Figura da resposta: call_a78b4916:coef.VOUCH0 = -0,00822502-0.00822502234106659 (se 0,004881150.004881150746083452)
  7. 6Pontuação
    #0resposta com lastropassouobrigatóriaevery number backed
  8. 7Pontuação
    #1figura da resposta próximafalhouobrigatória-0.008225022341 vs -0.009

Épocas × verificações

Resultado de cada verificação em cada época pontuada
#01
Época 1passoufalhou

Tentativas

Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

Downloads desta tarefa

Pacote da tarefa (.zip)
114,7 KB · sha256 8c49a83b4a597bdb761ba5bbe79656ba1d1953dcdfb20fc850368cc32acfb534

O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

Downloads desta tarefa
ArquivoTamanhosha256
attachments/1d38934f56a875e1b85c825c23780008394b02f090ead323d5fa35f284af3a26.json102 B1d38934f56a875e1b85c825c23780008394b02f090ead323d5fa35f284af3a26
attachments/2daee10d61bfa7dcfcd52b5bfb7d515fa4657349a7fdcc4de0f858517bc72756.json11,9 KB2daee10d61bfa7dcfcd52b5bfb7d515fa4657349a7fdcc4de0f858517bc72756
attachments/4302454eded6b39cf531e2eb5ea4287593b3925ca51ed8db30684cc3c01588a3.json461 B4302454eded6b39cf531e2eb5ea4287593b3925ca51ed8db30684cc3c01588a3
attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
attachments/de9b90d38e60b7a31df0afdf0ccabf6811830a40860b77fee7d8b704d3ee324e.json2,5 KBde9b90d38e60b7a31df0afdf0ccabf6811830a40860b77fee7d8b704d3ee324e
attachments/ef461713fb2b77fa50e79db6bb2d8e5d0a8399790d8ae97a472333fe9c3a5154.json2,6 KBef461713fb2b77fa50e79db6bb2d8e5d0a8399790d8ae97a472333fe9c3a5154
native/causcibench_real/causcibench_real.q099.e1.a1.json2,2 KB7c77c6af2735b3d7dbbce0093b81df8b64f44979a5f40ad6777705f5a3c50b22
sources/causcibench_real.gold.q099.json1,2 KB21b8ea15dcf109b3b7f0787b2b9c0950ac04d641d7036be007405fe3e302a330
specs/causcibench_real.q099.json14,2 KB0fb0cbafab01d60d595b4414302558cc06af525cf4172e6661a202288c76a251
traces/causcibench_real.q099.e1.a1.jsonl28,6 KB98eb6f9bf572d2cdfe87dedc921b50a23730356940e20c9aba1cea8d34e3dfe6
trajectories/causcibench_real.q099.e1.a1.jsonl23,2 KB48aa17b15f5cef6239fed3f6446276068b7832a24d7b9366adca610e8d83d539