Pular para o conteúdo

Tarefa crb_papers.q038

crb_papersagentT2publicépoca 1, tentativa 1Execução: 20261015T170050Z-suite-crb_papers-scripted-8b13b2

Veredito

passouPassou em todas as verificações obrigatórias.

Família do método (das chamadas de ferramentas): did (OLS on the interaction of a group indicator and a period indicator (2x2 difference in differences))

Pergunta feita ao analista

Among cities with observed reform status at both censuses, how did adopting a civil service commission after 1910 and by 1920 affect the change from 1910 to 1920 in the share of blue-collar city jobs held by foreign-born white residents, compared with cities that had not adopted by 1920, adjusting for the city's foreign-born white population share?

Resposta

Estimativa (infer.ols): coef.Treated_Post = 0,03444. Reference path transcribed from the item's own estimation script.

Valores esperados e de onde vêm

crb_papers.q038.gold

Fonte
CausalReasoningBenchmark, causal_queries.json, index 38 (revision edd0fe1c1d1c)
Tipo
benchmark_gold
Localização
causal_queries.json['38'].effect and .standard_error
Trecho
index 38: effect 0.0344377, standard_error 0.0274434
Valor como publicado
0.03443767309674962
Erro-padrão como publicado
0.02744344488077871
Valor
0,03443770.03443767309674962 (se 0,02744340.02744344488077871)
Conferido por
arquivo do benchmark · Read from the catalog at the pinned revision by scripts/freeze_crb_papers.py; the catalog states the value its estimation script prints.
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json
Licença
MIT
  • #2 figura da resposta próxima: 0,03443770.03443767309674962 · relativa 0.000001 · absoluta 2.744344488077871e-8
  • #3 figura da resposta próxima: 0,02744340.02744344488077871 · relativa 0.000001 · absoluta 2.744344488077871e-8

crb_papers.q038.script

Fonte
CausalReasoningBenchmark reference estimation script for index 38
Tipo
software
Localização
solutions/research_papers/DiD/Kuipers_Sahn_2023/question_1/estimation.py
Valor
—
Conferido por
arquivo do benchmark · sha256 of the script's 1872 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
Implementação
independente da ferramenta
sha256 da cópia lida
a523e06788050d4bbcfd5184fe06acb966f39c69f0d5f4caa41f516803db9bee (identifica a cópia lida, não um arquivo canônico)
Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/DiD/Kuipers_Sahn_2023/question_1/estimation.py
Licença
MIT

    Verificações

    Cada verificação, o que esperava, o que observou e a chamada que leu
    #VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
    0resposta com lastro
    every number backed
    obrigatóriapassou—[]———
    1figura da resposta próxima
    0.0344376731 in [-0.01935147887, 0.08822682506]?
    obrigatóriapassou[-0.01935147886957666,0.08822682506307589]0,03443770.03443767309674896interval · [-0.01935147886957666, 0.08822682506307589]—call_30096d78
    2figura da resposta próxima
    0.0344376731 vs 0.03443767309674962
    registradapassou0,03443770.034437673096749620,03443770.03443767309674896relativa 0.000001 · absoluta 2.744344488077871e-8crb_papers.q038.goldcall_30096d78
    3figura da resposta próxima
    0.02744344488 vs 0.02744344488077871
    registradapassou0,02744340.027443444880778710,02744340.02744344488077873relativa 0.000001 · absoluta 2.744344488077871e-8crb_papers.q038.goldcall_30096d78

    Caminho de referência e caminho do agente

    A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

    caminho de referência do item · benchmark_script

    Referência: infer.olsChamada do agente: infer.ols (call_30096d78)igual
    Argumentos da referência e do agente
    ArgumentoReferênciaAgente
    cluster"city""city"igual
    controls["Treated","Post","pop_prop"]["Treated","Post","pop_prop"]igual
    dataset"ref_panel""ref_panel"igual
    fe—[]não fixado pela referência
    intercept—truenão fixado pela referência
    level—0,950.95não fixado pela referência
    se—"HC1"não fixado pela referência
    subset——não fixado pela referência
    weights——não fixado pela referência
    x["Treated_Post"]["Treated_Post"]igual
    y"govt_prop""govt_prop"igual

    Trajetória

    Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

    1. 0Início

      Among cities with observed reform status at both censuses, how did adopting a civil service commission after 1910 and by 1920 affect the change from 1910 to 1920 in the share of blue-collar city jobs held by foreign-born white residents, compared with cities that had not adopted by 1920, adjusting for the city's foreign-born white population share?

      ds_0020 (agent)

      | Variable Name | Description | | --- | --- | | treat | Binary indicator equal to 1 if the municipality had established a municipal civil service commission (merit-based personnel system) by the given census year; 0 if not yet established. Values are weakly increasing over time within a city. Sourced primarily from U.S. Civil Service Assembly municipal surveys (1937, 1940, 1943) and corroborated by state statutes; may be missing (blank/NA) where adoption year could not be determined. | | pop_prop | Proportion (0–1) of the city’s residents who are foreign-born whites in that census year. Constructed from full-count decennial U.S. Census microdata using birthplace (foreign-born) and enumerated race (white). Available for decennial years 1850–1940 except 1890 (destroyed census). | | govt_prop | Proportion (0–1) of blue-collar municipal government employees who are foreign-born whites in that census year. Computed from full-count decennial U.S. Census microdata by identifying residents employed in local public administration and classifying blue-collar occupations (e.g., craftsmen, mechanics, service workers, laborers); police and fire personnel are excluded due to distinct recruitment regimes. Counts reflect resident workers and assume city employment generally coincides with residence in this era. | | city | Municipality name and two-letter state abbreviation in the standardized format “city, st” (e.g., “aberdeen, sd”). Standardization facilitates consistent tracking across sources and decades; cities with the same name are distinguished by state. | | YEAR | Decennial census year for which measures are calculated (integers from 1850 to 1940; 1890 absent due to the lost census). | Dataset Context: This dataset follows U.S. municipalities at ten-year intervals from the mid-19th to early-20th centuries, a period spanning patronage-based municipal staffing through the widespread diffusion of merit-oriented civil service systems. Municipal adoption of civil service rules was recorded by the U.S. Civil Service Assembly in nationwide surveys conducted in 1937, 1940, and 1943 and supplemented by state-level statutes that, in many cases, mandated adoption using population thresholds. The “treat” indicator reflects whether a city had a functioning municipal civil service commission by a given census year; because commissions, once established, typically persisted, the indicator does not toggle back to zero for later years. Demographic and employment composition measures are derived from the full-count decennial U.S. Censuses (1850–1940, with 1890 unavailable). The census enumerated every resident and captured birthplace, race, industry, and occupation, allowing identification of local public administration workers and classification of blue-collar positions. Blue-collar categories include craftsmen, mechanics, service workers, and laborers; police and fire employees are excluded because their hiring, promotion, and protection rules often followed distinct legal frameworks. Because the census does not name employers, municipal employment is inferred from the industry code “local public administration,” and, consistent with transportation realities of the era, employees are assumed to work in the municipality where they reside. The civil service systems cataloged here typically introduced commission oversight of hiring, promotion, and termination in “classified” services, commonly relying on publicly advertised examinations and shortlists (e.g., a “rule of three”). “Unclassified” roles (e.g., department heads, certain temporary staff) fell outside commission rules, and the scope of coverage varied across cities and over time. City names are standardized to “city, st” to harmonize historical references across sources and decades. Shares are expressed as proportions between 0 and 1 and are calculated at the city–year level to align with the decennial timing of the underlying census enumerations.

      file fb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441 · frame —
      ref_fty (reference)
      file fb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441 · frame —
      1. select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      2. rename {"map":{"YEAR":"year"}}
      3. dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4. filter {"query":"treat == 1"}
      5. collapse {"aggs":[{"column":"year","fn":"min","name":"fty"}],"by":["city"]}
      ref_panel (reference)
      file fb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441 · frame —
      1. select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      2. rename {"map":{"YEAR":"year"}}
      3. dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4. filter {"query":"year in [1910, 1920]"}
      5. merge {"how":"left","on":["city"],"with":"ref_years"}
      6. filter {"query":"nyears == 2"}
      7. merge {"how":"inner","on":["city"],"with":"ref_pre"}
      8. merge {"how":"inner","on":["city"],"with":"ref_post"}
      9. merge {"how":"left","on":["city"],"with":"ref_fty"}
      10. filter {"query":"t_pre == 0 and (t_post == 1 or (t_post == 0 and (fty != fty or fty > 1920)))"}
      11. derive {"args":{"cmp":"eq","column":"t_post","value":1},"name":"Treated","op":"indicator"}
      12. derive {"args":{"cmp":"eq","column":"year","value":1920},"name":"Post","op":"indicator"}
      13. derive {"args":{"columns":["Treated","Post"]},"name":"Treated_Post","op":"interaction"}
      ref_post (reference)
      file fb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441 · frame —
      1. select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      2. rename {"map":{"YEAR":"year"}}
      3. dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4. filter {"query":"year == 1920"}
      5. collapse {"aggs":[{"column":"treat","fn":"max","name":"t_post"}],"by":["city"]}
      ref_pre (reference)
      file fb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441 · frame —
      1. select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      2. rename {"map":{"YEAR":"year"}}
      3. dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4. filter {"query":"year == 1910"}
      5. collapse {"aggs":[{"column":"treat","fn":"max","name":"t_pre"}],"by":["city"]}
      ref_years (reference)
      file fb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441 · frame —
      1. select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      2. rename {"map":{"YEAR":"year"}}
      3. dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4. filter {"query":"year in [1910, 1920]"}
      5. collapse {"aggs":[{"column":"treat","fn":"count","name":"n"}],"by":["city","year"]}
      6. collapse {"aggs":[{"column":"n","fn":"count","name":"nyears"}],"by":["city"]}
    2. 1Transformação
      ref_fty · select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      4408 → 4408 linhas
      Frame antes → depois: cc7d39e21613 → 60f04f92f2b8
    3. 2Transformação
      ref_fty · rename {"map":{"YEAR":"year"}}
      4408 → 4408 linhas
      Frame antes → depois: 60f04f92f2b8 → 8e4754dadcb6
    4. 3Transformação
      ref_fty · dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4408 → 1604 linhas
      Frame antes → depois: 8e4754dadcb6 → a154ac026892
    5. 4Transformação
      ref_fty · filter {"query":"treat == 1"}
      1604 → 781 linhas
      Frame antes → depois: a154ac026892 → 0bba33ca7b15
    6. 5Transformação
      ref_fty · collapse {"aggs":[{"column":"year","fn":"min","name":"fty"}],"by":["city"]}
      781 → 274 linhas
      Frame antes → depois: 0bba33ca7b15 → 132e501a14af
    7. 6Transformação
      ref_years · select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      4408 → 4408 linhas
      Frame antes → depois: cc7d39e21613 → 60f04f92f2b8
    8. 7Transformação
      ref_years · rename {"map":{"YEAR":"year"}}
      4408 → 4408 linhas
      Frame antes → depois: 60f04f92f2b8 → 8e4754dadcb6
    9. 8Transformação
      ref_years · dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4408 → 1604 linhas
      Frame antes → depois: 8e4754dadcb6 → a154ac026892
    10. 9Transformação
      ref_years · filter {"query":"year in [1910, 1920]"}
      1604 → 486 linhas
      Frame antes → depois: a154ac026892 → 9a4dcbb27376
    11. 10Transformação
      ref_years · collapse {"aggs":[{"column":"treat","fn":"count","name":"n"}],"by":["city","year"]}
      486 → 486 linhas
      Frame antes → depois: 9a4dcbb27376 → 7542dbe9be2b
    12. 11Transformação
      ref_years · collapse {"aggs":[{"column":"n","fn":"count","name":"nyears"}],"by":["city"]}
      486 → 260 linhas
      Frame antes → depois: 7542dbe9be2b → cf7818e1994a
    13. 12Transformação
      ref_pre · select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      4408 → 4408 linhas
      Frame antes → depois: cc7d39e21613 → 60f04f92f2b8
    14. 13Transformação
      ref_pre · rename {"map":{"YEAR":"year"}}
      4408 → 4408 linhas
      Frame antes → depois: 60f04f92f2b8 → 8e4754dadcb6
    15. 14Transformação
      ref_pre · dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4408 → 1604 linhas
      Frame antes → depois: 8e4754dadcb6 → a154ac026892
    16. 15Transformação
      ref_pre · filter {"query":"year == 1910"}
      1604 → 229 linhas
      Frame antes → depois: a154ac026892 → dec82e90bdcc
    17. 16Transformação
      ref_pre · collapse {"aggs":[{"column":"treat","fn":"max","name":"t_pre"}],"by":["city"]}
      229 → 229 linhas
      Frame antes → depois: dec82e90bdcc → bd8e1d38873d
    18. 17Transformação
      ref_post · select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      4408 → 4408 linhas
      Frame antes → depois: cc7d39e21613 → 60f04f92f2b8
    19. 18Transformação
      ref_post · rename {"map":{"YEAR":"year"}}
      4408 → 4408 linhas
      Frame antes → depois: 60f04f92f2b8 → 8e4754dadcb6
    20. 19Transformação
      ref_post · dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4408 → 1604 linhas
      Frame antes → depois: 8e4754dadcb6 → a154ac026892
    21. 20Transformação
      ref_post · filter {"query":"year == 1920"}
      1604 → 257 linhas
      Frame antes → depois: a154ac026892 → fcaa1dab1234
    22. 21Transformação
      ref_post · collapse {"aggs":[{"column":"treat","fn":"max","name":"t_post"}],"by":["city"]}
      257 → 257 linhas
      Frame antes → depois: fcaa1dab1234 → c0cb38e967bd
    23. 22Transformação
      ref_panel · select {"columns":["city","YEAR","treat","govt_prop","pop_prop"]}
      4408 → 4408 linhas
      Frame antes → depois: cc7d39e21613 → 60f04f92f2b8
    24. 23Transformação
      ref_panel · rename {"map":{"YEAR":"year"}}
      4408 → 4408 linhas
      Frame antes → depois: 60f04f92f2b8 → 8e4754dadcb6
    25. 24Transformação
      ref_panel · dropna {"columns":["city","year","treat","govt_prop","pop_prop"]}
      4408 → 1604 linhas
      Frame antes → depois: 8e4754dadcb6 → a154ac026892
    26. 25Transformação
      ref_panel · filter {"query":"year in [1910, 1920]"}
      1604 → 486 linhas
      Frame antes → depois: a154ac026892 → 9a4dcbb27376
    27. 26Transformação
      ref_panel · merge {"how":"left","on":["city"],"with":"ref_years"}
      486 → 486 linhas
      Frame antes → depois: 9a4dcbb27376 → 4023bbd1cd35
    28. 27Transformação
      ref_panel · filter {"query":"nyears == 2"}
      486 → 452 linhas
      Frame antes → depois: 4023bbd1cd35 → f1cec1b446c7
    29. 28Transformação
      ref_panel · merge {"how":"inner","on":["city"],"with":"ref_pre"}
      452 → 452 linhas
      Frame antes → depois: f1cec1b446c7 → 6dd6b08c2db3
    30. 29Transformação
      ref_panel · merge {"how":"inner","on":["city"],"with":"ref_post"}
      452 → 452 linhas
      Frame antes → depois: 6dd6b08c2db3 → 594fe5874b69
    31. 30Transformação
      ref_panel · merge {"how":"left","on":["city"],"with":"ref_fty"}
      452 → 452 linhas
      Frame antes → depois: 594fe5874b69 → 57246fdf7c39
    32. 31Transformação
      ref_panel · filter {"query":"t_pre == 0 and (t_post == 1 or (t_post == 0 and (fty != fty or fty > 1920)))"}
      452 → 292 linhas
      Frame antes → depois: 57246fdf7c39 → 1a092f923196
    33. 32Transformação
      ref_panel · derive {"args":{"cmp":"eq","column":"t_post","value":1},"name":"Treated","op":"indicator"}
      292 → 292 linhas
      Frame antes → depois: 1a092f923196 → 732f70ce5b98
    34. 33Transformação
      ref_panel · derive {"args":{"cmp":"eq","column":"year","value":1920},"name":"Post","op":"indicator"}
      292 → 292 linhas
      Frame antes → depois: 732f70ce5b98 → df006421bf33
    35. 34Transformação
      ref_panel · derive {"args":{"columns":["Treated","Post"]},"name":"Treated_Post","op":"interaction"}
      292 → 292 linhas
      Frame antes → depois: df006421bf33 → 705596efb9c1
    36. 35Turno do modelo
      call_55a8a2d0referenceFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Texto visível

      smf.ols('govt_prop ~ Treated * Post + pop_prop').fit(cov_type='cluster', groups=city) (CR1 errors with statsmodels' default G/(G-1)·(N-1)/(N-K) correction)

      Chamadas pedidas
      • infer.ols
        {
          "cluster": "city",
          "controls": [
            "Treated",
            "Post",
            "pop_prop"
          ],
          "dataset": "ref_panel",
          "x": [
            "Treated_Post"
          ],
          "y": "govt_prop"
        }
    37. 36Ferramenta
      infer.olsv0.1.0call_30096d78decidido pelo modeloreexecutável

      Motivo: smf.ols('govt_prop ~ Treated * Post + pop_prop').fit(cov_type='cluster', groups=city) (CR1 errors with statsmodels' default G/(G-1)·(N-1)/(N-K) correction)

      Argumentos
      {
        "cluster": "city",
        "controls": [
          "Treated",
          "Post",
          "pop_prop"
        ],
        "dataset": "ref_panel",
        "fe": [],
        "intercept": true,
        "level": 0.95,
        "se": "HC1",
        "subset": null,
        "weights": null,
        "x": [
          "Treated_Post"
        ],
        "y": "govt_prop"
      }
      Figuras call_30096d78
      ChaveValorValor brutoErro-padrãoIC
      coef.Treated_Post
      Coefficient on Treated_Post in the regression of govt_prop
      0,0344377 0.034437673096748960,02744340.02744344488077873-0,0198032 – 0,0886785
      Diagnósticos
      • n_obs = 292292
      • k = 55
      • r2 = 0,6321580.6321576522459224
      • df_resid = 287287
      • se_type = "cluster"
      • n_clusters = 146146
      Tabelas (1)
      {
        "coefficients": [
          {
            "ci_high": 0.045371023944644456,
            "ci_low": -0.028692486344431667,
            "coef": 0.008339268800106393,
            "p": 0.6569230471367641,
            "se": 0.018736409205967582,
            "t": 0.44508361812733677,
            "term": "Intercept"
          },
          {
            "ci_high": 0.08867853216295346,
            "ci_low": -0.01980318596945555,
            "coef": 0.03443767309674896,
            "p": 0.21154848595878667,
            "se": 0.02744344488077873,
            "t": 1.2548597031588027,
            "term": "Treated_Post"
          },
          {
            "ci_high": 0.020577002721206494,
            "ci_low": -0.08564890321618714,
            "coef": -0.03253595024749032,
            "p": 0.22796474127664493,
            "se": 0.026872774921811712,
            "t": -1.2107402507614502,
            "term": "Treated"
          },
          {
            "ci_high": -0.0031813467084536792,
            "ci_low": -0.0907743477039682,
            "coef": -0.04697784720621093,
            "p": 0.03570641881861589,
            "se": 0.0221590673170233,
            "t": -2.1200281823288227,
            "term": "Post"
          },
          {
            "ci_high": 1.9923714616457968,
            "ci_low": 1.577424298503616,
            "coef": 1.7848978800747064,
            "p": 2.3978855394643752e-36,
            "se": 0.10497233816142787,
            "t": 17.003506936559482,
            "term": "pop_prop"
          }
        ]
      }
      Digests dos dados
      ref_panel 705596efb9c19b0c18dcb184672d04e6adb320636f99043b4cc3ec02a23171a8
      sha256 do resultado
      fa5738150d8d7095188002c0eafa1ab4cb08689642eea23c47c2e972d09dfea0
    38. 37Turno do modelo
      call_dc1864b5referenceFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
      Chamadas pedidas
      • submit_answer (meta-ferramenta)
        {
          "answer": "Estimativa (infer.ols): coef.Treated_Post = 0,03444. Reference path transcribed from the item's own estimation script.",
          "caveats": [],
          "figure_refs": [
            "call_30096d78:coef.Treated_Post"
          ]
        }
    39. 38Guarda
      resposta aceita
      Números encontrados
      0,03444
      Sem lastro
      —
      Não citados
      —
      1 nova(s) tentativa(s) restante(s)
    40. 39Resposta

      Estimativa (infer.ols): coef.Treated_Post = 0,03444. Reference path transcribed from the item's own estimation script.

      Figuras citadas: call_30096d78:coef.Treated_Post · Parada: answered
      Figura da resposta: call_30096d78:coef.Treated_Post = 0,03443770.03443767309674896 (se 0,02744340.02744344488077873)
    41. 40Pontuação
      #0resposta com lastropassouobrigatóriaevery number backed
    42. 41Pontuação
      #1figura da resposta próximapassouobrigatória0.0344376731 in [-0.01935147887, 0.08822682506]?
    43. 42Pontuação
      #2figura da resposta próximapassouregistrada0.0344376731 vs 0.03443767309674962
    44. 43Pontuação
      #3figura da resposta próximapassouregistrada0.02744344488 vs 0.02744344488077871

    Épocas × verificações

    Resultado de cada verificação em cada época pontuada
    #0123
    Época 1passoupassoupassoupassou

    Tentativas

    Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

    Downloads desta tarefa

    Pacote da tarefa (.zip)
    103,8 KB · sha256 7fd73a428db12213b52dad908148102988dcfdd1ce6dbc72d58fd237fee306c9

    O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

    Downloads desta tarefa
    ArquivoTamanhosha256
    attachments/1674455ecd7f4a658fa3eefcb64e83378f1c3f504b78b49cf380a0dd4240d959.json5,5 KB1674455ecd7f4a658fa3eefcb64e83378f1c3f504b78b49cf380a0dd4240d959
    attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
    attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
    attachments/54d32dc3be8777ead7340a24f65dd4550a4921f97506fab9d925e2f0b24e0b96.json1,3 KB54d32dc3be8777ead7340a24f65dd4550a4921f97506fab9d925e2f0b24e0b96
    attachments/68dbddda13f026c50fd9401649d2d8e18b912f2ff36ca9030d7088afac1583c5.json375 B68dbddda13f026c50fd9401649d2d8e18b912f2ff36ca9030d7088afac1583c5
    attachments/d78a3f788b5035b3c118b09822b37d95116d974cafb6c473a17478ea0ac1a703.json1,2 KBd78a3f788b5035b3c118b09822b37d95116d974cafb6c473a17478ea0ac1a703
    attachments/f0d077b0d71775085d31e0ce1b2f001231bcd4c6ab95e8a469268f0a1d4ca5c8.json369 Bf0d077b0d71775085d31e0ce1b2f001231bcd4c6ab95e8a469268f0a1d4ca5c8
    native/crb_papers/crb_papers.q038.e1.a1.json4,8 KB51cc9b20eef7c51939fcb2757b90b78b2b08f41a833b37f0e95d04071357e529
    sources/crb_papers.q038.gold.json1,1 KB7ac5bfa715117c7cdd08aa2470f1383ba2fc724d5eb338dc2f17baf7c3f6425b
    sources/crb_papers.q038.script.json1,1 KBd498219677f017548073520d75f7016dade0026e7c6e9ac6ebde46773064a118
    specs/crb_papers.q038.json15,5 KB9d3989d1e1b6dd34a3c54a99623f9ac2ae8bef96043b6a598117c394f5990399
    traces/crb_papers.q038.e1.a1.jsonl47,2 KB31b037921eaa2960c9baa1acd2b4b7c8280e63f77e9e123db5466f90094615bf
    trajectories/crb_papers.q038.e1.a1.jsonl36,1 KBb75b54a7ac48029e9fecf9cbaff0533ef34555443662b686884a71f4546e6409