Tarefa crb_papers.q039
crb_papersagentT2publicépoca 1, tentativa 1Execução: 20261015T170050Z-suite-crb_papers-scripted-8b13b2Veredito
Família do método (das chamadas de ferramentas): did (OLS on the interaction of a group indicator and a period indicator (2x2 difference in differences))
Pergunta feita ao analista
Among cities with observed reform status at both censuses, how did adopting a civil service commission after 1930 and by 1940 affect the change from 1930 to 1940 in the share of blue-collar city jobs held by foreign-born white residents, compared with cities that had not adopted by 1940, adjusting for the city's foreign-born white population share?
Estimativa (infer.ols): coef.Treated_Post = 0,01418. Reference path transcribed from the item's own estimation script.
Valores esperados e de onde vêm
crb_papers.q039.gold
- Fonte
- CausalReasoningBenchmark, causal_queries.json, index 39 (revision edd0fe1c1d1c)
- Tipo
- benchmark_gold
- Localização
- causal_queries.json['39'].effect and .standard_error
- Trecho
index 39: effect 0.0141794, standard_error 0.0311452
- Valor como publicado
0.014179411903156684- Erro-padrão como publicado
0.031145196886261866- Valor
- 0,0141794
0.014179411903156684(se 0,03114520.031145196886261866) - Conferido por
- arquivo do benchmark · Read from the catalog at the pinned revision by scripts/freeze_crb_papers.py; the catalog states the value its estimation script prints.
- Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/causal_queries.json- Licença
- MIT
- #2 figura da resposta próxima: 0,0141794
0.014179411903156684· relativa 0.000001 · absoluta 3.1145196886261864e-8 - #3 figura da resposta próxima: 0,0311452
0.031145196886261866· relativa 0.000001 · absoluta 3.1145196886261864e-8
crb_papers.q039.script
- Fonte
- CausalReasoningBenchmark reference estimation script for index 39
- Tipo
- software
- Localização
- solutions/research_papers/DiD/Kuipers_Sahn_2023/question_2/estimation.py
- Valor
- —
- Conferido por
- arquivo do benchmark · sha256 of the script's 1872 bytes at the pinned revision; the reference path of the item is a transcription of this script into typed transforms and tool calls (never executed here).
- Implementação
- independente da ferramenta
- sha256 da cópia lida
c8d4df2eb63f706756a413d7712f493121c7b4b498e33cdd5c159a4acd12c6e7(identifica a cópia lida, não um arquivo canônico)- Endereço
https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark/resolve/edd0fe1c1d1c5c0a4f0e3e67a50481ac679fb888/solutions/research_papers/DiD/Kuipers_Sahn_2023/question_2/estimation.py- Licença
- MIT
Verificações
| # | Verificação | Obrigatória | Resultado | Esperado | Observado | Tolerância | Fonte | Chamada |
|---|---|---|---|---|---|---|---|---|
| 0 | resposta com lastro every number backed | obrigatória | passou | — | [] | — | — | — |
| 1 | figura da resposta próxima 0.0141794119 in [-0.04686517399, 0.0752239978]? | obrigatória | passou | [-0.04686517399391657,0.07522399780022994] | 0,01417940.014179411903156438 | interval · [-0.04686517399391657, 0.07522399780022994] | — | call_3729da8d |
| 2 | figura da resposta próxima 0.0141794119 vs 0.014179411903156684 | registrada | passou | 0,01417940.014179411903156684 | 0,01417940.014179411903156438 | relativa 0.000001 · absoluta 3.1145196886261864e-8 | crb_papers.q039.gold | call_3729da8d |
| 3 | figura da resposta próxima 0.03114519689 vs 0.031145196886261866 | registrada | passou | 0,03114520.031145196886261866 | 0,03114520.031145196886261942 | relativa 0.000001 · absoluta 3.1145196886261864e-8 | crb_papers.q039.gold | call_3729da8d |
Caminho de referência e caminho do agente
A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.
caminho de referência do item · benchmark_script
| Argumento | Referência | Agente | |
|---|---|---|---|
| cluster | "city" | "city" | igual |
| controls | ["Treated","Post","pop_prop"] | ["Treated","Post","pop_prop"] | igual |
| dataset | "ref_panel" | "ref_panel" | igual |
| fe | — | [] | não fixado pela referência |
| intercept | — | true | não fixado pela referência |
| level | — | 0,950.95 | não fixado pela referência |
| se | — | "HC1" | não fixado pela referência |
| subset | — | — | não fixado pela referência |
| weights | — | — | não fixado pela referência |
| x | ["Treated_Post"] | ["Treated_Post"] | igual |
| y | "govt_prop" | "govt_prop" | igual |
Trajetória
Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.
- 0Início
Among cities with observed reform status at both censuses, how did adopting a civil service commission after 1930 and by 1940 affect the change from 1930 to 1940 in the share of blue-collar city jobs held by foreign-born white residents, compared with cities that had not adopted by 1940, adjusting for the city's foreign-born white population share?
ds_0020(agent)| Variable Name | Description | | --- | --- | | treat | Binary indicator equal to 1 if the municipality had established a municipal civil service commission (merit-based personnel system) by the given census year; 0 if not yet established. Values are weakly increasing over time within a city. Sourced primarily from U.S. Civil Service Assembly municipal surveys (1937, 1940, 1943) and corroborated by state statutes; may be missing (blank/NA) where adoption year could not be determined. | | pop_prop | Proportion (0–1) of the city’s residents who are foreign-born whites in that census year. Constructed from full-count decennial U.S. Census microdata using birthplace (foreign-born) and enumerated race (white). Available for decennial years 1850–1940 except 1890 (destroyed census). | | govt_prop | Proportion (0–1) of blue-collar municipal government employees who are foreign-born whites in that census year. Computed from full-count decennial U.S. Census microdata by identifying residents employed in local public administration and classifying blue-collar occupations (e.g., craftsmen, mechanics, service workers, laborers); police and fire personnel are excluded due to distinct recruitment regimes. Counts reflect resident workers and assume city employment generally coincides with residence in this era. | | city | Municipality name and two-letter state abbreviation in the standardized format “city, st” (e.g., “aberdeen, sd”). Standardization facilitates consistent tracking across sources and decades; cities with the same name are distinguished by state. | | YEAR | Decennial census year for which measures are calculated (integers from 1850 to 1940; 1890 absent due to the lost census). | Dataset Context: This dataset follows U.S. municipalities at ten-year intervals from the mid-19th to early-20th centuries, a period spanning patronage-based municipal staffing through the widespread diffusion of merit-oriented civil service systems. Municipal adoption of civil service rules was recorded by the U.S. Civil Service Assembly in nationwide surveys conducted in 1937, 1940, and 1943 and supplemented by state-level statutes that, in many cases, mandated adoption using population thresholds. The “treat” indicator reflects whether a city had a functioning municipal civil service commission by a given census year; because commissions, once established, typically persisted, the indicator does not toggle back to zero for later years. Demographic and employment composition measures are derived from the full-count decennial U.S. Censuses (1850–1940, with 1890 unavailable). The census enumerated every resident and captured birthplace, race, industry, and occupation, allowing identification of local public administration workers and classification of blue-collar positions. Blue-collar categories include craftsmen, mechanics, service workers, and laborers; police and fire employees are excluded because their hiring, promotion, and protection rules often followed distinct legal frameworks. Because the census does not name employers, municipal employment is inferred from the industry code “local public administration,” and, consistent with transportation realities of the era, employees are assumed to work in the municipality where they reside. The civil service systems cataloged here typically introduced commission oversight of hiring, promotion, and termination in “classified” services, commonly relying on publicly advertised examinations and shortlists (e.g., a “rule of three”). “Unclassified” roles (e.g., department heads, certain temporary staff) fell outside commission rules, and the scope of coverage varied across cities and over time. City names are standardized to “city, st” to harmonize historical references across sources and decades. Shares are expressed as proportions between 0 and 1 and are calculated at the city–year level to align with the decennial timing of the underlying census enumerations.
filefb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441· frame —ref_fty(reference)filefb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441· frame —select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}rename{"map":{"YEAR":"year"}}dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}filter{"query":"treat == 1"}collapse{"aggs":[{"column":"year","fn":"min","name":"fty"}],"by":["city"]}
ref_panel(reference)filefb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441· frame —select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}rename{"map":{"YEAR":"year"}}dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}filter{"query":"year in [1930, 1940]"}merge{"how":"left","on":["city"],"with":"ref_years"}filter{"query":"nyears == 2"}merge{"how":"inner","on":["city"],"with":"ref_pre"}merge{"how":"inner","on":["city"],"with":"ref_post"}merge{"how":"left","on":["city"],"with":"ref_fty"}filter{"query":"t_pre == 0 and (t_post == 1 or (t_post == 0 and (fty != fty or fty > 1940)))"}derive{"args":{"cmp":"eq","column":"t_post","value":1},"name":"Treated","op":"indicator"}derive{"args":{"cmp":"eq","column":"year","value":1940},"name":"Post","op":"indicator"}derive{"args":{"columns":["Treated","Post"]},"name":"Treated_Post","op":"interaction"}
ref_post(reference)filefb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441· frame —select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}rename{"map":{"YEAR":"year"}}dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}filter{"query":"year == 1940"}collapse{"aggs":[{"column":"treat","fn":"max","name":"t_post"}],"by":["city"]}
ref_pre(reference)filefb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441· frame —select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}rename{"map":{"YEAR":"year"}}dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}filter{"query":"year == 1930"}collapse{"aggs":[{"column":"treat","fn":"max","name":"t_pre"}],"by":["city"]}
ref_years(reference)filefb21d9bfd9e8815223675810e217e1db86e4bbf0d90e6a351772c71a5d17b441· frame —select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}rename{"map":{"YEAR":"year"}}dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}filter{"query":"year in [1930, 1940]"}collapse{"aggs":[{"column":"treat","fn":"count","name":"n"}],"by":["city","year"]}collapse{"aggs":[{"column":"n","fn":"count","name":"nyears"}],"by":["city"]}
- 1Transformação
ref_fty·select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}4408 → 4408 linhasFrame antes → depois:cc7d39e21613→60f04f92f2b8 - 2Transformação
ref_fty·rename{"map":{"YEAR":"year"}}4408 → 4408 linhasFrame antes → depois:60f04f92f2b8→8e4754dadcb6 - 3Transformação
ref_fty·dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}4408 → 1604 linhasFrame antes → depois:8e4754dadcb6→a154ac026892 - 4Transformação
ref_fty·filter{"query":"treat == 1"}1604 → 781 linhasFrame antes → depois:a154ac026892→0bba33ca7b15 - 5Transformação
ref_fty·collapse{"aggs":[{"column":"year","fn":"min","name":"fty"}],"by":["city"]}781 → 274 linhasFrame antes → depois:0bba33ca7b15→132e501a14af - 6Transformação
ref_years·select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}4408 → 4408 linhasFrame antes → depois:cc7d39e21613→60f04f92f2b8 - 7Transformação
ref_years·rename{"map":{"YEAR":"year"}}4408 → 4408 linhasFrame antes → depois:60f04f92f2b8→8e4754dadcb6 - 8Transformação
ref_years·dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}4408 → 1604 linhasFrame antes → depois:8e4754dadcb6→a154ac026892 - 9Transformação
ref_years·filter{"query":"year in [1930, 1940]"}1604 → 583 linhasFrame antes → depois:a154ac026892→6db58c114a30 - 10Transformação
ref_years·collapse{"aggs":[{"column":"treat","fn":"count","name":"n"}],"by":["city","year"]}583 → 583 linhasFrame antes → depois:6db58c114a30→438ef635c468 - 11Transformação
ref_years·collapse{"aggs":[{"column":"n","fn":"count","name":"nyears"}],"by":["city"]}583 → 293 linhasFrame antes → depois:438ef635c468→38e6d0a9bd23 - 12Transformação
ref_pre·select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}4408 → 4408 linhasFrame antes → depois:cc7d39e21613→60f04f92f2b8 - 13Transformação
ref_pre·rename{"map":{"YEAR":"year"}}4408 → 4408 linhasFrame antes → depois:60f04f92f2b8→8e4754dadcb6 - 14Transformação
ref_pre·dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}4408 → 1604 linhasFrame antes → depois:8e4754dadcb6→a154ac026892 - 15Transformação
ref_pre·filter{"query":"year == 1930"}1604 → 293 linhasFrame antes → depois:a154ac026892→085c7871adff - 16Transformação
ref_pre·collapse{"aggs":[{"column":"treat","fn":"max","name":"t_pre"}],"by":["city"]}293 → 293 linhasFrame antes → depois:085c7871adff→4fbb7b353915 - 17Transformação
ref_post·select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}4408 → 4408 linhasFrame antes → depois:cc7d39e21613→60f04f92f2b8 - 18Transformação
ref_post·rename{"map":{"YEAR":"year"}}4408 → 4408 linhasFrame antes → depois:60f04f92f2b8→8e4754dadcb6 - 19Transformação
ref_post·dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}4408 → 1604 linhasFrame antes → depois:8e4754dadcb6→a154ac026892 - 20Transformação
ref_post·filter{"query":"year == 1940"}1604 → 290 linhasFrame antes → depois:a154ac026892→0c1e1c417aee - 21Transformação
ref_post·collapse{"aggs":[{"column":"treat","fn":"max","name":"t_post"}],"by":["city"]}290 → 290 linhasFrame antes → depois:0c1e1c417aee→75fb905c1366 - 22Transformação
ref_panel·select{"columns":["city","YEAR","treat","govt_prop","pop_prop"]}4408 → 4408 linhasFrame antes → depois:cc7d39e21613→60f04f92f2b8 - 23Transformação
ref_panel·rename{"map":{"YEAR":"year"}}4408 → 4408 linhasFrame antes → depois:60f04f92f2b8→8e4754dadcb6 - 24Transformação
ref_panel·dropna{"columns":["city","year","treat","govt_prop","pop_prop"]}4408 → 1604 linhasFrame antes → depois:8e4754dadcb6→a154ac026892 - 25Transformação
ref_panel·filter{"query":"year in [1930, 1940]"}1604 → 583 linhasFrame antes → depois:a154ac026892→6db58c114a30 - 26Transformação
ref_panel·merge{"how":"left","on":["city"],"with":"ref_years"}583 → 583 linhasFrame antes → depois:6db58c114a30→ed5f512e17b2 - 27Transformação
ref_panel·filter{"query":"nyears == 2"}583 → 580 linhasFrame antes → depois:ed5f512e17b2→bdcffa66860e - 28Transformação
ref_panel·merge{"how":"inner","on":["city"],"with":"ref_pre"}580 → 580 linhasFrame antes → depois:bdcffa66860e→f7b25e6ba34c - 29Transformação
ref_panel·merge{"how":"inner","on":["city"],"with":"ref_post"}580 → 580 linhasFrame antes → depois:f7b25e6ba34c→f92a53b7eaa9 - 30Transformação
ref_panel·merge{"how":"left","on":["city"],"with":"ref_fty"}580 → 580 linhasFrame antes → depois:f92a53b7eaa9→2dbdf558ac12 - 31Transformação
ref_panel·filter{"query":"t_pre == 0 and (t_post == 1 or (t_post == 0 and (fty != fty or fty > 1940)))"}580 → 182 linhasFrame antes → depois:2dbdf558ac12→9440860bc705 - 32Transformação
ref_panel·derive{"args":{"cmp":"eq","column":"t_post","value":1},"name":"Treated","op":"indicator"}182 → 182 linhasFrame antes → depois:9440860bc705→bec0293320bf - 33Transformação
ref_panel·derive{"args":{"cmp":"eq","column":"year","value":1940},"name":"Post","op":"indicator"}182 → 182 linhasFrame antes → depois:bec0293320bf→eddd7a4b3e30 - 34Transformação
ref_panel·derive{"args":{"columns":["Treated","Post"]},"name":"Treated_Post","op":"interaction"}182 → 182 linhasFrame antes → depois:eddd7a4b3e30→158371a3ec53 - 35Turno do modelo
call_b42b5876referenceFim:tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cacheTexto visívelsmf.ols('govt_prop ~ Treated * Post + pop_prop').fit(cov_type='cluster', groups=city) (CR1 errors with statsmodels' default G/(G-1)·(N-1)/(N-K) correction)
Chamadas pedidasinfer.ols{ "cluster": "city", "controls": [ "Treated", "Post", "pop_prop" ], "dataset": "ref_panel", "x": [ "Treated_Post" ], "y": "govt_prop" }
- 36Ferramenta
infer.olsv0.1.0call_3729da8ddecidido pelo modeloreexecutávelMotivo: smf.ols('govt_prop ~ Treated * Post + pop_prop').fit(cov_type='cluster', groups=city) (CR1 errors with statsmodels' default G/(G-1)·(N-1)/(N-K) correction)
Argumentos
{ "cluster": "city", "controls": [ "Treated", "Post", "pop_prop" ], "dataset": "ref_panel", "fe": [], "intercept": true, "level": 0.95, "se": "HC1", "subset": null, "weights": null, "x": [ "Treated_Post" ], "y": "govt_prop" }Figuras call_3729da8d Chave Valor Valor bruto Erro-padrão IC coef.Treated_Post Coefficient on Treated_Post in the regression of govt_prop0,0141794 0.0141794119031564380,0311452 0.031145196886261942-0,047696 – 0,0760548 Diagnósticosn_obs= 182182k= 55r2= 0,6046950.6046948876322779df_resid= 177177se_type="cluster"n_clusters= 9191
Tabelas (1)
{ "coefficients": [ { "ci_high": 0.11498379084326872, "ci_low": -0.004966749675327717, "coef": 0.0550085205839705, "p": 0.07175330173143507, "se": 0.030188774774378657, "t": 1.8221514783255288, "term": "Intercept" }, { "ci_high": 0.07605478162229931, "ci_low": -0.04769595781598643, "coef": 0.014179411903156438, "p": 0.6500128514218789, "se": 0.031145196886261942, "t": 0.45526801307237635, "term": "Treated_Post" }, { "ci_high": 0.001906089942806992, "ci_low": -0.12048197725504559, "coef": -0.0592879436561193, "p": 0.05741384646822674, "se": 0.030802243822608537, "t": -1.9247930117546355, "term": "Treated" }, { "ci_high": 0.02782624088125852, "ci_low": -0.08252476447700391, "coef": -0.027349261797872698, "p": 0.3273867994739465, "se": 0.027772793957275766, "t": -0.9847501061630815, "term": "Post" }, { "ci_high": 1.5464123526051585, "ci_low": 1.0839242022732951, "coef": 1.3151682774392268, "p": 5.977896543268197e-19, "se": 0.11639756307745047, "t": 11.298933093333915, "term": "pop_prop" } ] }- Digests dos dados
ref_panel158371a3ec5351936f967f5e664fc5d62c898fda2cd3934ce77263904471e334- sha256 do resultado
3b7f46923d37f18628bb9dd9a20d9b19feaffe8f01e9482a389c46be4da378d6
- 37Turno do modelo
call_00a351a5referenceFim:tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cacheChamadas pedidassubmit_answer(meta-ferramenta){ "answer": "Estimativa (infer.ols): coef.Treated_Post = 0,01418. Reference path transcribed from the item's own estimation script.", "caveats": [], "figure_refs": [ "call_3729da8d:coef.Treated_Post" ] }
- 38Guardaresposta aceita
- Números encontrados
- 0,01418
- Sem lastro
- —
- Não citados
- —
1 nova(s) tentativa(s) restante(s) - 39Resposta
Estimativa (infer.ols): coef.Treated_Post = 0,01418. Reference path transcribed from the item's own estimation script.
Figuras citadas:call_3729da8d:coef.Treated_Post· Parada:answeredFigura da resposta:call_3729da8d:coef.Treated_Post= 0,01417940.014179411903156438(se 0,03114520.031145196886261942) - 40Pontuação#0resposta com lastropassouobrigatória
every number backed - 41Pontuação#1figura da resposta próximapassouobrigatória
0.0141794119 in [-0.04686517399, 0.0752239978]? - 42Pontuação#2figura da resposta próximapassouregistrada
0.0141794119 vs 0.014179411903156684 - 43Pontuação#3figura da resposta próximapassouregistrada
0.03114519689 vs 0.031145196886261866
Épocas × verificações
| # | 0 | 1 | 2 | 3 |
|---|---|---|---|---|
| Época 1 | passou | passou | passou | passou |
Tentativas
Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.
- época 1, tentativa 1passoupontuada(exibindo)
Downloads desta tarefa
658cdf11d48a9f1c73b4477343aa7e9c94202b7ad68be893d92092f242454e1aO hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.
| Arquivo | Tamanho | sha256 |
|---|---|---|
| attachments/3a795adceec3da7a7200afe0173ebe8e2f7537e6f9548896ac1334aaec026319.json | 375 B | 3a795adceec3da7a7200afe0173ebe8e2f7537e6f9548896ac1334aaec026319 |
| attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json | 2,4 KB | 433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420 |
| attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json | 64,0 KB | 52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b |
| attachments/acd52e2cd4a6c91a6a389c5be7ea0e122b382340ac240b8e2ea2c64cfc18be2a.json | 1,3 KB | acd52e2cd4a6c91a6a389c5be7ea0e122b382340ac240b8e2ea2c64cfc18be2a |
| attachments/e216090d5003f5989937edfc6335e3a32de7875d5560ffe3e6edf9d3bb479d34.json | 5,5 KB | e216090d5003f5989937edfc6335e3a32de7875d5560ffe3e6edf9d3bb479d34 |
| attachments/f02faacd3764b2a65edffd049605b630545e27295427088afb0c9c7f0f912df4.json | 1,2 KB | f02faacd3764b2a65edffd049605b630545e27295427088afb0c9c7f0f912df4 |
| attachments/f0d077b0d71775085d31e0ce1b2f001231bcd4c6ab95e8a469268f0a1d4ca5c8.json | 369 B | f0d077b0d71775085d31e0ce1b2f001231bcd4c6ab95e8a469268f0a1d4ca5c8 |
| native/crb_papers/crb_papers.q039.e1.a1.json | 4,8 KB | e7e0ae9d28ffea6967d3e25c031abb2854950e224f77d3c2d1cf93b170f75c9c |
| sources/crb_papers.q039.gold.json | 1,1 KB | 99d0cc6385031eb7d5050a72815e5cd9ba55bfb559029ea53a34a807e20732cc |
| sources/crb_papers.q039.script.json | 1,1 KB | 868a47ee978d8fb2e52cf1428cd5bbd7ba8bbc75fe5469e992f43d745489278b |
| specs/crb_papers.q039.json | 15,5 KB | db85a3cc944ae8ac333ef6f1772d92a3323765e82dbe1122ab345d4a1437a8a4 |
| traces/crb_papers.q039.e1.a1.jsonl | 47,2 KB | 6d7d6b155bf45f31b4cf02304fb48f181999327ef060297ca72508290f9095e4 |
| trajectories/crb_papers.q039.e1.a1.jsonl | 36,2 KB | f9b18d87aea9d4e9f1e7556c621a80ba7ba7ef361ff9554bf62296e7279ab617 |