Tarefa paper_repro.colditz_1994.trials_rr.tool

paper_reprotoolT1publicépoca 1, tentativa 1Execução: 20261015T165911Z-suite-paper_repro-baseline-8b4f85

Veredito

passouPassou em todas as verificações obrigatórias.

Pergunta feita ao analista

Tarefa de ferramenta: nenhuma pergunta; a especificação de referência é chamada direto.

Valores esperados e de onde vêm

colditz_1994.trials_rr.software

Fonte: statsmodels 0.15.0: the reference specification of colditz_1994 trials_rr (evidence.pool_dl, figure 'pooled') on an independent code path
Tipo: software
Localização: colditz_1994: Abstract, Data Synthesis: random-effects relative risk of TB in the prospective trials
Valor: -0,714117-0.7141172220732273 (se 0,1787420.1787420895354032)
Conferido por: execução de software · combine_effects(yi, sei**2, method_re='dl') -> the random-effects mean and its SE on bcg (the file pinned at sha256 8508024604252ddecbbba88a5ebbbf76ddec7d32f9e5df56521f602ce5398fdb, after its 15 declared transforms); k = 13. The tool evidence.pool_dl (magi_score.tools.transfer.pool, pure Python) does not call statsmodels. Written by scripts/paper_repro_reference.py.
Implementação: independente da ferramenta
Endereço: https://pypi.org/project/statsmodels/0.15.0/

#0 figura próxima: -0,714117-0.7141172220732273 · relativa 0.000001 · absoluta 1.7874208953540318e-7
#1 figura próxima: 0,1787420.1787420895354032 · relativa 0.000001 · absoluta 1.7874208953540318e-7

colditz_1994.trials_rr.paper

Fonte: Colditz, G. A., Brewer, T. F., Berkey, C. S., Wilson, M. E., Burdick, E., Fineberg, H. V. and Mosteller, F. (1994). Efficacy of BCG Vaccine in the Prevention of Tuberculosis: Meta-analysis of the Published Literature. JAMA 271(9): 698-702.
Tipo: paper
Localização: Abstract, Data Synthesis: random-effects relative risk of TB in the prospective trials
Página: 698
Trecho: the RR of TB was 0.49 (95% confidence interval [CI], 0.34 to 0.70)
Valor como publicado: 0.49
Valor: 0,490.49 relative risk (vaccinated vs unvaccinated); 95% CI 0.34 to 0.70 as printed
Conferido por: fonte primária · Read on 2026-10-15 from the abstract as PubMed serves it (E-utilities efetch, PMID 8309034, plain text; read_copy_sha256 is that text's sha256). The abstract prints the pooled trial RR as a ratio with a 95% interval and no standard error, and says fourteen prospective trials were included, while the public trial-level data (metadat dat.bcg, pinned at sha256 8508024604252ddecbbba88a5ebbbf76ddec7d32f9e5df56521f602ce5398fdb; HSAUR BCG.csv) hold 13 trials. The metafor reference article (Viechtbauer 2010, Journal of Statistical Software 36(3)) prints the REML random-effects model on those 13 trials as estimate -0.7145 (se 0.1798), tau^2 0.3132, not a DerSimonian-Laird fit. Cited by the T1 task colditz_1994.trials_rr.tool, recorded and not compared (printed as a ratio with a CI); exp(-0.71412) = 0.4896 on the 13 public trials rounds to the printed 0.49.
sha256 da cópia lida: 952029419ff1a99083143911dec0b088b4f215c27bb96ccee173fae0fc5bd6f7 (identifica a cópia lida, não um arquivo canônico)
Desvio conhecido: versão dos dados
Recorded before any software-reference run or dry run, from the abstract and the data's provenance: the abstract pools fourteen prospective trials, the public trial-level data hold 13, and the abstract does not say which random-effects estimator it used.
Endereço: https://pubmed.ncbi.nlm.nih.gov/8309034/
Licença: Copyright American Medical Association (JAMA); cited, not reproduced.

Verificações

Cada verificação, o que esperava, o que observou e a chamada que leu
#	Verificação	Obrigatória	Resultado	Esperado	Observado	Tolerância	Fonte	Chamada
0	figura próxima -0.7141172221 vs -0.7141172220732273	obrigatória	passou	-0,714117`-0.7141172220732273`	-0,714117`-0.7141172220732269`	relativa 0.000001 · absoluta 1.7874208953540318e-7	colditz_1994.trials_rr.software	—
1	figura próxima 0.1787420895 vs 0.1787420895354032	obrigatória	passou	0,178742`0.1787420895354032`	0,178742`0.1787420895354032`	relativa 0.000001 · absoluta 1.7874208953540318e-7	colditz_1994.trials_rr.software	—

Caminho de referência e caminho do agente

A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

a própria especificação da tarefa

Referência: evidence.pool_dlChamada do agente: evidence.pool_dl (call_ffdefaa3)igual

Argumentos da referência e do agente
Argumento	Referência	Agente
estimates	—	[{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-0.8893113339202054,"id":"1","se":0.5706003548929508,"study_id":"1"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-1.5853886572014306,"id":"2","se":0.4411135017182583,"study_id":"2"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-1.348073148299693,"id":"3","se":0.644490469571091,"study_id":"3"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-1.4415511900213054,"id":"4","se":0.14145681992130169,"study_id":"4"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-0.2175473222112957,"id":"5","se":0.2262966463950159,"study_id":"5"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-0.786115585818864,"id":"6","se":0.08310005087789514,"study_id":"6"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-1.6208982235983924,"id":"7","se":0.4722470196542432,"study_id":"7"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":0.011952333523841173,"id":"8","se":0.06294107798423641,"study_id":"8"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-0.4694176487381487,"id":"9","se":0.2375588568402554,"study_id":"9"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-1.3713448034727846,"id":"10","se":0.2702310004663212,"study_id":"10"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-0.33935882833839015,"id":"11","se":0.1114101161096232,"study_id":"11"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":0.4459134005713783,"id":"12","se":0.7297299810204818,"study_id":"12"},{"ci_high":null,"ci_level":0.95,"ci_low":null,"estimate":-0.017313948216879493,"id":"13","se":0.26721650339001574,"study_id":"13"}]	não fixado pela referência
level	0,95`0.95`	0,95`0.95`	igual
unit	`"log relative risk"`	`"log relative risk"`	igual

Trajetória

Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

0Início
Tarefa de ferramenta: nenhuma pergunta; a especificação de referência é chamada direto.
bcg (agent)
The trials of BCG vaccine against tuberculosis analysed by Colditz et al. (1994), as metadat's dat.bcg holds them: one row per trial. Columns: trial, the trial number; author and year of the report; tpos and tneg, the vaccinated people who did and did not get tuberculosis; cpos and cneg, the same for the unvaccinated; ablat, the trial's absolute latitude; alloc, how treatment was allocated. Built columns: n_t and n_c, the arm sizes; risk_t and risk_c, the arms' tuberculosis risks; rr, their ratio; yi, the log relative risk; vi, its large-sample variance (tneg/(tpos·n_t) + cneg/(cpos·n_c)); sei, its standard error.
file 8508024604252ddecbbba88a5ebbbf76ddec7d32f9e5df56521f602ce5398fdb · frame —
1. cast {"columns":["trial"],"to":"str"}
2. derive {"args":{"columns":["tpos","tneg"]},"name":"n_t","op":"sum"}
3. derive {"args":{"columns":["cpos","cneg"]},"name":"n_c","op":"sum"}
4. derive {"args":{"left":"tpos","right":"n_t"},"name":"risk_t","op":"ratio"}
5. derive {"args":{"left":"cpos","right":"n_c"},"name":"risk_c","op":"ratio"}
6. derive {"args":{"left":"risk_t","right":"risk_c"},"name":"rr","op":"ratio"}
7. derive {"args":{"column":"rr"},"name":"yi","op":"log"}
8. derive {"args":{"columns":["tpos","n_t"]},"name":"tpos_n_t","op":"product"}
9. derive {"args":{"columns":["cpos","n_c"]},"name":"cpos_n_c","op":"product"}
10. derive {"args":{"left":"tneg","right":"tpos_n_t"},"name":"v_t","op":"ratio"}
11. derive {"args":{"left":"cneg","right":"cpos_n_c"},"name":"v_c","op":"ratio"}
12. derive {"args":{"columns":["v_t","v_c"]},"name":"vi","op":"sum"}
13. derive {"args":{"column":"vi"},"name":"log_vi","op":"log"}
14. derive {"args":{"column":"log_vi","factor":0.5},"name":"half_log_vi","op":"scale"}
15. derive {"args":{"column":"half_log_vi"},"name":"sei","op":"exp"}
1Transformação
bcg · cast {"columns":["trial"],"to":"str"}
13 → 13 linhas
Frame antes → depois: 04c90e9b74f3 → 5b0b175097dc
2Transformação
bcg · derive {"args":{"columns":["tpos","tneg"]},"name":"n_t","op":"sum"}
13 → 13 linhas
Frame antes → depois: 5b0b175097dc → 04bb078fa6e0
3Transformação
bcg · derive {"args":{"columns":["cpos","cneg"]},"name":"n_c","op":"sum"}
13 → 13 linhas
Frame antes → depois: 04bb078fa6e0 → 5e452e05cc4e
4Transformação
bcg · derive {"args":{"left":"tpos","right":"n_t"},"name":"risk_t","op":"ratio"}
13 → 13 linhas
Frame antes → depois: 5e452e05cc4e → 8fef9bdd4eb8
5Transformação
bcg · derive {"args":{"left":"cpos","right":"n_c"},"name":"risk_c","op":"ratio"}
13 → 13 linhas
Frame antes → depois: 8fef9bdd4eb8 → e027760d38e9
6Transformação
bcg · derive {"args":{"left":"risk_t","right":"risk_c"},"name":"rr","op":"ratio"}
13 → 13 linhas
Frame antes → depois: e027760d38e9 → 6eafc3000091
7Transformação
bcg · derive {"args":{"column":"rr"},"name":"yi","op":"log"}
13 → 13 linhas
Frame antes → depois: 6eafc3000091 → 7603dce3f18c
8Transformação
bcg · derive {"args":{"columns":["tpos","n_t"]},"name":"tpos_n_t","op":"product"}
13 → 13 linhas
Frame antes → depois: 7603dce3f18c → 71c9857fa6ef
9Transformação
bcg · derive {"args":{"columns":["cpos","n_c"]},"name":"cpos_n_c","op":"product"}
13 → 13 linhas
Frame antes → depois: 71c9857fa6ef → d8d7394c769f
10Transformação
bcg · derive {"args":{"left":"tneg","right":"tpos_n_t"},"name":"v_t","op":"ratio"}
13 → 13 linhas
Frame antes → depois: d8d7394c769f → c1cbb1940c85
11Transformação
bcg · derive {"args":{"left":"cneg","right":"cpos_n_c"},"name":"v_c","op":"ratio"}
13 → 13 linhas
Frame antes → depois: c1cbb1940c85 → e2a7d8086360
12Transformação
bcg · derive {"args":{"columns":["v_t","v_c"]},"name":"vi","op":"sum"}
13 → 13 linhas
Frame antes → depois: e2a7d8086360 → 975270d4d3d2
13Transformação
bcg · derive {"args":{"column":"vi"},"name":"log_vi","op":"log"}
13 → 13 linhas
Frame antes → depois: 975270d4d3d2 → 364b2a8edbff
14Transformação
bcg · derive {"args":{"column":"log_vi","factor":0.5},"name":"half_log_vi","op":"scale"}
13 → 13 linhas
Frame antes → depois: 364b2a8edbff → cd0e4c1398a2
15Transformação
bcg · derive {"args":{"column":"half_log_vi"},"name":"sei","op":"exp"}
13 → 13 linhas
Frame antes → depois: cd0e4c1398a2 → 7470c42c4c3f

16Ferramenta

evidence.pool_dlv0.1.0call_ffdefaa3decidido pelo códigoreexecutável

Argumentos

{
  "estimates": [
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -0.8893113339202054,
      "id": "1",
      "se": 0.5706003548929508,
      "study_id": "1"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -1.5853886572014306,
      "id": "2",
      "se": 0.4411135017182583,
      "study_id": "2"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -1.348073148299693,
      "id": "3",
      "se": 0.644490469571091,
      "study_id": "3"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -1.4415511900213054,
      "id": "4",
      "se": 0.14145681992130169,
      "study_id": "4"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -0.2175473222112957,
      "id": "5",
      "se": 0.2262966463950159,
      "study_id": "5"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -0.786115585818864,
      "id": "6",
      "se": 0.08310005087789514,
      "study_id": "6"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -1.6208982235983924,
      "id": "7",
      "se": 0.4722470196542432,
      "study_id": "7"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": 0.011952333523841173,
      "id": "8",
      "se": 0.06294107798423641,
      "study_id": "8"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -0.4694176487381487,
      "id": "9",
      "se": 0.2375588568402554,
      "study_id": "9"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -1.3713448034727846,
      "id": "10",
      "se": 0.2702310004663212,
      "study_id": "10"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -0.33935882833839015,
      "id": "11",
      "se": 0.1114101161096232,
      "study_id": "11"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": 0.4459134005713783,
      "id": "12",
      "se": 0.7297299810204818,
      "study_id": "12"
    },
    {
      "ci_high": null,
      "ci_level": 0.95,
      "ci_low": null,
      "estimate": -0.017313948216879493,
      "id": "13",
      "se": 0.26721650339001574,
      "study_id": "13"
    }
  ],
  "level": 0.95,
  "unit": "log relative risk"
}

Figuras call_ffdefaa3
Chave	Valor	Valor bruto	Erro-padrão	IC
pooled Random-effects pooled estimate (DerSimonian–Laird) over 13 studies	-0,714117 log relative risk	`-0.7141172220732269`	0,178742`0.1787420895354032`	-1,06445 – -0,363789

Diagnósticos

k = 1313
tau2 = 0,308760.30876026286237646
i2 = 92,117392.11734685456207
q = 152,233152.2330080823734
n_se_from_interval = 00

Tabelas (1)

{
  "studies": [
    {
      "estimate": -0.8893113339202054,
      "id": "1",
      "se": 0.5706003548929508,
      "se_source": "reported",
      "study_id": "1",
      "weight_fixed": 3.0713967835314193,
      "weight_pct": 5.036491683231727,
      "weight_random": 1.5764291608993408
    },
    {
      "estimate": -1.5853886572014306,
      "id": "2",
      "se": 0.4411135017182583,
      "se_source": "reported",
      "study_id": "2",
      "weight_fixed": 5.13924471610913,
      "weight_pct": 6.347329182641975,
      "weight_random": 1.9867231888137737
    },
    {
      "estimate": -1.348073148299693,
      "id": "3",
      "se": 0.644490469571091,
      "se_source": "reported",
      "study_id": "3",
      "weight_fixed": 2.407503908285565,
      "weight_pct": 4.41202722473061,
      "weight_random": 1.3809708847338356
    },
    {
      "estimate": -1.4415511900213054,
      "id": "4",
      "se": 0.14145681992130169,
      "se_source": "reported",
      "study_id": "4",
      "weight_fixed": 49.97493281795706,
      "weight_pct": 9.717646356814289,
      "weight_random": 3.0416373252818607
    },
    {
      "estimate": -0.2175473222112957,
      "id": "5",
      "se": 0.2262966463950159,
      "se_source": "reported",
      "study_id": "5",
      "weight_fixed": 19.52737039601342,
      "weight_pct": 8.875377381656724,
      "weight_random": 2.7780059212670714
    },
    {
      "estimate": -0.786115585818864,
      "id": "6",
      "se": 0.08310005087789514,
      "se_source": "reported",
      "study_id": "6",
      "weight_fixed": 144.80962224959802,
      "weight_pct": 10.121060419345175,
      "weight_random": 3.167906508691391
    },
    {
      "estimate": -1.6208982235983924,
      "id": "7",
      "se": 0.4722470196542432,
      "se_source": "reported",
      "study_id": "7",
      "weight_fixed": 4.483958128286655,
      "weight_pct": 6.007913825721248,
      "weight_random": 1.8804856925644875
    },
    {
      "estimate": 0.011952333523841173,
      "id": "8",
      "se": 0.06294107798423641,
      "se_source": "reported",
      "study_id": "8",
      "weight_fixed": 252.42458242622047,
      "weight_pct": 10.216342533284292,
      "weight_random": 3.1977299477781354
    },
    {
      "estimate": -0.4694176487381487,
      "id": "9",
      "se": 0.2375588568402554,
      "se_source": "reported",
      "study_id": "9",
      "weight_fixed": 17.719748212854313,
      "weight_pct": 8.748416776558122,
      "weight_random": 2.7382670687580495
    },
    {
      "estimate": -1.3713448034727846,
      "id": "10",
      "se": 0.2702310004663212,
      "se_source": "reported",
      "study_id": "10",
      "weight_fixed": 13.693979133979813,
      "weight_pct": 8.368251724263134,
      "weight_random": 2.619274859084015
    },
    {
      "estimate": -0.33935882833839015,
      "id": "11",
      "se": 0.1114101161096232,
      "se_source": "reported",
      "study_id": "11",
      "weight_fixed": 80.56580415801031,
      "weight_pct": 9.947531895144719,
      "weight_random": 3.113591830339357
    },
    {
      "estimate": 0.4459134005713783,
      "id": "12",
      "se": 0.7297299810204818,
      "se_source": "reported",
      "study_id": "12",
      "weight_fixed": 1.8779136586268463,
      "weight_pct": 3.7976966224232367,
      "weight_random": 1.1886845201728637
    },
    {
      "estimate": -0.017313948216879493,
      "id": "13",
      "se": 0.26721650339001574,
      "se_source": "reported",
      "study_id": "13",
      "weight_fixed": 14.004688271405163,
      "weight_pct": 8.403914374184746,
      "weight_random": 2.630437319945124
    }
  ]
}

I² of 75% or more: most of the spread is between studies; report the range of estimates and τ², not only the mean

Digests dos dados
sha256 do resultado: 7a8048f466fa87f6c170becb651298e6bec0d22d4e20ebc7339a72c4ce7ae3d2

17Pontuação
#0figura próximapassouobrigatória-0.7141172221 vs -0.7141172220732273
18Pontuação
#1figura próximapassouobrigatória0.1787420895 vs 0.1787420895354032

Épocas × verificações

Resultado de cada verificação em cada época pontuada
#	0	1
Época 1	passou	passou

Tentativas

Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

época 1, tentativa 1passoupontuada(exibindo)

Downloads desta tarefa

Pacote da tarefa (.zip)

56,5 KB · sha256 f619116bb4a2294194958a2478340f88ad527daa9b02a45a10575652645b1c25

O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

Downloads desta tarefa
Arquivo	Tamanho	sha256
sources/colditz_1994.trials_rr.paper.json	2,3 KB	`7cb5f3fb8dcc885e6fba191ae682aa470cb349b4c4c50a30c0f43379255467c1`
sources/colditz_1994.trials_rr.software.json	1,2 KB	`9bdc7c3043ea49af6152b7c1f6ba8fdfd5d9aeb3f8bf19b991f2e820bbb6fe1a`
specs/paper_repro.colditz_1994.trials_rr.tool.json	5,8 KB	`0370cbd184c3bf6f84222c6ae6afebbed6f0c867d7026ece91e8a382d15865a0`
traces/paper_repro.colditz_1994.trials_rr.tool.e1.a1.jsonl	27,5 KB	`66cfa38008f2e60e84424120f494b94c336e38c86a129f539f58df2dfb72e0ef`
trajectories/paper_repro.colditz_1994.trials_rr.tool.e1.a1.jsonl	26,9 KB	`a0c32525b0dfb2c5ca46af9cae32ce5453f7b6932d8719127ec0f8400469d15a`