Pular para o conteúdo

Tarefa nist_anova.smls09.agent

nist_anovaagentT2publicépoca 1, tentativa 1Execução: 20261015T171223Z-suite-nist_anova-scripted-7361e5

Veredito

falhouDecidida pela verificação 6: dígitos corretos (LRE), fora da tolerância.
LRE 4.17 (min 6.0)

Família do método (das chamadas de ferramentas): other (not an estimator in the table)

Pergunta feita ao analista

NIST Statistical Reference Datasets, one-way analysis of variance, problem SmLs09: generated data with 13 constant leading digits; one factor (treatment) with 9 levels and 18009 observations in a balanced design, model y_ij = mu + tau_i + e_ij. Dataset d holds the factor treatment (levels 1 to 9), the response response, and indicator columns treatment_2 to treatment_9 (1 when the row is at that level; level 1 is the reference). Compute the ANOVA F statistic for the hypothesis that all 9 treatment effects are equal: the between-treatment mean square divided by the within-treatment mean square.

Resposta

Estimativa (infer.linear_hypothesis): F = 2001.

Valores esperados e de onde vêm

nist_anova.smls09.f

Fonte
NIST/ITL StRD, Analysis of Variance: SmLs09 (SmLs09.dat), certified values
Tipo
certified
Localização
Certified Values block (lines 41-47), row 'Between Treatment F Statistic'
Trecho
Between Treatment F Statistic: 2.00100000000000E+03
Valor como publicado
2.00100000000000E+03
Valor
2.0012001
Conferido por
fonte primária · Parsed from the certified block of the file as itl.nist.gov served it (CRLF); the pinned mirror the suite fetches has the same bytes after CRLF -> LF. Re-derived from the data with exact rational arithmetic in tests/test_suite_nist_extra.py.
sha256 da cópia lida
f4688c5a0d5690fc86fa27e0c5a265eef0b24641e74af27aa72d9615084dd13f (identifica a cópia lida, não um arquivo canônico)
Endereço
https://www.itl.nist.gov/div898/strd/anova/SmLs09.dat
Licença
Public domain: a work of the US Government (NIST/ITL Statistical Reference Datasets)
  • #6 dígitos corretos (LRE): 2.0012001 · LRE >= 6.0 · LRE ≥ 6

Verificações

Cada verificação, o que esperava, o que observou e a chamada que leu
#VerificaçãoObrigatóriaResultadoEsperadoObservadoTolerânciaFonteChamada
0resposta com lastro
every number backed
obrigatóriapassou—[]———
1resposta cita
cited ['call_be9be17c:F']
obrigatóriapassou—["call_be9be17c:F"]——call_be9be17c
2ferramenta chamada
answer call is infer.linear_hypothesis
obrigatóriapassou—"infer.linear_hypothesis"——call_be9be17c
3argumento igual
infer.linear_hypothesis.se = 'classical'
obrigatóriapassou"classical""classical"——call_be9be17c
4diagnóstico
8 vs 8
obrigatóriapassou8888default rel 1e-6 (abs floor 1e-6)—call_be9be17c
5diagnóstico
18000 vs 18000
obrigatóriapassou18.0001800018.00018000default rel 1e-6 (abs floor 1e-6)—call_be9be17c
6dígitos corretos (LRE)
LRE 4.17 (min 6.0)
obrigatóriafalhou2.00120014,1714.171LRE >= 6.0 · LRE ≥ 6nist_anova.smls09.fcall_be9be17c

Caminho de referência e caminho do agente

A chamada de referência ao lado da chamada que deu a resposta, argumento por argumento.

caminho de referência do item · metadata_rule

Referência: infer.linear_hypothesisChamada do agente: infer.linear_hypothesis (call_be9be17c)igual
Argumentos da referência e do agente
ArgumentoReferênciaAgente
cluster——não fixado pela referência
dataset"d""d"igual
hypothesis"treatment_2 = 0, treatment_3 = 0, treatment_4 = 0, treatment_5 = 0, treatment_6 = 0, treatment_7 = 0, treatment_8 = 0, treatment_9 = 0""treatment_2 = 0, treatment_3 = 0, treatment_4 = 0, treatment_5 = 0, treatment_6 = 0, treatment_7 = 0, treatment_8 = 0, treatment_9 = 0"igual
se"classical""classical"igual
subset——não fixado pela referência
x["treatment_2","treatment_3","treatment_4","treatment_5","treatment_6","treatment_7","treatment_8","treatment_9"]["treatment_2","treatment_3","treatment_4","treatment_5","treatment_6","treatment_7","treatment_8","treatment_9"]igual
y"response""response"igual

Trajetória

Cada evento na ordem em que aconteceu: turnos do modelo, chamadas de ferramentas, guardas, transformações e pontuação.

  1. 0Início

    NIST Statistical Reference Datasets, one-way analysis of variance, problem SmLs09: generated data with 13 constant leading digits; one factor (treatment) with 9 levels and 18009 observations in a balanced design, model y_ij = mu + tau_i + e_ij. Dataset d holds the factor treatment (levels 1 to 9), the response response, and indicator columns treatment_2 to treatment_9 (1 when the row is at that level; level 1 is the reference). Compute the ANOVA F statistic for the hypothesis that all 9 treatment effects are equal: the between-treatment mean square divided by the within-treatment mean square.

    d (agent)

    NIST StRD SmLs09: 18009 observations; treatment = the treatment level (1 to 9), response = the response, treatment_2 … treatment_9 = 1 when the row is at that treatment level (level 1 is the reference)

    file aa610b390c8d947ec258e32df0f43467fcb1820f47c5ce25a993ae1d9c715ae7 · frame —
    1. dummies {"column":"treatment","drop_first":true,"prefix":"treatment"}
  2. 1Transformação
    d · dummies {"column":"treatment","drop_first":true,"prefix":"treatment"}
    18009 → 18009 linhas
    Frame antes → depois: 8db499972bbb → 874bc9ba9917
  3. 2Turno do modelo
    call_b69fadccreferenceFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
    Texto visível

    With classical errors, the joint test that every indicator's coefficient is zero is the one-way ANOVA F.

    Chamadas pedidas
    • infer.linear_hypothesis
      {
        "dataset": "d",
        "hypothesis": "treatment_2 = 0, treatment_3 = 0, treatment_4 = 0, treatment_5 = 0, treatment_6 = 0, treatment_7 = 0, treatment_8 = 0, treatment_9 = 0",
        "se": "classical",
        "x": [
          "treatment_2",
          "treatment_3",
          "treatment_4",
          "treatment_5",
          "treatment_6",
          "treatment_7",
          "treatment_8",
          "treatment_9"
        ],
        "y": "response"
      }
  4. 3Ferramenta
    infer.linear_hypothesisv0.1.0call_be9be17cdecidido pelo modeloreexecutável

    Motivo: With classical errors, the joint test that every indicator's coefficient is zero is the one-way ANOVA F.

    Argumentos
    {
      "cluster": null,
      "dataset": "d",
      "hypothesis": "treatment_2 = 0, treatment_3 = 0, treatment_4 = 0, treatment_5 = 0, treatment_6 = 0, treatment_7 = 0, treatment_8 = 0, treatment_9 = 0",
      "se": "classical",
      "subset": null,
      "x": [
        "treatment_2",
        "treatment_3",
        "treatment_4",
        "treatment_5",
        "treatment_6",
        "treatment_7",
        "treatment_8",
        "treatment_9"
      ],
      "y": "response"
    }
    Figuras call_be9be17c
    ChaveValorValor brutoErro-padrãoIC
    F
    F statistic of treatment_2 = 0; treatment_3 = 0; treatment_4 = 0; treatment_5 = 0; treatment_6 = 0; treatment_7 = 0; treatment_8 = 0; treatment_9 = 0
    2.001,13 2001.1349262180404——
    p_value
    p-value of treatment_2 = 0; treatment_3 = 0; treatment_4 = 0; treatment_5 = 0; treatment_6 = 0; treatment_7 = 0; treatment_8 = 0; treatment_9 = 0
    0 probability0——
    Diagnósticos
    • statistic = "F"
    • df_numerator = 88
    • df_denominator = 18.00018000
    • se_type = "classical"
    • n_obs = 18.00918009
    • n_clusters = —
    Tabelas (2)
    {
      "coefficients": [
        {
          "ci_high": 1000000000000.4044,
          "ci_low": 1000000000000.3956,
          "coef": 1000000000000.4,
          "p": 0,
          "se": 0.0022355699150202234,
          "t": 447313230188711.75,
          "term": "Intercept"
        },
        {
          "ci_high": -0.09383960410130877,
          "ci_low": -0.10623357708119084,
          "coef": -0.10003659059124981,
          "p": 6.931521624154509e-214,
          "se": 0.0031615732934548975,
          "t": -31.64139537689858,
          "term": "treatment_2"
        },
        {
          "ci_high": 0.10617257242774376,
          "ci_low": 0.09377859944786206,
          "coef": 0.09997558593780291,
          "p": 1.2365005332269767e-213,
          "se": 0.0031615732934548086,
          "t": 31.622099713701278,
          "term": "treatment_3"
        },
        {
          "ci_high": -0.09383960410113809,
          "ci_low": -0.10623357708101944,
          "coef": -0.10003659059107876,
          "p": 6.931521635018747e-214,
          "se": 0.0031615732934547115,
          "t": -31.64139537684634,
          "term": "treatment_4"
        },
        {
          "ci_high": 0.1061725724274336,
          "ci_low": 0.09377859944755108,
          "coef": 0.09997558593749234,
          "p": 1.2365005369444156e-213,
          "se": 0.0031615732934550107,
          "t": 31.622099713601024,
          "term": "treatment_5"
        },
        {
          "ci_high": -0.09383960410132425,
          "ci_low": -0.10623357708120681,
          "coef": -0.10003659059126553,
          "p": 6.9315216233830005e-214,
          "se": 0.0031615732934550237,
          "t": -31.641395376902288,
          "term": "treatment_6"
        },
        {
          "ci_high": 0.10617257242756717,
          "ci_low": 0.09377859944768441,
          "coef": 0.09997558593762579,
          "p": 1.2365005354038572e-213,
          "se": 0.0031615732934550775,
          "t": 31.622099713642566,
          "term": "treatment_7"
        },
        {
          "ci_high": -0.09383960410102894,
          "ci_low": -0.10623357708091115,
          "coef": -0.10003659059097005,
          "p": 6.931521642630458e-214,
          "se": 0.0031615732934549327,
          "t": -31.64139537680974,
          "term": "treatment_8"
        },
        {
          "ci_high": 0.10617257242755622,
          "ci_low": 0.09377859944767418,
          "coef": 0.0999755859376152,
          "p": 1.2365005354595353e-213,
          "se": 0.0031615732934548923,
          "t": 31.622099713641067,
          "term": "treatment_9"
        }
      ],
      "restrictions": [
        {
          "estimate": -0.10003659059124981,
          "hypothesized": 0,
          "restriction": "treatment_2 = 0"
        },
        {
          "estimate": 0.09997558593780291,
          "hypothesized": 0,
          "restriction": "treatment_3 = 0"
        },
        {
          "estimate": -0.10003659059107876,
          "hypothesized": 0,
          "restriction": "treatment_4 = 0"
        },
        {
          "estimate": 0.09997558593749234,
          "hypothesized": 0,
          "restriction": "treatment_5 = 0"
        },
        {
          "estimate": -0.10003659059126553,
          "hypothesized": 0,
          "restriction": "treatment_6 = 0"
        },
        {
          "estimate": 0.09997558593762579,
          "hypothesized": 0,
          "restriction": "treatment_7 = 0"
        },
        {
          "estimate": -0.10003659059097005,
          "hypothesized": 0,
          "restriction": "treatment_8 = 0"
        },
        {
          "estimate": 0.0999755859376152,
          "hypothesized": 0,
          "restriction": "treatment_9 = 0"
        }
      ]
    }
    Digests dos dados
    d 874bc9ba991716686e5848d5038f3dc97ad37b6f45a1252dbdbae909e44faeb8
    sha256 do resultado
    c68c821bb3b16eb032d9aa499586996cd2b13e86f9edf3947f7e87f11886f5ec
  5. 4Turno do modelo
    call_3a0010d0referenceFim: tool_use0 ms0 de entrada · 0 de saída · 0 de raciocínio · 0 em cache
    Chamadas pedidas
    • submit_answer (meta-ferramenta)
      {
        "answer": "Estimativa (infer.linear_hypothesis): F = 2001.",
        "caveats": [],
        "figure_refs": [
          "call_be9be17c:F"
        ]
      }
  6. 5Guarda
    resposta aceita
    Números encontrados
    2001
    Sem lastro
    —
    Não citados
    —
    1 nova(s) tentativa(s) restante(s)
  7. 6Resposta

    Estimativa (infer.linear_hypothesis): F = 2001.

    Figuras citadas: call_be9be17c:F · Parada: answered
    Figura da resposta: call_be9be17c:F = 2.001,132001.1349262180404
  8. 7Pontuação
    #0resposta com lastropassouobrigatóriaevery number backed
  9. 8Pontuação
    #1resposta citapassouobrigatóriacited ['call_be9be17c:F']
  10. 9Pontuação
    #2ferramenta chamadapassouobrigatóriaanswer call is infer.linear_hypothesis
  11. 10Pontuação
    #3argumento igualpassouobrigatóriainfer.linear_hypothesis.se = 'classical'
  12. 11Pontuação
    #4diagnósticopassouobrigatória8 vs 8
  13. 12Pontuação
    #5diagnósticopassouobrigatória18000 vs 18000
  14. 13Pontuação
    #6dígitos corretos (LRE)falhouobrigatóriaLRE 4.17 (min 6.0)

Épocas × verificações

Resultado de cada verificação em cada época pontuada
#0123456
Época 1passoupassoupassoupassoupassoupassoufalhou

Tentativas

Cada tentativa é seu próprio arquivo e é publicada; só a última de cada época é pontuada.

Downloads desta tarefa

Pacote da tarefa (.zip)
42,7 KB · sha256 bba59c6a294a2df0cc14c1eca5cc610422024e6eb4471d7b5f225e03747448af

O hash de um zip é só de transporte: o que ancora a integridade é o RUN_SHA256SUMS que vai dentro dele, cópia exata do SHA256SUMS da execução.

Downloads desta tarefa
ArquivoTamanhosha256
attachments/433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420.json2,4 KB433a6877aa6a378bbd4b7e2752e484d8cb7499c562d68222be231f62ff2fa420
attachments/52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b.json64,0 KB52ab03d8ec104abb85572294bf8a469d75c5de9e74d6042caabff8017adc572b
attachments/6c5ebf5edb18ce2a66bbb9eb5fa99f326c43b8f9657aee85bab2dd62582b6b98.json624 B6c5ebf5edb18ce2a66bbb9eb5fa99f326c43b8f9657aee85bab2dd62582b6b98
attachments/a612e131b7096c20ae35af52a5e63a77401ecc275d59eedc0ad38e255e02a20f.json2,6 KBa612e131b7096c20ae35af52a5e63a77401ecc275d59eedc0ad38e255e02a20f
attachments/aadeb977d60c8e4aca76275ea9e8433f05fcb0a99f8ad5331ab03f648ebe741f.json683 Baadeb977d60c8e4aca76275ea9e8433f05fcb0a99f8ad5331ab03f648ebe741f
attachments/ea561c2acfc25b0d50a3954e14b116d696afca6de808dcdf3eb659b3405e30a5.json524 Bea561c2acfc25b0d50a3954e14b116d696afca6de808dcdf3eb659b3405e30a5
attachments/fe8e22eb23cae76ac298b43795b88ce667322b5f1bfa19255a3f7d56bbbbe1f9.json2,7 KBfe8e22eb23cae76ac298b43795b88ce667322b5f1bfa19255a3f7d56bbbbe1f9
sources/nist_anova.smls09.f.json1,2 KB897fffe0385a47ef6b29f012f641f9cc7010db6d480c5dcb49e14fe11be78b45
specs/nist_anova.smls09.agent.json6,9 KB8d0e4ac5cae52a8b0f87d3233686a4b3df51b1b1c5f32f9f9297a45a659c1c58
traces/nist_anova.smls09.agent.e1.a1.jsonl15,5 KBd9d720aae062096f0dacbdf97999d26a8e3b143c2600ebe889aa4c99a3ec7f73
trajectories/nist_anova.smls09.agent.e1.a1.jsonl14,4 KBd6400d023575c16a67bf9aac5b0e429f983039cea46f9ad9a2fa359fea2c9619