{
  "schema": "s2s-bench-v1",
  "kind": "data-kit-index",
  "exhibit": "small-open-deciders-measured",
  "exhibit_title": "Small open deciders, measured: a word counter kept up on our hardest question",
  "exhibit_url": "https://research.strata2signal.com/small-open-deciders-measured/",
  "published_utc": "2026-09-30",
  "licence": "CC BY 4.0",
  "licence_note": "CC BY 4.0 covers the records in this directory: the harnesses' rows, reports and receipts, the word counter, the recount, the evidence and the pre-registrations. Some rows carry the outputs and scores of models that are not ours and whose own licences differ — among them OpenJev 27B's 4-bit build (the OpenJev README puts the weights under CC BY-NC 4.0), and Apache-2.0 models; the page's licence section says what each repository carries. They are reproduced here as measurements, so a reader can check the page's figures; this kit grants no rights in those models. The word counter's 227 training lines were written by two chat models, Gemma 4 26B and Mistral Small 3.2 24B, at this workshop's test dinners.",
  "attribution": "strata→signal research, research.strata2signal.com",
  "contact": "hello@strata2signal.com",
  "run_id": "small-open-deciders-2026-09",
  "run_window_utc": {
    "door_run_utc": "2026-09-13",
    "cost_series_mistral_readings_utc": "2026-09-23T18:30:40Z to 2026-09-23T18:58:05Z",
    "deem_and_t1_utc": "2026-09-27T11:53:59Z to 2026-09-28T15:19:47Z",
    "opendecider_utc": "2026-09-28T09:20:54Z to 2026-09-28T12:16:19Z",
    "lev_utc": "2026-09-28T11:47:03Z to 2026-09-28T13:19:40Z",
    "apus_utc": "2026-09-28T15:32:11Z to 2026-09-28T16:50:39Z",
    "jev_bench_arm_13_utc": "2026-09-28T15:47:31Z to 2026-09-28T16:12:31Z",
    "imajev_utc": "2026-09-28T16:05:47Z to 2026-09-28T16:39:34Z",
    "evidence_and_recount_utc": "2026-09-28T21:30Z to 2026-09-28T22:5xZ; the recount's page checks (checked) 2026-09-29T06:52Z to 07:0xZ",
    "note": "Each bench's window is the first and last UTC stamp its shipped rows and receipts carry; the door run's rows are held back, so its day is its pre-registration's. The page's arms 1 to 12 ran 2026-09-21 and 2026-09-22 and are in the Reading the answer kit. imajev's window is its laptop run's six-way rows alone: that run's door rows and its card-B run (I-2), later the same day, are held back."
  },
  "card_class": "one used NVIDIA GeForce RTX 3090 with 24 GB at a 300 W cap in the bench box (card B; arm 13, Lev, APUS-OpenJev-v1, imajev's graphics-card run and OpenDecider small); the cost series' readings on card A, a different used RTX 3090, also at 300 W, and on an NVIDIA RTX PRO 6000 Blackwell with 96 GB; the rest on a laptop's processor",
  "counting_rules": {
    "correct": "A row is right when its own choice equals its label; rows that carry a boolean correct are cross-checked against that. A written answer counts only when it parsed (strict).",
    "ties": "A row is tied when two or more options share the top probability exactly; the tie range counts every tied row wrong, then right where the label is among the tied.",
    "intervals": "Wilson 95 per cent; the six-way minus the held-out lines by Newcombe's hybrid score interval.",
    "memory": "Growth at load is the run's own residency check (memory used after the warm-ups minus before the load); the highest reading is the highest memory-used sample in the run's telemetry. Every watt and MiB is the card's own, never the wall's.",
    "post_hoc": "Five of the recount's sets were computed after the rows were seen and say so in recount-v2.json (`post_hoc`). So were the page's own checks (`checked`), which the recount re-derives from its counts and the row files; three of them read held-back sets."
  },
  "not_a_standard": "One workshop's questions, on its own frozen sets, cards and runtimes, over two weeks. It is a reading, not a rating, and the page's own section on what was not measured says which comparisons this data does not support.",
  "sanitisation": "Every file listed in provenance.json was copied from the benches' own record and rewritten only by the named mechanical rules there, applied by one program (the hub repo's tools/kit_sanitise.py) in a fixed order. provenance.json names each rule, describes what it does, gives its firing count on every file, and says of every file whether a rule touched it. The original's digest is given only for a file no rule touched: a digest of a redacted original would let anyone test guesses for what was replaced. NO FIGURE WAS TOUCHED: the tool's fence re-reads every numeric token on both sides and refuses on any difference.",
  "files_note": "Stamped from the files themselves rather than authored: every row is the name, the byte count and the sha256 as they are on disk. Three files are not rule-cut copies, so they are listed here and not in provenance.json: README.md and recount_on_the_kit.py, written for this kit, and cost-of-intelligence-2026-09-23/KIT.lock.six-way.json, the six-way part of the cost series' kit lock, extracted by one stated filter (README.md) and passed through the same rules.",
  "file_count": 155,
  "files": [
    {
      "file": "EVIDENCE-v2.md",
      "bytes": 96736,
      "sha256": "6e7da12ce10c2df4967070303e03f4913fa1d32aa838b899dd3cbb2749bb642c",
      "role": "The evidence file the page was written from: every cell of every table with its row file and commit, the tie ranges, intervals and paired tests, the licence reads and the memory readings. Written as an internal working file; published here rewritten only by the kit's rules."
    },
    {
      "file": "README.md",
      "bytes": 17125,
      "sha256": "b3e1630e479393664cfe47fb22e9b4a7c7e23866a2889b252378e39d020853f5",
      "role": "What is in this kit, what was held back and why, what the rules replaced, how to run the recount and the word counter on it, and where the Reading the answer kit's files go."
    },
    {
      "file": "READS-v2.md",
      "bytes": 17752,
      "sha256": "6555fc0b79093fbdda08895794195b1c6183c7dfeb8da18174ca1c63849c0d6e",
      "role": "The reads the page's dates, revisions, card quotes and ollama digests come from, each with its source URL and read time (UTC)."
    },
    {
      "file": "apus-2026-09-28/PREREG-apus.md",
      "bytes": 96349,
      "sha256": "e3c968be5e6da4426044b91d67204384b67c495897583e3fda46b9ba31448f82",
      "role": "The pre-registration of the APUS-OpenJev-v1 bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "apus-2026-09-28/a1b/receipts/counted-run.json",
      "bytes": 41365,
      "sha256": "6b648f73197a7d5251896d64946836f21a18e811d6e6aad7ead1167bed010a6a",
      "role": "The counted run's own record for the APUS-OpenJev-v1 bench: its pins, its environment, the card posture before and after, and the residency check (what the model added to the card at load)."
    },
    {
      "file": "apus-2026-09-28/a1b/receipts/counted-telemetry.jsonl",
      "bytes": 139519,
      "sha256": "7a69cd5bec851f78c51c54125604c5845c365c56c5a9673ce5507a45e8556a94",
      "role": "The card's own power, temperature, memory and clocks sampled at 2 Hz through the counted run of the APUS-OpenJev-v1 bench, one JSON object a sample."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.ka.idle.csv",
      "bytes": 620,
      "sha256": "c4372f7f7dd38cde33dafd56619f2586f1a68c1a09fcc83c51144c3cbb0b0b74",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the long pages), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.ka.jsonl",
      "bytes": 145089,
      "sha256": "d124499abb99390e1e6012d657a286d84f4735a1661ae9998c64110e5099b7cd",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the long pages): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.ka.report.json",
      "bytes": 5803,
      "sha256": "6772d3947423eb539edbfa9c35f66e29f4aadfed70db1232eada23878ec4beca",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the long pages), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.ka.watts.csv",
      "bytes": 3437,
      "sha256": "bc791d9e15ec0f2db6d066d7d929d0acbcb58d26c90f3c4ed1b86ead9f0248df",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the long pages): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kc.idle.csv",
      "bytes": 621,
      "sha256": "c68cee32f373131b2817a21e62f7dedf9085e39ff3019d155bc433c1ee85de8b",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kc.jsonl",
      "bytes": 352691,
      "sha256": "a699cd37c0227b7c3eea4aff7906c13038dc657217f02b15115b1770afe7a71d",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kc.report.json",
      "bytes": 6114,
      "sha256": "b23667ba3da80474910d37d5f3197e34a1ddd60633b09e9aedf93d664965973b",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kc.watts.csv",
      "bytes": 1196,
      "sha256": "bdda609b505e2b4b76abf291436cac5974f637366049987e56bd5e023fc68053",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kperm.idle.csv",
      "bytes": 632,
      "sha256": "d976bbe96f63f78e170aad9e88f27e1a78fb11ca283614f22b46c4e230333e8f",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the six-way under six option orders), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kperm.jsonl",
      "bytes": 1290170,
      "sha256": "3f61be663a0bf08750b034eeb82c0f942f1a6b2403a637a1551a9a1ddcd3124c",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the six-way under six option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kperm.report.json",
      "bytes": 6118,
      "sha256": "40de682428d3524f920d54771ab7579b60c3f3b5284d5f3305e3fca544665a08",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the six-way under six option orders), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-high.kperm.watts.csv",
      "bytes": 7167,
      "sha256": "662301503e4c90d29bed2a861768135a1bf8331b316d1f757ee2c31b0aaa0f54",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the six-way under six option orders): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-low.kc.idle.csv",
      "bytes": 630,
      "sha256": "690ed28e2b7de0ae16a537736ecae59426c5c1544979e987ba976da162497906",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-low.kc.jsonl",
      "bytes": 354208,
      "sha256": "904038c998473f71f615df5f9c079ea37f01426979f80df51fc8f467ec3acb1e",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-low.kc.report.json",
      "bytes": 6161,
      "sha256": "ac078954af51d2c8e36ad9b2cc5c45af7780e973ef79f2eb7f8e39155eb10b84",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/a1b/rows/apus-4b-low.kc.watts.csv",
      "bytes": 703,
      "sha256": "a4c7e2567b8720d1e5fd06e22a7499c6d84839f2075a6ea5b3ade82e25b693c4",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/receipts/counted-run.json",
      "bytes": 41503,
      "sha256": "53814565d52a5589b58c392c93b329ae105f0d1cb525469f0933da59a8275328",
      "role": "The counted run's own record for the APUS-OpenJev-v1 bench: its pins, its environment, the card posture before and after, and the residency check (what the model added to the card at load)."
    },
    {
      "file": "apus-2026-09-28/receipts/counted-telemetry.jsonl",
      "bytes": 153474,
      "sha256": "7fdbebfb80cd47106901d59284f842546e30c29094d2beea1f833d7b2c38245f",
      "role": "The card's own power, temperature, memory and clocks sampled at 2 Hz through the counted run of the APUS-OpenJev-v1 bench, one JSON object a sample."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.ka.idle.csv",
      "bytes": 630,
      "sha256": "cd59970e16f6968efee80402f786296de0d159ae5b4df1a2ec05f724f98ee2be",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the long pages), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.ka.jsonl",
      "bytes": 144043,
      "sha256": "ccedc3d8e4f48db097e00f641afabd60165175a27ef1b27d427f44e528d65205",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the long pages): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.ka.report.json",
      "bytes": 5787,
      "sha256": "f504bf10529fa1b8014473dbd1521146b592914079568c09b5a428bf0e14174d",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the long pages), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.ka.watts.csv",
      "bytes": 4736,
      "sha256": "fa3c73fbd3769ee9e62f632dfafccea1856e56b4f046a34d4525014db3248305",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the long pages): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kc.idle.csv",
      "bytes": 631,
      "sha256": "6998bc559e3f105a08cebaf28860b5d1a9e6cef88c925e764dffd18cffed97b1",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kc.jsonl",
      "bytes": 350823,
      "sha256": "f3716c3734b876d7b054ac4e03783a0ab4ed311a325287a0fc2088f4b8196c00",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kc.report.json",
      "bytes": 6118,
      "sha256": "ad368e5a06643593232c31da7a0fe3300a0ab360101e16463c72e3de83a8e213",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kc.watts.csv",
      "bytes": 1353,
      "sha256": "2885c5ed259a7071e7aa33fd306f67b0af62fbfdce6ab5488f88c7f180ec2b6e",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kperm.idle.csv",
      "bytes": 630,
      "sha256": "bdb0bdbf920fde6a65f44289c4d8ab98898f610f4410a8a592bb460f9b91b70f",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the six-way under six option orders), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kperm.jsonl",
      "bytes": 1288298,
      "sha256": "52ca45dc57575504cf9084c275a147dba2e6008b2c483403b594d3147b058640",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the six-way under six option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kperm.report.json",
      "bytes": 6121,
      "sha256": "62d3f3caae6973e8324904f03389d9bb44dbb685a29657f93952a7733aedf053",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the six-way under six option orders), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-high.kperm.watts.csv",
      "bytes": 7920,
      "sha256": "407a69bf3d141d3fd947428c9c3866df0cf3097ec71801370b3ac1d0ea85455a",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the six-way under six option orders): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-low.kc.idle.csv",
      "bytes": 630,
      "sha256": "48481b64859cbc10876f26f2010b806db0aee73c29c3cee3e81d38aa52a5044a",
      "role": "The ten-second read of the card taken before one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-low.kc.jsonl",
      "bytes": 351958,
      "sha256": "b9ccddb0d69916621080c51315b9159d0214c86974ad7e29991f489dfa7202d1",
      "role": "One run's scored rows for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-low.kc.report.json",
      "bytes": 6137,
      "sha256": "21833bcca50470b7340539bcf308176a98ccd17d0889a0a1264c00bd60e9f627",
      "role": "One task's own report for the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "apus-2026-09-28/rows/apus-9b-low.kc.watts.csv",
      "bytes": 767,
      "sha256": "e76230f71d94e9fa349ff3936b88e0de8da871fb4109d31489bfd011da5db907",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the APUS-OpenJev-v1 bench (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "cost-of-intelligence-2026-09-23/KIT.lock.six-way.json",
      "bytes": 48909,
      "sha256": "f6dc920c8c3de156f34a653f1a257b0b6109049587815e4e2be75bfc040fd332",
      "role": "The six-way part of the cost series' kit lock: the options in kit order, the label counts, the chair counts, and per line its id, label, chair model family, dinner id, kit index, prompt sha256 and text sha256. Extracted by the filter README.md states."
    },
    {
      "file": "cost-of-intelligence-2026-09-23/benchbox-3090-reading-0/rows/b-mistral-small3.2-24b/b-mistral-small3.2-24b.c.jsonl",
      "bytes": 120549,
      "sha256": "7e4880f36a3975e76b81c7e869268c1b728e7324c046ea210864adef16750c48",
      "role": "One run's scored rows for the cost series' Mistral Small 3.2 24B reading (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "cost-of-intelligence-2026-09-23/largecard-reading-0/rows/b1-mistral-small3.2-cd/b1-mistral-small3.2-cd.c.jsonl",
      "bytes": 122652,
      "sha256": "ffc5dffd1616ff4aa607000b96385250dc56352b2aa52aac40a4833d0aaac733",
      "role": "One run's scored rows for the cost series' Mistral Small 3.2 24B reading (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/PREREG-v0.md",
      "bytes": 39439,
      "sha256": "186dd9e7459249f5d0863e99adda5b58593126af7d190a0010a5d1ef6df6c708",
      "role": "The pre-registration of the Deem bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "deem-2026-09-27/rows/d0-cpu-0.8.s0.P.rep1.jsonl",
      "bytes": 331604,
      "sha256": "ebe0c62d7bda00cbc455ccd222ff551903e7dfa15d602ba07185306a6799d70e",
      "role": "One run's scored rows for the Deem bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/rows/d0-cpu-0.8.s0.P.rep1.pass.json",
      "bytes": 5643,
      "sha256": "99f3a3a4dbd9dd8576f9c7d0dc9bab03131366fab0cbf43ab728edb0c3af039d",
      "role": "One counted pass's receipt for the Deem bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "deem-2026-09-27/rows/d0-cpu-0.8.s0.P.rep2.jsonl",
      "bytes": 338049,
      "sha256": "5c0940a26c1349c3af1d68f9d8270afa5efda13fe3d19ca95810b0ea7e05833f",
      "role": "One run's scored rows for the Deem bench (the six-way again (rep 2, the determinism re-run)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/rows/d0-cpu-0.8.s0.P.rep2.pass.json",
      "bytes": 7048,
      "sha256": "d2effb27dec665661acd85b3cc5b8426b9eeb048eb4fe29d7a669252962b5a11",
      "role": "One counted pass's receipt for the Deem bench (the six-way again (rep 2, the determinism re-run)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "deem-2026-09-27/rows/d0-cpu-0.8.s0.S.rep1.jsonl",
      "bytes": 338394,
      "sha256": "886fa980a89adea97b1d85f883d4861d8de7844396da34421cc6893c7428ddca",
      "role": "One run's scored rows for the Deem bench (the six-way under rendering S, the registered secondary rendering): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/rows/d0-cpu-0.8.s0.S.rep1.pass.json",
      "bytes": 6301,
      "sha256": "bf7cdb3696a06a82c17390b328a1f81dc9a183495fc70396a9fbb1ce1afb6656",
      "role": "One counted pass's receipt for the Deem bench (the six-way under rendering S, the registered secondary rendering): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "deem-2026-09-27/t1-tune/PREREG-T1.md",
      "bytes": 56797,
      "sha256": "be81b356c80a963af718b2206d1f3903cfd45b5bc3304c362f7edcb6cc3f53f9",
      "role": "The pre-registration of the Deem bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "deem-2026-09-27/t1-tune/baseline_nb.py",
      "bytes": 6300,
      "sha256": "7d7fbe1a6f1c9a2419323cbc8a33289fbb99a9b43a22fc948ef56158b9942033",
      "role": "The word counter: a multinomial naive Bayes over single words with add-one smoothing, stdlib only. `--set s0` reads the six-way; `--set fold1` to `fold4` read the folds. See README.md before running it."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/fold1-ancients.json",
      "bytes": 83327,
      "sha256": "e521b018e6a122b5f8bcdeb443fd2905402ac03536c909f8ccc2819f6096801f",
      "role": "One fold's held-out table: the pool's lines from that table, as the builder wrote them."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/fold2-cross.json",
      "bytes": 60998,
      "sha256": "7a1cdecddfea20fb8de6e501da82f7b9671d2f38d7e67a9a88d10766981cd39f",
      "role": "One fold's held-out table: the pool's lines from that table, as the builder wrote them."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/fold3-operator.json",
      "bytes": 88149,
      "sha256": "2f5f291a09e661b927fbf8df2e97a01c41391fdb96138073febbbe788fa2fe27",
      "role": "One fold's held-out table: the pool's lines from that table, as the builder wrote them."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/fold4-span.json",
      "bytes": 72332,
      "sha256": "b372fe8c499f2fe98960189ae63c4a7c7c5070fa1b02e99bec74ad4760bbb374",
      "role": "One fold's held-out table: the pool's lines from that table, as the builder wrote them."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/folds.json",
      "bytes": 12019,
      "sha256": "303cb1b6c346e8b2a1395353da00f1355d3be1378944dc6a1372a252a7a81640",
      "role": "The four leave-one-table-out folds over the pool."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/t1-pool.json",
      "bytes": 304797,
      "sha256": "8d1b844a1d1539c28b7c775c37ed2e7e615dbb30e1e7ab8eecec1bea93ad84fb",
      "role": "The word counter's 227 labelled training lines: guests' lines from 32 test dinners of 2026-09-12, each the reply of a logged model call (Gemma 4 26B or Mistral Small 3.2 24B) to a preset host line; none is a visitor's."
    },
    {
      "file": "deem-2026-09-27/t1-tune/kit/t1-pool.manifest.json",
      "bytes": 12831,
      "sha256": "caca3ada281d28fe00237ce0a55f6312d3953ca61b5be77e338ecb6650251043",
      "role": "The pool's manifest as its builder wrote it: counts, drops, fingerprints and the pinned sources."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-baseline-nb.fold1.P.rep1.jsonl",
      "bytes": 56184,
      "sha256": "6870bfa10504bfd6f98d589d3b2e505a5996ba6bc69983105a2e016e7ed6cc78",
      "role": "One run's scored rows for the Deem bench (one of the word counter's leave-one-table-out folds): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-baseline-nb.fold2.P.rep1.jsonl",
      "bytes": 41351,
      "sha256": "84f6a6a8e3d27118c21981c9f3dbb3e1de5764b494a65adf4283f4ae3129dfff",
      "role": "One run's scored rows for the Deem bench (one of the word counter's leave-one-table-out folds): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-baseline-nb.fold3.P.rep1.jsonl",
      "bytes": 53512,
      "sha256": "228ed5931534cdeff5911e400831af0d91899afbc372a78e528f3c03bc13cda9",
      "role": "One run's scored rows for the Deem bench (one of the word counter's leave-one-table-out folds): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-baseline-nb.fold4.P.rep1.jsonl",
      "bytes": 46482,
      "sha256": "9c61ff64b25361c4fb4d99efdb8fa648a187bde99fadce0349d927c13f869cad",
      "role": "One run's scored rows for the Deem bench (one of the word counter's leave-one-table-out folds): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-baseline-nb.s0.P.rep1.jsonl",
      "bytes": 93917,
      "sha256": "fd92574b50c288a1d5dfdb7d3f39a0e172f3367a42d89fb7eadf4e9d1a6e01a9",
      "role": "One run's scored rows for the Deem bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-null-20260927.s0.P.rep1.jsonl",
      "bytes": 372672,
      "sha256": "63a032369fc39aea35e1e2cd09525a36d0011dfd352c8a405831c86324441d83",
      "role": "One run's scored rows for the Deem bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line. The number in the file name is the control's shuffle seed (20260927, 20260928 or 20260929), not a date."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-null-20260927.s0.P.rep1.pass.json",
      "bytes": 6239,
      "sha256": "df87e95cd284470c3d877db8bbf152ae5f8bb27d8bf02704c3e5a68e33043d91",
      "role": "One counted pass's receipt for the Deem bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window. The number in the file name is the control's shuffle seed (20260927, 20260928 or 20260929), not a date."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-null-20260928.s0.P.rep1.jsonl",
      "bytes": 373576,
      "sha256": "1137cd326eac60d15e599263122dbe2ef2f95913526d3ed03184499483b62fd3",
      "role": "One run's scored rows for the Deem bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line. The number in the file name is the control's shuffle seed (20260927, 20260928 or 20260929), not a date."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-null-20260928.s0.P.rep1.pass.json",
      "bytes": 6373,
      "sha256": "d2fcf41e1b5be134329f718dd230e3e3e64e1ffbcb2506a146edfb73c1de71b7",
      "role": "One counted pass's receipt for the Deem bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window. The number in the file name is the control's shuffle seed (20260927, 20260928 or 20260929), not a date."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-null-20260929.s0.P.rep1.jsonl",
      "bytes": 372410,
      "sha256": "d40807f0fd3007bfba7faf325392640383f35097b88eee6816f8b374cf384b12",
      "role": "One run's scored rows for the Deem bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line. The number in the file name is the control's shuffle seed (20260927, 20260928 or 20260929), not a date."
    },
    {
      "file": "deem-2026-09-27/t1-tune/rows/t1-null-20260929.s0.P.rep1.pass.json",
      "bytes": 6352,
      "sha256": "dc708185b4ec4c687c26ce27f767800a985369d2e73db6a6606e73a4e544bb7a",
      "role": "One counted pass's receipt for the Deem bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window. The number in the file name is the control's shuffle seed (20260927, 20260928 or 20260929), not a date."
    },
    {
      "file": "deem-2026-09-27/t1-tune/t1common.py",
      "bytes": 6745,
      "sha256": "ec377fda2f3e78a5876d0d7a95dcd761363a586afd4dde0c1b9fe91de2ae423b",
      "role": "The shared pins and helpers baseline_nb.py imports."
    },
    {
      "file": "doorman-planted-2026-09-13/PRE-REGISTRATION.md",
      "bytes": 5871,
      "sha256": "c16faa4753c38ad5e1d68fba4f3c231e5eb75371e1c470e3e49b40b13d19ae83",
      "role": "The pre-registration of the 2026-09-13 doorman run, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "imajev-2026-09-28/PREREG-imajev.md",
      "bytes": 41612,
      "sha256": "09c15b955d5c45e7f89587ff89edbd8b44f0edcb3ec92433706d48e4d7d0195c",
      "role": "The pre-registration of the imajev bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "imajev-2026-09-28/rows/imajev-4b-cpu.kc.jsonl",
      "bytes": 385361,
      "sha256": "c48bf8e6a0e333d8b1f8ccf93022102481f593c30573af89650bfb1322538f27",
      "role": "One run's scored rows for the imajev bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "imajev-2026-09-28/rows/imajev-4b-cpu.kc.summary.json",
      "bytes": 2058,
      "sha256": "84671514ef7b729ba0bab853670688f473ebcd3413572f51290f0f667f3563f7",
      "role": "One task's own summary for the imajev bench (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "jev-2026-09-21/ARM13-OJ-GGUF.md",
      "bytes": 44686,
      "sha256": "cc971340bbbcbb5400e4121ba0f5326d31c63e4139cdc5b235d2312c3c23a34c",
      "role": "The pre-registration of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B), as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "jev-2026-09-21/receipts/oj-gguf/run/counted-run.json",
      "bytes": 31254,
      "sha256": "c83c23cdf29cbbfc9401c044d6fde0e9bfa9070bde3859bf06160cdcf11fbccb",
      "role": "The counted run's own record for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B): its pins, its environment, the card posture before and after, and the residency check (what the model added to the card at load)."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-generate.c.idle.csv",
      "bytes": 630,
      "sha256": "ef05eec7743ca4f2504bf79938dec31a798c45a4159e2055fa603925dae912fc",
      "role": "The ten-second read of the card taken before one task of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-generate.c.jsonl",
      "bytes": 176164,
      "sha256": "61d248fbe322db0367c5a11d2aec5d9678f16c767ba1577d438120287c1549b6",
      "role": "One run's scored rows for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-generate.c.report.json",
      "bytes": 5940,
      "sha256": "82a8f9b9b7276a81e21b150a8cf8c4dfb2454cbcc98f54638cb79e5c10492fb5",
      "role": "One task's own report for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-generate.c.watts.csv",
      "bytes": 7877,
      "sha256": "c11a817eb5c494fb8946ab9dff2815ad8313779bddf2ff74e882955a7c6191ed",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.c.idle.csv",
      "bytes": 630,
      "sha256": "bd6f8f51a38b3de58f99ec200c774c0e5f9064e509dde0548a2ad5acf1eaea16",
      "role": "The ten-second read of the card taken before one task of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.c.jsonl",
      "bytes": 213872,
      "sha256": "07592fc7a48ef5cba8db0afbc45ac9a610ea8af52c8b21471ff29de39aaddeb8",
      "role": "One run's scored rows for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.c.report.json",
      "bytes": 6153,
      "sha256": "8aba707bac359b9e0097b2fad448b86e0962088022e8ee88202dfa1746bf8f30",
      "role": "One task's own report for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.c.watts.csv",
      "bytes": 7744,
      "sha256": "ca8bc7f9c7253736fc85ad2d0ab1d8ba5e7bd30beb534f59e22e20542ba5cfc6",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.creorder.idle.csv",
      "bytes": 630,
      "sha256": "9f112da66bfb79c9bfda9538376418ba749fcb076c610321ebd8903b34e27227",
      "role": "The ten-second read of the card taken before one task of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way under six option orders), in the same columns as its .watts.csv."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.creorder.jsonl",
      "bytes": 1463093,
      "sha256": "53313e4c32e80c3630b798fbacdb7e84f028eedcceec1fa8bd84e1b5646b619b",
      "role": "One run's scored rows for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way under six option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.creorder.report.json",
      "bytes": 6283,
      "sha256": "5fedaa8f89727d44162df1d2a819672f23ab5c4eefcb3bd3bf164b36ad2c5430",
      "role": "One task's own report for arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way under six option orders), as the harness wrote it."
    },
    {
      "file": "jev-2026-09-21/rows-oj-gguf/openjev-q4km-readout.creorder.watts.csv",
      "bytes": 56904,
      "sha256": "e337f201dd381266f3e9d64178cf9cc65711e2ca235bc8ecc7477c61b4b0218a",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of arm 13 of the Jev bench (OpenJev 27B, 4-bit GGUF, through ollama on card B) (the six-way under six option orders): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "lev-2026-09-28/PREREG-lev.md",
      "bytes": 49170,
      "sha256": "fc57bc1b8ab136a4cbaf3a34a35b5700d4b92a40bc57e00503a83ea4dd3d5475",
      "role": "The pre-registration of the Lev bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "lev-2026-09-28/l1/rows/lev-4b-cpu.kc.jsonl",
      "bytes": 192403,
      "sha256": "35831d96ab73d4278e0ad1df94e5a298b91a51c5a1ac0017eeb6803fbb31e9c5",
      "role": "One run's scored rows for the Lev bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "lev-2026-09-28/receipts/counted-run.json",
      "bytes": 26944,
      "sha256": "2d41db4b01ea1955a29487c8322dde8cc732f636f1e663f2819e789ae7f10f27",
      "role": "The counted run's own record for the Lev bench: its pins, its environment, the card posture before and after, and the residency check (what the model added to the card at load)."
    },
    {
      "file": "lev-2026-09-28/receipts/counted-telemetry.jsonl",
      "bytes": 151573,
      "sha256": "1f4af79caa8bc0caadd1e9e125dce53652a1bc1de993b3b3a73d875da31065e0",
      "role": "The card's own power, temperature, memory and clocks sampled at 2 Hz through the counted run of the Lev bench, one JSON object a sample."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.ka.idle.csv",
      "bytes": 630,
      "sha256": "040d18d410829d8161dc30c9a3f50b4e9bf2d9318d523b0eafb036d9fd168ec2",
      "role": "The ten-second read of the card taken before one task of the Lev bench (the long pages), in the same columns as its .watts.csv."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.ka.jsonl",
      "bytes": 127533,
      "sha256": "9aa4990513979a22748eb05ed58f3b3dbc52ea3d04ea40c5bbb574a72022209b",
      "role": "One run's scored rows for the Lev bench (the long pages): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.ka.report.json",
      "bytes": 5904,
      "sha256": "c15c29a5676584b53819b26ed3af9fda9f72ea2a45edb97686e14b70189cdaad",
      "role": "One task's own report for the Lev bench (the long pages), as the harness wrote it."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.ka.watts.csv",
      "bytes": 7013,
      "sha256": "c81298b8e7317207fa165d4534eff66c478f9f919d04d0e4ada816a6485c6f30",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the Lev bench (the long pages): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kc.idle.csv",
      "bytes": 621,
      "sha256": "99536ad891dd6c813228cd17c6398654a98f44fdf235ed6d2c525ef56a620f6c",
      "role": "The ten-second read of the card taken before one task of the Lev bench (the six-way (which of six guests said a line; 108 lines)), in the same columns as its .watts.csv."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kc.jsonl",
      "bytes": 235350,
      "sha256": "736091b85ed3dceaa390421bd5e8ed122d1a69f193ec2c468794d08ce704f067",
      "role": "One run's scored rows for the Lev bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kc.report.json",
      "bytes": 6055,
      "sha256": "e7960bc857241090c3a96892a415445e422e3db1491c8d0d63264a5b98f8a1c4",
      "role": "One task's own report for the Lev bench (the six-way (which of six guests said a line; 108 lines)), as the harness wrote it."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kc.watts.csv",
      "bytes": 1479,
      "sha256": "3a46e6017ec04e08b85e4c4a900d54380c5400c23c0fc12fd4052ac8b729de21",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the Lev bench (the six-way (which of six guests said a line; 108 lines)): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kperm.idle.csv",
      "bytes": 630,
      "sha256": "bc8aa05812ad00ec04c12378c00b7a5cba0a587f2eb9fd273d823e1d83bf0698",
      "role": "The ten-second read of the card taken before one task of the Lev bench (the six-way under six option orders), in the same columns as its .watts.csv."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kperm.jsonl",
      "bytes": 744922,
      "sha256": "f189cc6abb7443f357ff04b17ad5a00361248922bd89d0b25cffb5a4955a1a31",
      "role": "One run's scored rows for the Lev bench (the six-way under six option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kperm.report.json",
      "bytes": 6065,
      "sha256": "0ab71366b6be56366003fd77a2be4787378ec3300b0210ba9a0a6f7da3d02d44",
      "role": "One task's own report for the Lev bench (the six-way under six option orders), as the harness wrote it."
    },
    {
      "file": "lev-2026-09-28/rows/lev-4b.kperm.watts.csv",
      "bytes": 9098,
      "sha256": "ef189ec1388c11d62c3eafa07edcda2534819b6db7ff4f3c23f945f84df29c22",
      "role": "The card's own power and memory sampled at 1 Hz by nvidia-smi through one task of the Lev bench (the six-way under six option orders): UUID fingerprint, UTC time, watts, memory used in MiB, utilisation."
    },
    {
      "file": "opendecider-2026-09-28/PREREG-O1.md",
      "bytes": 33084,
      "sha256": "aea406573d0daf651222e18396d1e65e08bb239f2c3746dc6e85bbb859b5b212",
      "role": "The pre-registration of the OpenDecider bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "opendecider-2026-09-28/PREREG-O2.md",
      "bytes": 50708,
      "sha256": "19fd1367566078e06aa35dd4d43b02c3ec33e5c60eb8652f1e3ff80ab8a40e15",
      "role": "The pre-registration of the OpenDecider bench, as committed before its first model call (with its dated amendments), rewritten only by the kit's rules."
    },
    {
      "file": "opendecider-2026-09-28/receipts/counted-telemetry.jsonl",
      "bytes": 324782,
      "sha256": "04db178bc6e538ad8b9cdb56c8699be1e22d1042172311d30fc12d2a6745523e",
      "role": "The card's own power, temperature, memory and clocks sampled at 2 Hz through the counted run of the OpenDecider bench, one JSON object a sample."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep1.jsonl",
      "bytes": 351839,
      "sha256": "03f8679e7822dca92803c6bb31068dca568e33344365091c3c3b53955012d89b",
      "role": "One run's scored rows for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep1.k1-5.jsonl",
      "bytes": 1760182,
      "sha256": "998cf6344340eea89852413f58e9e727a4b7ddf7d2a6b214a50fddc1d6bc1d42",
      "role": "One run's scored rows for the OpenDecider bench (the six-way under five more option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep1.k1-5.pass.json",
      "bytes": 8250,
      "sha256": "cf45c3525bd9bc22144f79a3acd5c648e8cdcc76dfd1cde62846354f0250ced0",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way under five more option orders): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep1.k1-5.worker.log",
      "bytes": 147,
      "sha256": "141ee9900e5cbeac8bdbc0be6173c937e7ac29c6be9e154b4b8cc1f964154d18",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way under five more option orders)."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep1.pass.json",
      "bytes": 8255,
      "sha256": "0c6700d3e05f69382a30f5293b6daa84711ac59d2d0c14c4a5e761b0dfee3c25",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep1.worker.log",
      "bytes": 147,
      "sha256": "fbbe597d06f8dc5dbf88e53ac1d96f94d5b4ec695b55812ce4ceec9bca7829ce",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines))."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep2.jsonl",
      "bytes": 351823,
      "sha256": "f10576744bd877e7db7f38f0efa0f7c6897198d258e32cdd0c876d3871cea3c3",
      "role": "One run's scored rows for the OpenDecider bench (the six-way again (rep 2, the determinism re-run)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep2.pass.json",
      "bytes": 8243,
      "sha256": "f7f02c631887f4e9126e109ed64b820dfd2db29fd13f73cb53558f68153fb6f8",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way again (rep 2, the determinism re-run)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.P.rep2.worker.log",
      "bytes": 147,
      "sha256": "5b69e3e5f5dca68691d6a6b6e222d0c8a6ad9df5b3a3cdba9847995d7979ece3",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way again (rep 2, the determinism re-run))."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.S.rep1.jsonl",
      "bytes": 352170,
      "sha256": "e9aa1ca069ba408a6bd0a6e3c314d23ce3ccbdb4d10edfb226957b1e130cbc69",
      "role": "One run's scored rows for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.S.rep1.pass.json",
      "bytes": 8247,
      "sha256": "e2e7bd1d2963e98ff888ab5a809c67dd6a62870bd90438cc330f873d3d23812b",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o1-cpu-nano.s0.S.rep1.worker.log",
      "bytes": 147,
      "sha256": "410240bfc31d94f30b2f19276223466e051dac733dc20d3a141a80cbdb574898",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering)."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep1.jsonl",
      "bytes": 384076,
      "sha256": "b26a7b1ef09d5ea4861ee38ccc8ea91eda2479e43f14b0db2c7f50f242305a90",
      "role": "One run's scored rows for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep1.k1-5.jsonl",
      "bytes": 1920641,
      "sha256": "269a5f16aca8870b16f01dd037d92aea1aebb6abd31fe7ab46db099f013a29fd",
      "role": "One run's scored rows for the OpenDecider bench (the six-way under five more option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep1.k1-5.pass.json",
      "bytes": 9837,
      "sha256": "262455851438fdf7350a9d75d20010f3785977476dc21de187daf705f2cdca5d",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way under five more option orders): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep1.k1-5.worker.log",
      "bytes": 148,
      "sha256": "8ec872253bf949fb6859112145b5fd641d33048ab11fa891ccfe30a5df60fbfb",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way under five more option orders)."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep1.pass.json",
      "bytes": 9830,
      "sha256": "3bf438ed571d68302aa48e9cc32b5e164aa40f9bac2dc2b24086fe808103abd5",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep1.worker.log",
      "bytes": 148,
      "sha256": "c0517655ce0ff49df27ea80bf7960616299a1c8b5f6971cc5660eb2355f98d82",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines))."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep2.jsonl",
      "bytes": 384077,
      "sha256": "28eba00f207dc86727dfefa9d23b302f89e9431a336739f40cd42d04b85f5a3a",
      "role": "One run's scored rows for the OpenDecider bench (the six-way again (rep 2, the determinism re-run)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep2.pass.json",
      "bytes": 9833,
      "sha256": "40dbc6dd7836e43b93d95d3b071942b89a54dabdd74176552176c3e22853bae9",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way again (rep 2, the determinism re-run)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.P.rep2.worker.log",
      "bytes": 148,
      "sha256": "0371f011a0060a61f308b7fd458178dde8bd7ac0b56752099478f3617a2b626d",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way again (rep 2, the determinism re-run))."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.S.rep1.jsonl",
      "bytes": 384217,
      "sha256": "ed15481fc84084d1c1bd3706f70627a94dd356f6d4b2b8eab8358014d4ef9106",
      "role": "One run's scored rows for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.S.rep1.pass.json",
      "bytes": 9830,
      "sha256": "7b7c5a90d2e26779b5fa9893d5cf459042ef240b00d4b8ed8a02b359654275d3",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2-gpu-small.s0.S.rep1.worker.log",
      "bytes": 148,
      "sha256": "0e3abad1159eeea34d57f0119b63f1f34126fa5fc3314f9c66cd7cb0d1226ddf",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering)."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep1.jsonl",
      "bytes": 376051,
      "sha256": "62b3fe97577e00f1e8186f8d1ba4b8417e137b12aa5361c08b10f2d975d95507",
      "role": "One run's scored rows for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep1.k1-5.jsonl",
      "bytes": 1881929,
      "sha256": "dc67790dc0becd683944405b5e2d6906231bc69ff0dd14441499498d80e43caf",
      "role": "One run's scored rows for the OpenDecider bench (the six-way under five more option orders): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep1.k1-5.pass.json",
      "bytes": 9601,
      "sha256": "5373c486358e90033d15c7a352d0c78808684092f7bea81ed9545812707d58bd",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way under five more option orders): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep1.k1-5.worker.log",
      "bytes": 148,
      "sha256": "eb81076e9114ad9dc0baff079d8b2c3078b55c607ab43143cc7e425918b2d234",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way under five more option orders)."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep1.pass.json",
      "bytes": 9597,
      "sha256": "e19fcc3fae20cf164fd712379de19379ce1c828c62d6d3a7da725335ecbe1637",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep1.worker.log",
      "bytes": 148,
      "sha256": "c203ea05bee106b8757f15384d79bbb88b082111c7ba86e2aa4f8faef2359cfc",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way (which of six guests said a line; 108 lines))."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep2.jsonl",
      "bytes": 376059,
      "sha256": "fbf49865bbb0c1b3b967e78a7c9a90e59582b819173dbcbbf4637d4344d3ab30",
      "role": "One run's scored rows for the OpenDecider bench (the six-way again (rep 2, the determinism re-run)): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep2.pass.json",
      "bytes": 9595,
      "sha256": "7eab03c2184e92f265f6673817e26e3cb9e5987bbd76ce6ca239d5b961a956b2",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way again (rep 2, the determinism re-run)): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.P.rep2.worker.log",
      "bytes": 148,
      "sha256": "e5c8dd36fa2e74ca13f2c57dc654cd6b8748cda6de5735ddf7635e49463d2435",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way again (rep 2, the determinism re-run))."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.S.rep1.jsonl",
      "bytes": 376383,
      "sha256": "9d8e0eea74f41cac5221e5887c45ddb1795d89d07f6ebc971c4f757f3dc4fdd3",
      "role": "One run's scored rows for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering): per question, the choice, the probabilities, the seconds and the token counts, one JSON object a line."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.S.rep1.pass.json",
      "bytes": 9595,
      "sha256": "0e2223c8eed0896f085b8fd9cfb6f4ceea526f640ed6aeae29d3b380f4568da9",
      "role": "One counted pass's receipt for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering): the preflight, the worker, the card or processor readings, the residency check and the pass's own window."
    },
    {
      "file": "opendecider-2026-09-28/rows/o2c-gpu-qwen3-4b-base.s0.S.rep1.worker.log",
      "bytes": 148,
      "sha256": "93366a21402424e9a84b12f02a7d0a12f779be4f54db058aa3959769d71dbac0",
      "role": "One counted pass's worker log for the OpenDecider bench (the six-way under rendering S, the registered secondary rendering)."
    },
    {
      "file": "recount-v2.json",
      "bytes": 118682,
      "sha256": "054697853a1ed3bf0e3ddf48de606423aa307037df8b61c07def4167f5b01327",
      "role": "recount_v2.py's output over the full private record, the figures of record, including the counts of the sets whose rows are held back."
    },
    {
      "file": "recount_on_the_kit.py",
      "bytes": 13120,
      "sha256": "31744e8d7115c0f76a54b6eac270df75c72b83d95d65d8e18e05a74be7f494b3",
      "role": "Runs recount_v2.py, as it ran, over this kit and the Reading the answer kit, statement by statement, and checks every figure it can re-derive against recount-v2.json. Stdlib only."
    },
    {
      "file": "recount_v2.py",
      "bytes": 70778,
      "sha256": "1874539a8e9936e00b5ed141dda706eb023d757b8ff0440fe515d62ff6a53f89",
      "role": "The recount, as it ran over the private record: a standard-library script that re-derives every count, interval, tie range, paired test, six-order figure, median and memory reading from the row files. recount_on_the_kit.py runs it over this kit."
    },
    {
      "file": "render_evidence_v2.py",
      "bytes": 41424,
      "sha256": "f87b25543b7777c3733ff7e37e2a95b1354ef5967bbf0015bc515e56108bf765",
      "role": "The script that writes EVIDENCE-v2.md's tables from recount-v2.json."
    },
    {
      "file": "work-v2/reads/manifest.tsv",
      "bytes": 11509,
      "sha256": "1915f5fc3e85fbc9419ee6762f16936052bf68a20f82e4dd64acb562063074f3",
      "role": "READS-v2.md's manifest: each read's URL, UTC read time, HTTP status, bytes and sha256 (51 reads). The response bodies themselves are not published (README.md)."
    },
    {
      "file": "work-v4/stat/checks.py",
      "bytes": 8680,
      "sha256": "de810cd1a172e4764c8c8e6c16b9928cef6f9b0d2e3847ff1a806537236fae73",
      "role": "The v4 statistician's first script for the page's checks drawn from the recount's counts (the correction for seventeen tests, the paired intervals, the door's bounds), as it ran over the private record's recount-v2.json. recount_v2.py's `checked` section now re-derives the figures the page prints from it."
    },
    {
      "file": "work-v4/stat/cluster.py",
      "bytes": 7166,
      "sha256": "3840ec27140547b41d65bb385ffb0f026602166bebdd6e20fc2b2651de77cbb3",
      "role": "The v4 statistician's resample by dinner (the six-way's 108 lines come from 16 dinners), as it ran over a checkout of the private record. recount_v2.py's `checked.resample_by_dinner` now re-derives it, with the same seed and the same draw."
    },
    {
      "file": "work-v4/stat/pairs.py",
      "bytes": 3292,
      "sha256": "8a14681df8854eacf016e30b90247f286e617f30d113de134044929961abe050",
      "role": "The v4 statistician's paired checks (the 9B against the live door, which lines moved over the six option orders, the word-counter test in each order), as it ran over a checkout of the private record. recount_v2.py's `checked` section now re-derives them."
    }
  ]
}