{
  "chart": "s2s-chart/1",
  "kind": "bars",
  "title": "How fast does each machine read the question? Prompt processing with nothing cached",
  "subtitle": "Prompt tokens read a second with the model just loaded and nothing cached, at default threads; a longer bar reads faster. The 3700X rows are three fresh runs (2026-11-04 and 2026-11-08), the rest two cold runs on 2026-08-25 (the 70B one), the same construction.",
  "unit": "tok/s",
  "series": [
    "Prompt reading"
  ],
  "panels": [
    {
      "heading": "qwen3.5:9b, dense 9B · 537-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "109.4",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m1.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 109.4125"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "38.2",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m1.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 38.2017"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "33.5",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m1.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 33.5084"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "47.7",
              "source": "/ram-speeds-compared/data/fill-in/two-channel-desktop/summary.json arms[arm = \"f1-qwen3.5-9b-tdef\"].prefill_median 47.7"
            }
          ]
        }
      ]
    },
    {
      "heading": "gemma4:12b, dense 12B · 536-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "78.0",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m2.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 77.9816"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "24.2",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m2.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 24.1720"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "20.9",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m2.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 20.9379"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "31.3",
              "source": "/ram-speeds-compared/data/fill-in/two-channel-desktop/summary.json arms[arm = \"f1-gemma4-12b-tdef\"].prefill_median 31.278"
            }
          ]
        }
      ]
    },
    {
      "heading": "phi4:14b, dense 14B · 505-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "62.3",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m3.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 62.2995"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "19.1",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m3.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 19.1204"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "14.3",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m3.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 14.3250"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "23.9",
              "source": "/ram-speeds-compared/data/fill-in/two-channel-desktop/summary.json arms[arm = \"f1-phi4-14b-tdef\"].prefill_median 23.936"
            }
          ]
        }
      ]
    },
    {
      "heading": "mistral-small3.2:24b, dense · 1,023 tokens",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "41.5",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m4.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 41.5492"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "12.4",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m4.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 12.4220"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "10.5",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m4.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 10.4744"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "16.4",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[1].prefill_median 16.383"
            }
          ]
        }
      ]
    },
    {
      "heading": "gemma4:26b, mixture · 536-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "143.7",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m5.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 143.7255"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "63.0",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m5.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 63.0048"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "46.9",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m5.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 46.9384"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "65.0",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[0].prefill_median 64.97"
            }
          ]
        }
      ]
    },
    {
      "heading": "Nemotron 30B-A3B, mixture · 532 tokens",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "132.2",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m6.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 132.1768"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "54.0",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m6.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 53.9973"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "37.9",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m6.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 2 (rule 2) 37.9157"
            }
          ]
        }
      ]
    },
    {
      "heading": "llama3.3:70b, dense 70B · EPYC only",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "13.4",
              "source": "/two-hours-on-battery/data/runs/cpu-server-x2.json cold_load[] prompt_eval_count ÷ prompt_eval_duration_ns, median of 1 (rule 2) 13.4416"
            }
          ]
        }
      ]
    }
  ],
  "source": "The battery page's kit, runs/cpu-{server,laptop,mini}-m1…m6.json and cpu-server-x2.json, cold_load[] prompt_eval_count over prompt_eval_duration_ns (its counting rule 2). Exhibit 105's kit, two-channel-desktop/summary.json arms[0..1].prefill_median. This page's kit, fill-in/two-channel-desktop/summary.json, the three f1- arms' prefill_median. Table T2."
}