{
  "chart": "s2s-chart/1",
  "kind": "bars",
  "title": "How long until the first word of the answer? A fresh question, the model already loaded",
  "subtitle": "Seconds from sending a fresh question to the first word of the answer, the model already loaded and nothing cached, at default threads; a shorter bar is a shorter wait. The 3700X rows are three fresh runs (2026-11-04 and 2026-11-08), the rest two cold runs on 2026-08-25 (the 70B one).",
  "unit": "s",
  "series": [
    "First word"
  ],
  "panels": [
    {
      "heading": "qwen3.5:9b, dense 9B · 537-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "4.92",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m1.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 4.9195"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "14.06",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m1.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 14.0612"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "16.03",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m1.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 16.0311"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "11.26",
              "source": "/ram-speeds-compared/data/fill-in/two-channel-desktop/summary.json arms[arm = \"f1-qwen3.5-9b-tdef\"].first_word_median_ms 11263.7 ÷ 1,000"
            }
          ]
        }
      ]
    },
    {
      "heading": "gemma4:12b, dense 12B · 536-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "6.89",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m2.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 6.8868"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "22.18",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m2.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 22.1800"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "25.61",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m2.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 25.6059"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "17.14",
              "source": "/ram-speeds-compared/data/fill-in/two-channel-desktop/summary.json arms[arm = \"f1-gemma4-12b-tdef\"].first_word_median_ms 17143.5 ÷ 1,000"
            }
          ]
        }
      ]
    },
    {
      "heading": "phi4:14b, dense 14B · 505-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "8.11",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m3.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 8.1150"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "26.42",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m3.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 26.4160"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "35.39",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m3.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 35.3861"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "21.10",
              "source": "/ram-speeds-compared/data/fill-in/two-channel-desktop/summary.json arms[arm = \"f1-phi4-14b-tdef\"].first_word_median_ms 21103.4 ÷ 1,000"
            }
          ]
        }
      ]
    },
    {
      "heading": "mistral-small3.2:24b, dense · 1,023 tokens",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "24.63",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m4.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 24.6330"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "82.36",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m4.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 82.3586"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "97.67",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m4.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 97.6731"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "62.45",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[1].first_word_median_ms 62446.1 ÷ 1,000"
            }
          ]
        }
      ]
    },
    {
      "heading": "gemma4:26b, mixture · 536-token prompt",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "3.74",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m5.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 3.7424"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "8.51",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m5.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 8.5129"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "11.43",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m5.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 11.4255"
            }
          ]
        },
        {
          "label": "3700X, 32 GB DDR4",
          "notes": "Desktop · 2 ch DDR4-3200 · 8 threads (default)",
          "values": [
            {
              "value": "8.26",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[0].first_word_median_ms 8255.4 ÷ 1,000"
            }
          ]
        }
      ]
    },
    {
      "heading": "Nemotron 30B-A3B, mixture · 532 tokens",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "4.03",
              "source": "/two-hours-on-battery/data/runs/cpu-server-m6.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 4.0308"
            }
          ]
        },
        {
          "label": "290HX Plus, 64 GB",
          "notes": "Laptop · DDR5-5600 · 4 of 24 threads (default)",
          "values": [
            {
              "value": "9.86",
              "source": "/two-hours-on-battery/data/runs/cpu-laptop-m6.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 9.8561"
            }
          ]
        },
        {
          "label": "i5-12600H, 32 GB",
          "notes": "Mini PC · DDR5-4800 · 4 of 16 threads (default)",
          "values": [
            {
              "value": "14.08",
              "source": "/two-hours-on-battery/data/runs/cpu-mini-m6.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 2 (rule 3 item 2) 14.0751"
            }
          ]
        }
      ]
    },
    {
      "heading": "llama3.3:70b, dense 70B · EPYC only",
      "rows": [
        {
          "label": "EPYC 7532, 128 GB",
          "notes": "Desktop · 8 ch DDR4-3200 · 32 threads (default)",
          "values": [
            {
              "value": "37.58",
              "source": "/two-hours-on-battery/data/runs/cpu-server-x2.json cold_load[] (ttft_ms − load_duration_ns ÷ 1e6) ÷ 1,000, median of 1 (rule 3 item 2) 37.5759"
            }
          ]
        }
      ]
    }
  ],
  "source": "The battery page's kit, runs/cpu-{server,laptop,mini}-m1…m6.json and cpu-server-x2.json, cold_load[] (ttft_ms minus load_duration_ns, its counting rule 3 item 2). Exhibit 105's kit, two-channel-desktop/summary.json arms[0..1].first_word_median_ms. This page's kit, fill-in/two-channel-desktop/summary.json, the three f1- arms' first_word_median_ms. Table T3."
}
