{
  "chart": "s2s-chart/1",
  "kind": "bars",
  "title": "Do more threads shorten the wait? Prompt reading and the first word at two thread settings",
  "subtitle": "Prompt tokens read a second, and seconds to the first word, at Ollama's default threads and one other setting (named in each heading); longer reads faster, shorter waits less.",
  "series": [
    "Default threads",
    "The other setting (in the heading)"
  ],
  "panels": [
    {
      "heading": "Laptop, 4 → 20 threads · prompt reading",
      "unit": "tok/s",
      "rows": [
        {
          "label": "gemma4:26b",
          "notes": "THROTTLED 3/3 at 4 thr · 1/3 at 20 thr",
          "values": [
            {
              "value": "61.8",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[0].prefill_median 61.789"
            },
            {
              "value": "152.1",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[2].prefill_median 152.057"
            }
          ]
        },
        {
          "label": "mistral-small3.2",
          "notes": "THROTTLED 3/3 at 4 thr · 3/3 at 20 thr",
          "values": [
            {
              "value": "12.3",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[1].prefill_median 12.281"
            },
            {
              "value": "36.7",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[3].prefill_median 36.693"
            }
          ]
        }
      ]
    },
    {
      "heading": "Ryzen 7 3700X, 8 → 4 threads · prompt reading",
      "unit": "tok/s",
      "rows": [
        {
          "label": "gemma4:26b",
          "notes": "THROTTLED 0/3 at 8 thr · 0/3 at 4 thr",
          "values": [
            {
              "value": "65.0",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[0].prefill_median 64.97"
            },
            {
              "value": "34.9",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[2].prefill_median 34.89"
            }
          ]
        },
        {
          "label": "mistral-small3.2",
          "notes": "THROTTLED 0/3 at 8 thr · 0/3 at 4 thr",
          "values": [
            {
              "value": "16.4",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[1].prefill_median 16.383"
            },
            {
              "value": "8.5",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[3].prefill_median 8.544"
            }
          ]
        }
      ]
    },
    {
      "heading": "Laptop, 4 → 20 threads · first word",
      "unit": "s",
      "rows": [
        {
          "label": "gemma4:26b",
          "notes": "THROTTLED 3/3 at 4 thr · 1/3 at 20 thr",
          "values": [
            {
              "value": "8.68",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[0].first_word_median_ms 8679.7 ÷ 1,000"
            },
            {
              "value": "3.54",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[2].first_word_median_ms 3536.1 ÷ 1,000"
            }
          ]
        },
        {
          "label": "mistral-small3.2",
          "notes": "THROTTLED 3/3 at 4 thr · 3/3 at 20 thr",
          "values": [
            {
              "value": "83.30",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[1].first_word_median_ms 83301.0 ÷ 1,000"
            },
            {
              "value": "27.89",
              "source": "/speeds-from-ram-alone/data/laptop/summary.json arms[3].first_word_median_ms 27885.7 ÷ 1,000"
            }
          ]
        }
      ]
    },
    {
      "heading": "Ryzen 7 3700X, 8 → 4 threads · first word",
      "unit": "s",
      "rows": [
        {
          "label": "gemma4:26b",
          "notes": "THROTTLED 0/3 at 8 thr · 0/3 at 4 thr",
          "values": [
            {
              "value": "8.26",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[0].first_word_median_ms 8255.4 ÷ 1,000"
            },
            {
              "value": "15.37",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[2].first_word_median_ms 15368.6 ÷ 1,000"
            }
          ]
        },
        {
          "label": "mistral-small3.2",
          "notes": "THROTTLED 0/3 at 8 thr · 0/3 at 4 thr",
          "values": [
            {
              "value": "62.45",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[1].first_word_median_ms 62446.1 ÷ 1,000"
            },
            {
              "value": "119.75",
              "source": "/speeds-from-ram-alone/data/two-channel-desktop/summary.json arms[3].first_word_median_ms 119747.6 ÷ 1,000"
            }
          ]
        }
      ]
    }
  ],
  "source": "Exhibit 105's kit: laptop/summary.json and two-channel-desktop/summary.json, arms[0..3].prefill_median and arms[0..3].first_word_median_ms (ms ÷ 1,000), fresh loads, three scored runs. Table T5."
}