## The gate — arm 2

| gated task | arm 1's adapter readout (ollama, one card) | the floor (that − 2) | OpenJev-FP8 readout (vLLM, two cards) | delta (points) | verdict |
|---|---|---|---|---|---|
| (c) which of the six guests said this line? | 83.3 % (90 / 108) | **81.3 %** | 93.5 % (101 / 108) | +10.2 | **PASS** |

Verdict: **ACCEPTED**

## Coverage — what the 16,384-token ceiling refused

| task | items in the kit | reached | refused as overlong | scored against a label |
|---|---|---|---|---|
| (a) does the article answer this question? | 63 | 53 | 10 | 53 |
| (b) which section is the answer in? | 42 | 35 | 7 | 0 |
| (c) which of the six guests said this line? | 108 | 108 | 0 | 108 |

_A refused item is in the row file with its measured token count and out of every rate. It was never truncated: a truncated docent page can turn a genuinely on-page question into an unanswerable one, which is arm 1 §8's ruling and it stands._

## Accuracy

| task | arm | accuracy | correct / scored | Brier | unparsed | rows with a floored letter | letters floored |
|---|---|---|---|---|---|---|---|
| (a) does the article answer this question? | `openjev-fp8-readout` | 100.0 % | 53 / 53 | 0.0059 | 0 | 0 | 0 |
|  | `openjev-fp8-generate` | 100.0 % | 53 / 53 | 0.0001 | 0 | 0 | 0 |
| (b) which section is the answer in? | `openjev-fp8-readout` | **not a rate** — 1 of 35 reached rows carry a label | 0 / 1 | 0.5159 | 0 | 5 | 20 |
|  | `openjev-fp8-generate` | **not a rate** — 1 of 35 reached rows carry a label | 0 / 1 | 1.0000 | 0 | 0 | 0 |
| (c) which of the six guests said this line? | `openjev-fp8-readout` | 93.5 % | 101 / 108 | 0.1219 | 0 | 0 | 0 |
|  | `openjev-fp8-generate` | 93.5 % | 101 / 108 | 0.1296 | 0 | 0 | 0 |

## Latency and energy — BOTH boards, summed

| task | arm | median s | p95 s | prompt tokens | written tokens | card 0 mean W | card 1 mean W | both, J / decision | net of idle, J / decision | idle W (both) |
|---|---|---|---|---|---|---|---|---|---|---|
| (a) does the article answer this question? | `openjev-fp8-readout` | 6.458 | 14.200 | 373,760 | 53 | 241.9 | 245.4 | 3521.7 | 1836.1 | 233.2 |
|  | `openjev-fp8-generate` | 6.501 | 14.325 | 373,760 | 106 | 242.7 | 245.1 | 3553.5 | 1508.6 | 280.7 |
| (b) which section is the answer in? | `openjev-fp8-readout` | 7.643 | 14.553 | 261,452 | 35 | 241.8 | 244.9 | 3936.6 | 1526.5 | 298.0 |
|  | `openjev-fp8-generate` | 7.658 | 14.559 | 261,452 | 70 | 242.4 | 245.5 | 3959.6 | 1707.9 | 277.4 |
| (c) which of the six guests said this line? | `openjev-fp8-readout` | 0.350 | 0.417 | 31,303 | 108 | 244.2 | 245.5 | 167.9 | 72.6 | 277.9 |
|  | `openjev-fp8-generate` | 0.392 | 0.459 | 31,303 | 216 | 243.6 | 244.6 | 189.9 | 82.5 | 276.1 |

## Reading the letter against writing it, on the same model

| task | paired items | median readout s | median generate s | median delta | share | same choice |
|---|---|---|---|---|---|---|
| (a) does the article answer this question? | 53 | 6.458 | 6.501 | +0.031 s | 0.5 % | 53 / 53 |
| (b) which section is the answer in? | 35 | 7.643 | 7.658 | +0.021 s | 0.3 % | 35 / 35 |
| (c) which of the six guests said this line? | 108 | 0.350 | 0.392 | +0.041 s | 10.5 % | 108 / 108 |

## Latency ACROSS RUNTIMES — not a like-for-like comparison

_Arm 1 ran on **ollama, one card, a Q4\_K\_M GGUF of a 26B-A4B**; arm 2 runs on **vLLM 0.29.0, two cards tensor-parallel, an FP8 checkpoint of a different model family**. Arm 1's base was NOT served under vLLM (README §A2.3.4), so **the apples-to-apples latency comparison is not made**. These rows sit in one table because a reader needs the scale; they do not sit in one table because they are the same measurement._

| task | arm | server · cards | model | median s | p95 s | decisions it is a median of |
|---|---|---|---|---|---|---|
| (a) does the article answer this question? | `jev-readout` | ollama · 1 card | `hf.co/mradermacher/jevify-gemma4-26b-a4b-GGUF:Q4_K_M` | 3.527 | 12.182 | 63 |
|  | `base-readout` | ollama · 1 card | `gemma4:26b` | 3.746 | 12.943 | 63 |
|  | `jev-generate` | ollama · 1 card | `hf.co/mradermacher/jevify-gemma4-26b-a4b-GGUF:Q4_K_M` | 3.621 | 28.089 | 63 |
|  | `base-generate` | ollama · 1 card | `gemma4:26b` | 3.841 | 29.896 | 63 |
|  | `openjev-fp8-readout` | vLLM 0.29.0 · 2 cards | `openjev-fp8` | 6.458 | 14.200 | 53 |
|  | `openjev-fp8-generate` | vLLM 0.29.0 · 2 cards | `openjev-fp8` | 6.501 | 14.325 | 53 |
| (b) which section is the answer in? | `jev-readout` | ollama · 1 card | `hf.co/mradermacher/jevify-gemma4-26b-a4b-GGUF:Q4_K_M` | 3.766 | 12.210 | 42 |
|  | `base-readout` | ollama · 1 card | `gemma4:26b` | 4.010 | 12.969 | 42 |
|  | `jev-generate` | ollama · 1 card | `hf.co/mradermacher/jevify-gemma4-26b-a4b-GGUF:Q4_K_M` | 3.848 | 12.214 | 42 |
|  | `base-generate` | ollama · 1 card | `gemma4:26b` | 4.024 | 13.052 | 42 |
|  | `openjev-fp8-readout` | vLLM 0.29.0 · 2 cards | `openjev-fp8` | 7.643 | 14.553 | 35 |
|  | `openjev-fp8-generate` | vLLM 0.29.0 · 2 cards | `openjev-fp8` | 7.658 | 14.559 | 35 |
| (c) which of the six guests said this line? | `jev-readout` | ollama · 1 card | `hf.co/mradermacher/jevify-gemma4-26b-a4b-GGUF:Q4_K_M` | 1.017 | 1.093 | 108 |
|  | `base-readout` | ollama · 1 card | `gemma4:26b` | 1.025 | 1.116 | 108 |
|  | `jev-generate` | ollama · 1 card | `hf.co/mradermacher/jevify-gemma4-26b-a4b-GGUF:Q4_K_M` | 1.031 | 1.090 | 108 |
|  | `base-generate` | ollama · 1 card | `gemma4:26b` | 1.060 | 1.116 | 108 |
|  | `openjev-fp8-readout` | vLLM 0.29.0 · 2 cards | `openjev-fp8` | 0.350 | 0.417 | 108 |
|  | `openjev-fp8-generate` | vLLM 0.29.0 · 2 cards | `openjev-fp8` | 0.392 | 0.459 | 108 |

## Agreement with arm 1's arms

| task | pair | agree | of comparable | rate |
|---|---|---|---|---|
| (a) does the article answer this question? | `jev-readout` vs `openjev-fp8-readout` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `jev-readout` vs `openjev-fp8-generate` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `base-readout` vs `openjev-fp8-readout` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `base-readout` vs `openjev-fp8-generate` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `jev-generate` vs `openjev-fp8-readout` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `jev-generate` vs `openjev-fp8-generate` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `base-generate` vs `openjev-fp8-readout` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `base-generate` vs `openjev-fp8-generate` | 53 | 53 | 100.0 % |
| (a) does the article answer this question? | `openjev-fp8-readout` vs `openjev-fp8-generate` | 53 | 53 | 100.0 % |
| (b) which section is the answer in? | `jev-readout` vs `openjev-fp8-readout` | 20 | 35 | 57.1 % |
| (b) which section is the answer in? | `jev-readout` vs `openjev-fp8-generate` | 20 | 35 | 57.1 % |
| (b) which section is the answer in? | `base-readout` vs `openjev-fp8-readout` | 23 | 35 | 65.7 % |
| (b) which section is the answer in? | `base-readout` vs `openjev-fp8-generate` | 23 | 35 | 65.7 % |
| (b) which section is the answer in? | `jev-generate` vs `openjev-fp8-readout` | 20 | 35 | 57.1 % |
| (b) which section is the answer in? | `jev-generate` vs `openjev-fp8-generate` | 20 | 35 | 57.1 % |
| (b) which section is the answer in? | `base-generate` vs `openjev-fp8-readout` | 22 | 35 | 62.9 % |
| (b) which section is the answer in? | `base-generate` vs `openjev-fp8-generate` | 22 | 35 | 62.9 % |
| (b) which section is the answer in? | `openjev-fp8-readout` vs `openjev-fp8-generate` | 35 | 35 | 100.0 % |
| (c) which of the six guests said this line? | `jev-readout` vs `openjev-fp8-readout` | 91 | 108 | 84.3 % |
| (c) which of the six guests said this line? | `jev-readout` vs `openjev-fp8-generate` | 91 | 108 | 84.3 % |
| (c) which of the six guests said this line? | `base-readout` vs `openjev-fp8-readout` | 89 | 108 | 82.4 % |
| (c) which of the six guests said this line? | `base-readout` vs `openjev-fp8-generate` | 89 | 108 | 82.4 % |
| (c) which of the six guests said this line? | `jev-generate` vs `openjev-fp8-readout` | 91 | 108 | 84.3 % |
| (c) which of the six guests said this line? | `jev-generate` vs `openjev-fp8-generate` | 91 | 108 | 84.3 % |
| (c) which of the six guests said this line? | `base-generate` vs `openjev-fp8-readout` | 89 | 108 | 82.4 % |
| (c) which of the six guests said this line? | `base-generate` vs `openjev-fp8-generate` | 89 | 108 | 82.4 % |
| (c) which of the six guests said this line? | `openjev-fp8-readout` vs `openjev-fp8-generate` | 108 | 108 | 100.0 % |

## The PHB receipt — what the host bridge costs (README §A2.8)

| what one all-reduce carries | bytes on the wire | median | p95 | bus bandwidth |
|---|---|---|---|---|
| one decode step (1 token × 5,120 × bf16) | 10.0 KiB | 50.2 µs | 55.3 µs | 0.20 GB/s |
| a 4-token prefill chunk (4 tokens × 5,120 × bf16) | 40.0 KiB | 82.9 µs | 87.0 µs | 0.49 GB/s |
| a 16-token prefill chunk (16 tokens × 5,120 × bf16) | 160.0 KiB | 155.6 µs | 160.8 µs | 1.05 GB/s |
| a 64-token prefill chunk (64 tokens × 5,120 × bf16) | 640.0 KiB | 423.9 µs | 435.2 µs | 1.55 GB/s |
| a 256-token prefill chunk (256 tokens × 5,120 × bf16) | 2.5 MiB | 1.5 ms | 1.5 ms | 1.75 GB/s |
| a 1024-token prefill chunk (1024 tokens × 5,120 × bf16) | 10.0 MiB | 5.8 ms | 5.9 ms | 1.80 GB/s |
| a 4096-token prefill chunk (4096 tokens × 5,120 × bf16) | 40.0 MiB | 23.1 ms | 23.2 ms | 1.82 GB/s |
| a 8192-token prefill chunk (8192 tokens × 5,120 × bf16) | 80.0 MiB | 46.1 ms | 46.4 ms | 1.82 GB/s |
| a 16384-token prefill chunk (16384 tokens × 5,120 × bf16) | 160.0 MiB | 92.0 ms | 92.4 ms | 1.82 GB/s |

**The floor this link puts under one written token: 6.4 ms** — 128 all-reduces (2 per layer × 64 layers) at 50.2 µs each, before the model computes anything. torch 2.13.0+cu130, NCCL 2.29.7, measured 2026-09-21T18:22:15Z.

### Reliability — `openjev-fp8-readout`, task a

| bin | n | mean confidence | accuracy | gap |
|---|---|---|---|---|
| 0.8–0.9 | 4 | 0.884 | 100.0 % | -0.116 |
| 0.9–1.0 | 49 | 0.959 | 100.0 % | -0.041 |

### Reliability — `openjev-fp8-readout`, task c

| bin | n | mean confidence | accuracy | gap |
|---|---|---|---|---|
| 0.4–0.5 | 1 | 0.465 | 0.0 % | +0.465 |
| 0.5–0.6 | 1 | 0.501 | 0.0 % | +0.501 |
| 0.6–0.7 | 4 | 0.659 | 100.0 % | -0.341 |
| 0.7–0.8 | 5 | 0.741 | 100.0 % | -0.259 |
| 0.8–0.9 | 9 | 0.853 | 77.8 % | +0.075 |
| 0.9–1.0 | 88 | 0.987 | 96.6 % | +0.021 |

### Reliability — `openjev-fp8-generate`, task a

| bin | n | mean confidence | accuracy | gap |
|---|---|---|---|---|
| 0.9–1.0 | 53 | 0.994 | 100.0 % | -0.006 |

### Reliability — `openjev-fp8-generate`, task c

| bin | n | mean confidence | accuracy | gap |
|---|---|---|---|---|
| 0.9–1.0 | 108 | 1.000 | 93.5 % | +0.065 |

### Task (c) confusion — `openjev-fp8-readout`

| said by ↓ / read as → | `darwin` | `einstein` | `hypatia` | `ibn_sina` | `sagan` | `socrates` |
|---|---|---|---|---|---|---|
| `darwin` | **16** | 0 | 0 | 1 | 1 | 0 |
| `einstein` | 0 | **16** | 2 | 0 | 0 | 0 |
| `hypatia` | 0 | 0 | **17** | 0 | 0 | 1 |
| `ibn_sina` | 0 | 0 | 0 | **18** | 0 | 0 |
| `sagan` | 1 | 0 | 0 | 0 | **17** | 0 |
| `socrates` | 0 | 0 | 1 | 0 | 0 | **17** |

### Task (c) confusion — `openjev-fp8-generate`

| said by ↓ / read as → | `darwin` | `einstein` | `hypatia` | `ibn_sina` | `sagan` | `socrates` |
|---|---|---|---|---|---|---|
| `darwin` | **16** | 0 | 0 | 1 | 1 | 0 |
| `einstein` | 0 | **16** | 2 | 0 | 0 | 0 |
| `hypatia` | 0 | 0 | **17** | 0 | 0 | 1 |
| `ibn_sina` | 0 | 0 | 0 | **18** | 0 | 0 |
| `sagan` | 1 | 0 | 0 | 0 | **17** | 0 |
| `socrates` | 0 | 0 | 1 | 0 | 0 | **17** |

## Residency — both boards, per arm

| arm | task | card 0 MiB after | card 1 MiB after | both grew | no other board moved | ok |
|---|---|---|---|---|---|---|
| `openjev-fp8-readout` | a | 21246.0 | 21246.0 | True | True | True |
| `openjev-fp8-readout` | b | 21246.0 | 21246.0 | False | True | True |
| `openjev-fp8-readout` | c | 21246.0 | 21246.0 | False | True | True |
| `openjev-fp8-generate` | a | 21246.0 | 21246.0 | False | True | True |
| `openjev-fp8-generate` | b | 21246.0 | 21246.0 | False | True | True |
| `openjev-fp8-generate` | c | 21246.0 | 21246.0 | False | True | True |