[2026-09-22T10:38:02Z] KEV CHAIN 2 START [2026-09-22T10:38:02Z] === kev-9b — jaredpalmer/kev-9b, as served, tasks ka + kperm [2026-09-22T10:38:22Z] kev-9b server READY after 20s [2026-09-22T10:38:22Z] warming kev-9b (triton JIT) warmup done, discarded MODELS {"models":[{"id":"kev-latest","aliases":["jev-latest"],"run":"jaredpalmer/kev-9b","base":"Qwen/Qwen3.5-9B-Base","lora":16,"device":"cuda","temperature":2.2973967099940698,"prefix_cache":{"size":4,"min_state_tokens":384,"hits":0,"misses":0,"cached_states":0}}]} ANNOUNCE box benchbox · cards GPU-46890836-d8f · arm kev-9b · task ka · start 2026-09-22T10:38:23Z · expect ~20 min on-01 yes -> REFUSED: overlong — (None tokens) on-02 yes -> REFUSED: overlong — (None tokens) on-03 yes -> yes 0.95s on-04 yes -> yes 1.48s on-05 yes -> REFUSED: kev-422 — (None tokens) on-06 yes -> REFUSED: kev-422 — (None tokens) on-07 yes -> yes 1.69s on-08 yes -> yes 1.10s on-09 yes -> yes 1.92s on-10 yes -> REFUSED: kev-422 — (None tokens) on-11 yes -> REFUSED: kev-422 — (None tokens) on-12 yes -> yes 0.61s on-13 yes -> yes 9.19s on-14 yes -> REFUSED: overlong — (None tokens) on-15 yes -> yes 1.57s on-16 yes -> yes 1.40s on-17 yes -> REFUSED: kev-422 — (None tokens) on-18 yes -> yes 1.55s on-19 yes -> yes 1.78s on-20 yes -> yes 1.58s on-21 yes -> yes 1.58s on-22 yes -> yes 2.17s on-23 yes -> yes 2.49s on-24 yes -> yes 2.19s on-25 yes -> yes 1.58s on-26 yes -> yes 1.73s on-27 yes -> REFUSED: kev-422 — (None tokens) on-28 yes -> REFUSED: kev-422 — (None tokens) on-29 yes -> REFUSED: overlong — (None tokens) on-30 yes -> yes 1.49s on-31 yes -> yes 1.51s on-32 yes -> yes 1.79s on-33 yes -> REFUSED: overlong — (None tokens) on-34 yes -> REFUSED: overlong — (None tokens) on-35 yes -> REFUSED: kev-422 — (None tokens) on-36 yes -> REFUSED: kev-422 — (None tokens) on-37 yes -> yes 2.15s on-38 yes -> REFUSED: kev-422 — (None tokens) on-39 yes -> yes 2.50s on-40 yes -> REFUSED: overlong — (None tokens) on-41 yes -> REFUSED: kev-422 — (None tokens) on-42 yes -> yes 2.01s off-01 no -> no 2.14s off-02 no -> no 1.52s off-03 no -> REFUSED: kev-422 — (None tokens) off-04 no -> REFUSED: overlong — (None tokens) off-05 no -> REFUSED: kev-422 — (None tokens) off-06 no -> no 1.59s off-07 no -> no 1.42s off-08 no -> no 1.80s off-09 no -> no 1.56s off-10 no -> no 0.91s off-11 no -> REFUSED: kev-422 — (None tokens) off-12 no -> no 1.59s off-13 no -> no 1.60s off-14 no -> REFUSED: overlong — (None tokens) off-15 no -> REFUSED: kev-422 — (None tokens) off-16 no -> no 1.51s off-17 no -> no 0.62s off-18 no -> REFUSED: overlong — (None tokens) off-19 no -> no 2.22s off-20 no -> no 1.94s off-21 no -> no 2.16s {"n": 63, "n_reached": 38, "n_labelled": 38, "refused": 25, "refused_by_reason": {"overlong": 10, "kev-422": 15}, "correct": 38, "errors": 0, "brier": 0.010173684210526317, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": nul ANNOUNCE box benchbox · cards GPU-46890836-d8f · arm kev-9b · task kperm · start 2026-09-22T10:39:45Z · expect ~20 min c-darwin-01-dessert-01 darwin -> darwin 0.09s c-darwin-01-dessert-01 darwin -> darwin 0.13s c-darwin-01-dessert-01 darwin -> socrates 0.10s c-darwin-01-dessert-02 darwin -> darwin 0.14s c-darwin-01-dessert-03 darwin -> darwin 0.14s c-darwin-01-dessert-03 darwin -> darwin 0.14s c-darwin-01-main-01 darwin -> darwin 0.10s c-darwin-01-main-02 darwin -> socrates 0.10s c-darwin-01-main-02 darwin -> darwin 0.13s c-darwin-01-main-02 darwin -> darwin 0.14s c-darwin-01-main-02 darwin -> darwin 0.14s c-darwin-01-main-03 darwin -> darwin 0.14s c-darwin-01-starter-01 darwin -> darwin 0.07s c-darwin-01-starter-01 darwin -> darwin 0.08s c-darwin-01-starter-01 darwin -> sagan 0.10s c-darwin-01-starter-02 darwin -> darwin 0.09s c-darwin-01-starter-03 darwin -> darwin 0.14s c-darwin-01-starter-03 darwin -> darwin 0.13s c-einstein-01-dessert-01 einstein -> sagan 0.13s c-einstein-01-dessert-01 einstein -> sagan 0.13s c-einstein-01-dessert-02 einstein -> sagan 0.13s c-einstein-01-dessert-02 einstein -> einstein 0.10s c-einstein-01-dessert-03 einstein -> einstein 0.14s c-einstein-01-main-01 einstein -> einstein 0.10s c-einstein-01-main-01 einstein -> einstein 0.13s c-einstein-01-main-02 einstein -> einstein 0.13s c-einstein-01-main-03 einstein -> sagan 0.11s c-einstein-01-main-03 einstein -> einstein 0.11s c-einstein-01-main-03 einstein -> einstein 0.13s c-einstein-01-main-03 einstein -> einstein 0.14s c-einstein-01-starter-01 einstein -> einstein 0.10s c-einstein-01-starter-02 einstein -> einstein 0.08s c-einstein-01-starter-02 einstein -> sagan 0.10s c-einstein-01-starter-03 einstein -> einstein 0.14s c-einstein-01-starter-03 einstein -> einstein 0.11s c-einstein-01-starter-03 einstein -> einstein 0.09s c-hypatia-01-dessert-01 hypatia -> ibn_sina 0.14s c-hypatia-01-dessert-02 hypatia -> ibn_sina 0.10s c-hypatia-01-dessert-02 hypatia -> darwin 0.09s c-hypatia-01-dessert-03 hypatia -> sagan 0.10s c-hypatia-01-main-01 hypatia -> hypatia 0.13s c-hypatia-01-main-01 hypatia -> socrates 0.10s c-hypatia-01-main-01 hypatia -> ibn_sina 0.14s c-hypatia-01-main-01 hypatia -> sagan 0.11s c-hypatia-01-main-01 hypatia -> einstein 0.09s c-hypatia-01-main-02 hypatia -> ibn_sina 0.13s c-hypatia-01-main-03 hypatia -> einstein 0.13s c-hypatia-01-main-03 hypatia -> ibn_sina 0.11s c-hypatia-01-main-03 hypatia -> hypatia 0.14s c-hypatia-01-starter-01 hypatia -> socrates 0.09s c-hypatia-01-starter-01 hypatia -> ibn_sina 0.10s c-hypatia-01-starter-02 hypatia -> hypatia 0.10s c-hypatia-01-starter-02 hypatia -> hypatia 0.09s c-hypatia-01-starter-02 hypatia -> sagan 0.10s c-ibn_sina-01-dessert-01 ibn_sina -> hypatia 0.10s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.10s c-ibn_sina-01-dessert-02 ibn_sina -> socrates 0.11s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.11s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.13s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.14s c-ibn_sina-01-main-02 ibn_sina -> sagan 0.10s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.13s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.13s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.14s c-ibn_sina-01-main-03 ibn_sina -> socrates 0.13s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.14s c-ibn_sina-01-starter-01 ibn_sina -> hypatia 0.10s c-ibn_sina-01-starter-02 ibn_sina -> socrates 0.10s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.13s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.13s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.13s c-ibn_sina-01-starter-03 ibn_sina -> hypatia 0.13s c-sagan-01-dessert-01 sagan -> sagan 0.14s c-sagan-01-dessert-01 sagan -> sagan 0.10s c-sagan-01-dessert-01 sagan -> hypatia 0.10s c-sagan-01-dessert-03 sagan -> sagan 0.10s c-sagan-01-dessert-03 sagan -> sagan 0.14s c-sagan-01-dessert-03 sagan -> sagan 0.11s c-sagan-01-dessert-03 sagan -> sagan 0.13s c-sagan-01-dessert-03 sagan -> sagan 0.14s c-sagan-01-main-01 sagan -> sagan 0.11s c-sagan-01-main-02 sagan -> sagan 0.13s c-sagan-01-main-02 sagan -> einstein 0.10s c-sagan-01-main-03 sagan -> sagan 0.14s c-sagan-01-main-03 sagan -> sagan 0.14s c-sagan-01-starter-01 sagan -> sagan 0.10s c-sagan-01-starter-02 sagan -> sagan 0.14s c-sagan-01-starter-02 sagan -> sagan 0.10s c-sagan-01-starter-03 sagan -> darwin 0.10s c-sagan-01-starter-03 sagan -> einstein 0.13s c-socrates-01-dessert-01 socrates -> socrates 0.14s c-socrates-01-dessert-01 socrates -> socrates 0.10s c-socrates-01-dessert-01 socrates -> ibn_sina 0.13s c-socrates-01-dessert-02 socrates -> socrates 0.11s c-socrates-01-dessert-02 socrates -> socrates 0.13s c-socrates-01-dessert-02 socrates -> ibn_sina 0.10s c-socrates-01-main-01 socrates -> socrates 0.10s c-socrates-01-main-02 socrates -> socrates 0.14s c-socrates-01-main-02 socrates -> socrates 0.10s c-socrates-01-main-02 socrates -> socrates 0.13s c-socrates-01-main-02 socrates -> socrates 0.10s c-socrates-01-main-03 socrates -> sagan 0.11s c-socrates-01-main-03 socrates -> socrates 0.13s c-socrates-01-starter-01 socrates -> socrates 0.08s c-socrates-01-starter-02 socrates -> socrates 0.10s c-socrates-01-starter-03 socrates -> socrates 0.11s c-socrates-01-starter-03 socrates -> socrates 0.13s c-socrates-01-starter-03 socrates -> socrates 0.10s {"n": 108, "n_reached": 108, "n_labelled": 108, "refused": 0, "refused_by_reason": {}, "correct": 72, "errors": 0, "brier": 0.4802564814814815, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 1, "sum_p": 0.19, "correct": 1, "mean_p": 0.19, "accuracy": 1.0, "gap": -0.81}, {"lo": 0.2, "hi": 0.3, "n": 9, "sum_p": 2.2199999999999998, "correct": 4, "mean_p": 0.24666666666666665, "accuracy": 0.4444444444444444, "gap": -0.19777777777777777}, {"lo": 0.3, "hi": 0.4, "n": 5, "sum_p": 1.7699999999999996 [2026-09-22T10:41:11Z] kev-9b RC=0 [2026-09-22T10:41:11Z] stopping kev server pid 18430 GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 30.50 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 24.85 W [2026-09-22T10:41:21Z] === kev-4b — jaredpalmer/kev-4b, as served, tasks ka + kperm [2026-09-22T10:41:31Z] kev-4b server READY after 10s [2026-09-22T10:41:31Z] warming kev-4b (triton JIT) warmup done, discarded MODELS {"models":[{"id":"kev-latest","aliases":["jev-latest"],"run":"jaredpalmer/kev-4b","base":"Qwen/Qwen3.5-4B-Base","lora":16,"device":"cuda","temperature":2.1435469250725863,"prefix_cache":{"size":4,"min_state_tokens":384,"hits":0,"misses":0,"cached_states":0}}]} ANNOUNCE box benchbox · cards GPU-46890836-d8f · arm kev-4b · task ka · start 2026-09-22T10:41:32Z · expect ~20 min on-01 yes -> REFUSED: overlong — (None tokens) on-02 yes -> REFUSED: overlong — (None tokens) on-03 yes -> yes 0.64s on-04 yes -> yes 0.92s on-05 yes -> REFUSED: kev-422 — (None tokens) on-06 yes -> REFUSED: kev-422 — (None tokens) on-07 yes -> yes 1.09s on-08 yes -> yes 0.71s on-09 yes -> yes 1.22s on-10 yes -> REFUSED: kev-422 — (None tokens) on-11 yes -> REFUSED: kev-422 — (None tokens) on-12 yes -> yes 0.41s on-13 yes -> yes 1.36s on-14 yes -> REFUSED: overlong — (None tokens) on-15 yes -> yes 1.01s on-16 yes -> yes 0.88s on-17 yes -> REFUSED: kev-422 — (None tokens) on-18 yes -> yes 1.00s on-19 yes -> yes 1.15s on-20 yes -> yes 1.01s on-21 yes -> yes 1.01s on-22 yes -> yes 1.39s on-23 yes -> yes 1.59s on-24 yes -> yes 1.40s on-25 yes -> yes 1.01s on-26 yes -> yes 1.11s on-27 yes -> REFUSED: kev-422 — (None tokens) on-28 yes -> REFUSED: kev-422 — (None tokens) on-29 yes -> REFUSED: overlong — (None tokens) on-30 yes -> yes 0.93s on-31 yes -> yes 0.97s on-32 yes -> yes 1.15s on-33 yes -> REFUSED: overlong — (None tokens) on-34 yes -> REFUSED: overlong — (None tokens) on-35 yes -> REFUSED: kev-422 — (None tokens) on-36 yes -> REFUSED: kev-422 — (None tokens) on-37 yes -> yes 1.37s on-38 yes -> REFUSED: kev-422 — (None tokens) on-39 yes -> yes 1.59s on-40 yes -> REFUSED: overlong — (None tokens) on-41 yes -> REFUSED: kev-422 — (None tokens) on-42 yes -> yes 1.31s off-01 no -> no 1.36s off-02 no -> no 0.97s off-03 no -> REFUSED: kev-422 — (None tokens) off-04 no -> REFUSED: overlong — (None tokens) off-05 no -> REFUSED: kev-422 — (None tokens) off-06 no -> no 1.02s off-07 no -> no 0.89s off-08 no -> no 1.15s off-09 no -> no 1.00s off-10 no -> no 0.59s off-11 no -> REFUSED: kev-422 — (None tokens) off-12 no -> no 1.02s off-13 no -> no 1.02s off-14 no -> REFUSED: overlong — (None tokens) off-15 no -> REFUSED: kev-422 — (None tokens) off-16 no -> no 0.93s off-17 no -> no 0.41s off-18 no -> REFUSED: overlong — (None tokens) off-19 no -> no 1.41s off-20 no -> no 1.22s off-21 no -> no 1.37s {"n": 63, "n_reached": 38, "n_labelled": 38, "refused": 25, "refused_by_reason": {"overlong": 10, "kev-422": 15}, "correct": 38, "errors": 0, "brier": 0.013231578947368422, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": nul ANNOUNCE box benchbox · cards GPU-46890836-d8f · arm kev-4b · task kperm · start 2026-09-22T10:42:23Z · expect ~20 min c-darwin-01-dessert-01 darwin -> sagan 0.07s c-darwin-01-dessert-01 darwin -> darwin 0.08s c-darwin-01-dessert-01 darwin -> sagan 0.07s c-darwin-01-dessert-02 darwin -> sagan 0.08s c-darwin-01-dessert-03 darwin -> hypatia 0.08s c-darwin-01-dessert-03 darwin -> darwin 0.08s c-darwin-01-main-01 darwin -> sagan 0.07s c-darwin-01-main-02 darwin -> socrates 0.07s c-darwin-01-main-02 darwin -> darwin 0.08s c-darwin-01-main-02 darwin -> darwin 0.08s c-darwin-01-main-02 darwin -> darwin 0.08s c-darwin-01-main-03 darwin -> darwin 0.08s c-darwin-01-starter-01 darwin -> sagan 0.07s c-darwin-01-starter-01 darwin -> darwin 0.07s c-darwin-01-starter-01 darwin -> sagan 0.07s c-darwin-01-starter-02 darwin -> darwin 0.07s c-darwin-01-starter-03 darwin -> sagan 0.08s c-darwin-01-starter-03 darwin -> darwin 0.08s c-einstein-01-dessert-01 einstein -> sagan 0.08s c-einstein-01-dessert-01 einstein -> sagan 0.08s c-einstein-01-dessert-02 einstein -> sagan 0.08s c-einstein-01-dessert-02 einstein -> ibn_sina 0.07s c-einstein-01-dessert-03 einstein -> sagan 0.08s c-einstein-01-main-01 einstein -> sagan 0.07s c-einstein-01-main-01 einstein -> einstein 0.08s c-einstein-01-main-02 einstein -> sagan 0.08s c-einstein-01-main-03 einstein -> sagan 0.07s c-einstein-01-main-03 einstein -> einstein 0.07s c-einstein-01-main-03 einstein -> einstein 0.08s c-einstein-01-main-03 einstein -> einstein 0.08s c-einstein-01-starter-01 einstein -> einstein 0.07s c-einstein-01-starter-02 einstein -> einstein 0.07s c-einstein-01-starter-02 einstein -> sagan 0.07s c-einstein-01-starter-03 einstein -> sagan 0.08s c-einstein-01-starter-03 einstein -> einstein 0.07s c-einstein-01-starter-03 einstein -> einstein 0.07s c-hypatia-01-dessert-01 hypatia -> socrates 0.08s c-hypatia-01-dessert-02 hypatia -> sagan 0.07s c-hypatia-01-dessert-02 hypatia -> sagan 0.07s c-hypatia-01-dessert-03 hypatia -> einstein 0.07s c-hypatia-01-main-01 hypatia -> hypatia 0.08s c-hypatia-01-main-01 hypatia -> ibn_sina 0.07s c-hypatia-01-main-01 hypatia -> sagan 0.08s c-hypatia-01-main-01 hypatia -> socrates 0.07s c-hypatia-01-main-01 hypatia -> einstein 0.07s c-hypatia-01-main-02 hypatia -> sagan 0.08s c-hypatia-01-main-03 hypatia -> hypatia 0.08s c-hypatia-01-main-03 hypatia -> ibn_sina 0.07s c-hypatia-01-main-03 hypatia -> hypatia 0.08s c-hypatia-01-starter-01 hypatia -> hypatia 0.07s c-hypatia-01-starter-01 hypatia -> ibn_sina 0.07s c-hypatia-01-starter-02 hypatia -> hypatia 0.07s c-hypatia-01-starter-02 hypatia -> hypatia 0.07s c-hypatia-01-starter-02 hypatia -> sagan 0.07s c-ibn_sina-01-dessert-01 ibn_sina -> sagan 0.07s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.07s c-ibn_sina-01-dessert-02 ibn_sina -> sagan 0.07s c-ibn_sina-01-dessert-02 ibn_sina -> sagan 0.07s c-ibn_sina-01-dessert-03 ibn_sina -> sagan 0.08s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.08s c-ibn_sina-01-main-02 ibn_sina -> sagan 0.07s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.08s c-ibn_sina-01-main-02 ibn_sina -> sagan 0.08s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.08s c-ibn_sina-01-main-03 ibn_sina -> socrates 0.08s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.08s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.07s c-ibn_sina-01-starter-02 ibn_sina -> socrates 0.07s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.08s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.08s c-ibn_sina-01-starter-03 ibn_sina -> sagan 0.08s c-ibn_sina-01-starter-03 ibn_sina -> sagan 0.08s c-sagan-01-dessert-01 sagan -> sagan 0.08s c-sagan-01-dessert-01 sagan -> sagan 0.07s c-sagan-01-dessert-01 sagan -> sagan 0.07s c-sagan-01-dessert-03 sagan -> sagan 0.07s c-sagan-01-dessert-03 sagan -> sagan 0.08s c-sagan-01-dessert-03 sagan -> sagan 0.07s c-sagan-01-dessert-03 sagan -> sagan 0.08s c-sagan-01-dessert-03 sagan -> sagan 0.08s c-sagan-01-main-01 sagan -> einstein 0.07s c-sagan-01-main-02 sagan -> sagan 0.08s c-sagan-01-main-02 sagan -> hypatia 0.07s c-sagan-01-main-03 sagan -> sagan 0.08s c-sagan-01-main-03 sagan -> sagan 0.08s c-sagan-01-starter-01 sagan -> sagan 0.07s c-sagan-01-starter-02 sagan -> sagan 0.08s c-sagan-01-starter-02 sagan -> sagan 0.07s c-sagan-01-starter-03 sagan -> sagan 0.07s c-sagan-01-starter-03 sagan -> einstein 0.08s c-socrates-01-dessert-01 socrates -> socrates 0.08s c-socrates-01-dessert-01 socrates -> socrates 0.07s c-socrates-01-dessert-01 socrates -> sagan 0.08s c-socrates-01-dessert-02 socrates -> sagan 0.07s c-socrates-01-dessert-02 socrates -> socrates 0.08s c-socrates-01-dessert-02 socrates -> socrates 0.07s c-socrates-01-main-01 socrates -> socrates 0.07s c-socrates-01-main-02 socrates -> socrates 0.08s c-socrates-01-main-02 socrates -> socrates 0.07s c-socrates-01-main-02 socrates -> socrates 0.08s c-socrates-01-main-02 socrates -> socrates 0.07s c-socrates-01-main-03 socrates -> sagan 0.07s c-socrates-01-main-03 socrates -> ibn_sina 0.08s c-socrates-01-starter-01 socrates -> socrates 0.07s c-socrates-01-starter-02 socrates -> socrates 0.07s c-socrates-01-starter-03 socrates -> socrates 0.07s c-socrates-01-starter-03 socrates -> socrates 0.08s c-socrates-01-starter-03 socrates -> socrates 0.07s {"n": 108, "n_reached": 108, "n_labelled": 108, "refused": 0, "refused_by_reason": {}, "correct": 60, "errors": 0, "brier": 0.6182249999999999, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 6, "sum_p": 1.6, "correct": 1, "mean_p": 0.26666666666666666, "accuracy": 0.16666666666666666, "gap": 0.1}, {"lo": 0.3, "hi": 0.4, "n": 11, "sum_p": 3.9500000000000006, "correct": 4, "mean_p": 0.359 [2026-09-22T10:43:21Z] kev-4b RC=0 [2026-09-22T10:43:21Z] stopping kev server pid 19403 GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 30.56 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 24.73 W [2026-09-22T10:43:31Z] === both boards, free: GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 30.56 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 24.73 W [2026-09-22T10:43:31Z] KEV CHAIN 2 END