ANNOUNCE  box benchbox · card 0 GPU-46890836-d8f (one RTX 3090, 250 W cap; card 1 stays dark) · arm 12 · kev.serve jaredpalmer/kev-9b bf16 served · start 2026-09-22T10:38:02Z · expect ~5 min to ready, then ~40 min of task arms

Fetching 9 files:   0%|          | 0/9 [00:00<?, ?it/s]
Fetching 9 files: 100%|██████████| 9/9 [00:00<00:00, 2149.46it/s]
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 1936.43it/s]

Loading weights:   0%|          | 0/427 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 427/427 [00:00<00:00, 8401.79it/s]
INFO:     Started server process [18436]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://127.0.0.1:8009 (Press CTRL+C to quit)
serving jaredpalmer/kev-9b (/workshop/.cache/huggingface/hub/models--jaredpalmer--kev-9b/snapshots/2629c06a5aeb0feb3b9783bafed17ed8f39ecf5c) on cuda :8009
INFO:     127.0.0.1:38418 - "GET /v1/models HTTP/1.1" 200 OK
[transformers] `causal_conv1d_fn` is falling back to its reference PyTorch implementation because `causal_conv1d` is not installed. This is correct but much slower; install `causal_conv1d` for the optimized kernel.
INFO:     127.0.0.1:38428 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:38438 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:38442 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38444 - "GET /v1/models HTTP/1.1" 200 OK
INFO:     127.0.0.1:38542 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:51112 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:51128 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:51140 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:51150 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:51164 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:51176 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:51180 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:51182 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:51196 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:51210 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:40958 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:40966 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:40976 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:40984 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:35678 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:35688 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:35702 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:35710 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:35720 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:53574 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:53588 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:53596 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:53606 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:53622 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:53624 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:53632 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:53634 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60964 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:60972 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:60978 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60994 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:32778 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:32792 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:32802 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:32806 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:32820 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:34402 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:34408 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:34412 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:34414 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:34420 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:34422 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:34436 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:34444 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:34454 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60096 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60110 - "POST /v1/systemone HTTP/1.1" 422 Unprocessable Entity
INFO:     127.0.0.1:60126 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60130 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60134 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60144 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:60158 - "POST /v1/systemone HTTP/1.1" 200 OK
INFO:     127.0.0.1:58780 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58788 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58802 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58808 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58822 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58824 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58832 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58838 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58840 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58848 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58862 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58878 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58890 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:58904 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39682 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39698 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39704 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39708 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39712 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39724 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39728 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39738 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39750 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39758 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39768 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39782 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39784 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:39796 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38278 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38288 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38298 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38314 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38328 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38332 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38334 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38344 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38350 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38354 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38366 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38368 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38382 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38398 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:38406 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49358 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49368 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49382 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49384 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49386 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49398 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49414 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49420 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49434 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49436 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49450 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49452 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49464 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49478 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:49480 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52422 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52430 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52442 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52446 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52450 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52452 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52460 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52470 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52484 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52492 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52500 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52510 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:52522 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44426 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44440 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44456 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44458 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44466 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44476 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44478 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44484 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44496 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44508 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44512 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44522 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44530 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:44532 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54862 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54878 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54882 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54896 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54906 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54922 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54926 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54942 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54954 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54960 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54968 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54976 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54978 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:54984 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45148 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45158 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45160 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45176 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45192 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45208 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45214 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45228 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     127.0.0.1:45232 - "POST /v1/systemone/permute HTTP/1.1" 200 OK
INFO:     Shutting down
INFO:     Waiting for application shutdown.
INFO:     Application shutdown complete.
INFO:     Finished server process [18436]