[2026-09-22T09:50:28Z] GAPS-CARD CHAIN START GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 16.82 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 12.36 W /dev/mapper/ubuntu--vg-ubuntu--lv 295G 274G 8.2G 98% / [2026-09-22T09:50:28Z] === gap 4 — arm 2's server verbatim, image:0 [2026-09-22T09:52:18Z] gap4 server READY after 110s {"object":"list","data":[{"id":"openjev-fp8","object":"model","created":1790070738,"owned_by":"vllm","root":"/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10","parent":null,"max_model_len":16384,"permission":[{"id":"modelperm-ab1379f967714b90","object":"model_permission","created":1790070738,"allow_create_engine":false,"allow_sampling":true,"allow_logprobs":true,"allow_search_indices":false,"allow_view":true,"allow_fine_tuning":false,"organization":"*","group":null,"is_blocking":false}]}]} (APIServer pid=5006) INFO 09-22 09:50:39 [api_utils.py:286] non-default args: {'model_tag': '/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', 'host': '127.0.0.1', 'model': '/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', 'trust_remote_code': True, 'max_model_len': 16384, 'quantization': 'fp8', 'max_logprobs': 64, 'served_model_name': ['openjev-fp8'], 'tensor_parallel_size': 2, 'gpu_memory_utilization': 0.9, 'enable_prefix_caching': True, 'limit_mm_per_prompt': {'image': 0}, 'max_num_seqs': 1, 'gdn_prefill_backend': 'triton'} (APIServer pid=5006) INFO 09-22 09:50:42 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']) (EngineCore pid=5155) INFO 09-22 09:50:56 [core.py:123] Initializing a V1 LLM engine (v0.29.0) with config: model='/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', speculative_config=None, tokenizer='/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=16384, download_dir=None, load_format=auto, tensor_parallel_size=2, pipeline_parallel_size=1, data_parallel_size=1, decode_context_parallel_size=1, dcp_comm_backend=ag_rs, disable_custom_all_reduce=False, quantization=fp8, quantization_config=None, enforce_eager=False, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, per_request_spec_decode_metrics='none', kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False, jit_monitor_mode='warn', jit_monitor_verbose=False), seed=0, served_model_name=openjev-fp8, enable_prefix_caching=True, enable_chunked_prefill=True, pooler_config=None, compilation_config={'mode': , 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['+quant_fp8', 'none', '+quant_fp8'], 'ir_enable_torch_wrap': True, 'splitting_ops': ['vllm::unified_attention_with_output', 'vllm::unified_mla_attention_with_output', 'vllm::mamba_mixer2', 'vllm::mamba_mixer', 'vllm::short_conv', 'vllm::qwen4_exp_compute_ple_ngram_ids', 'vllm::qwen4_exp_ple_short_conv', 'vllm::qwen4_exp_qsa_with_output', 'vllm::linear_attention', 'vllm::qwen_gdn_attention_core', 'vllm::qwen_gdn_attention_core_fused_norm_packed', 'vllm::gdn_attention_core_xpu', 'vllm::olmo_hybrid_gdn_full_forward', 'vllm::sparse_attn_indexer', 'vllm::rocm_aiter_sparse_attn_indexer', 'vllm::deepseek_v4_attention', 'vllm::hpc_rope_norm_forward', 'vllm::unified_kv_cache_update', 'vllm::unified_mla_kv_cache_update'], 'compile_mm_encoder': False, 'cudagraph_mm_encoder': False, 'encoder_cudagraph_token_budgets': [], 'encoder_cudagraph_max_vision_items_per_batch': 0, 'encoder_cudagraph_max_frames_per_batch': None, 'compile_sizes': [], 'compile_ranges_endpoints': [2048], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': , 'cudagraph_num_of_warmups': 1, 'cudagraph_capture_sizes': [1, 2], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': True, 'fuse_act_quant': True, 'fuse_attn_quant': False, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False, 'enable_qk_norm_rope_fusion': False, 'fuse_rope_kvcache_cat_mla': False, 'fuse_act_padding': False, 'fuse_qk_norm_rope_kvcache': False}, 'max_cudagraph_capture_size': 2, 'dynamic_shapes_config': {'type': , 'evaluate_guards': False, 'assume_32_bit_indexing': False}, 'local_cache_dir': None, 'fast_moe_cold_start': False, 'static_all_moe_layers': []}, kernel_config=KernelConfig(ir_op_priority=IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']), enable_flashinfer_autotune=True, enable_cutedsl_warmup=True, enable_jit_warmup=True, enable_bf16x3_router_gemm=False, moe_backend='auto', linear_backend='auto') (Worker_TP0 pid=5206) INFO 09-22 09:51:06 [__init__.py:695] Selected MarlinFP8ScaledMMLinearKernel for Fp8LinearMethod (Worker_TP0 pid=5206) INFO 09-22 09:51:06 [qwen_gdn_linear_attn.py:167] Using Triton/FLA GDN prefill kernel (requested=triton, head_k_dim=128). (Worker_TP0 pid=5206) INFO 09-22 09:51:06 [qwen_gdn_linear_attn.py:519] GDN decode kernel: cuda (Worker_TP0 pid=5206) WARNING 09-22 09:51:22 [marlin_utils_fp8.py:112] Your GPU does not have native support for FP8 computation but FP8 quantization is being used. Weight-only FP8 compression will be used leveraging the Marlin kernel. This may degrade performance for compute-heavy workloads. (Worker_TP0 pid=5206) INFO 09-22 09:51:44 [kernel_warmup.py:124] JIT kernel warmup starting. (Worker_TP1 pid=5207) INFO 09-22 09:51:44 [kernel_warmup.py:124] JIT kernel warmup starting. (Worker_TP0 pid=5206) INFO 09-22 09:51:44 [kernel_warmup.py:134] JIT kernel warmup finished in 0.00s. (Worker_TP1 pid=5207) INFO 09-22 09:51:44 [kernel_warmup.py:134] JIT kernel warmup finished in 0.00s. (Worker_TP0 pid=5206) INFO 09-22 09:51:44 [qwen_triton_warmup.py:270] Warming up Qwen Triton kernels for model_type=qwen3_5_text. (Worker_TP1 pid=5207) INFO 09-22 09:51:44 [qwen_triton_warmup.py:270] Warming up Qwen Triton kernels for model_type=qwen3_5_text. (Worker_TP0 pid=5206) INFO 09-22 09:51:46 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn. (Worker_TP1 pid=5207) INFO 09-22 09:51:46 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn. (EngineCore pid=5155) INFO 09-22 09:51:54 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']) [2026-09-22T09:52:18Z] === gap 4 task creorder — readout then the generating control ANNOUNCE box benchbox · cards GPU-46890836-d8f, GPU-7aa0be10-974 · arm openjev-fp8-readout · task creorder · start 2026-09-22T09:52:19Z · expect ~10 min c-darwin-01-dessert-01 darwin -> darwin 0.70s c-darwin-01-dessert-01 darwin -> darwin 0.39s c-darwin-01-dessert-01 darwin -> darwin 0.30s c-darwin-01-dessert-02 darwin -> darwin 0.41s c-darwin-01-dessert-03 darwin -> darwin 0.42s c-darwin-01-dessert-03 darwin -> darwin 0.42s c-darwin-01-main-01 darwin -> darwin 0.33s c-darwin-01-main-02 darwin -> ibn_sina 0.30s c-darwin-01-main-02 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.41s c-darwin-01-main-03 darwin -> darwin 0.41s c-darwin-01-starter-01 darwin -> sagan 0.23s c-darwin-01-starter-01 darwin -> darwin 0.27s c-darwin-01-starter-01 darwin -> darwin 0.30s c-darwin-01-starter-02 darwin -> darwin 0.28s c-darwin-01-starter-03 darwin -> darwin 0.41s c-darwin-01-starter-03 darwin -> darwin 0.40s c-einstein-01-dessert-01 einstein -> einstein 0.37s c-einstein-01-dessert-01 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> einstein 0.35s c-einstein-01-dessert-02 einstein -> hypatia 0.29s c-einstein-01-dessert-03 einstein -> einstein 0.42s c-einstein-01-main-01 einstein -> hypatia 0.30s c-einstein-01-main-01 einstein -> einstein 0.35s c-einstein-01-main-02 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.37s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-starter-01 einstein -> einstein 0.31s c-einstein-01-starter-02 einstein -> einstein 0.27s c-einstein-01-starter-02 einstein -> einstein 0.30s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.28s c-hypatia-01-dessert-01 hypatia -> hypatia 0.41s c-hypatia-01-dessert-02 hypatia -> hypatia 0.33s c-hypatia-01-dessert-02 hypatia -> hypatia 0.28s c-hypatia-01-dessert-03 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.37s c-hypatia-01-main-01 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.40s c-hypatia-01-main-01 hypatia -> hypatia 0.34s c-hypatia-01-main-01 hypatia -> hypatia 0.28s c-hypatia-01-main-02 hypatia -> hypatia 0.36s c-hypatia-01-main-03 hypatia -> hypatia 0.37s c-hypatia-01-main-03 hypatia -> hypatia 0.34s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-starter-01 hypatia -> hypatia 0.28s c-hypatia-01-starter-01 hypatia -> socrates 0.34s c-hypatia-01-starter-02 hypatia -> hypatia 0.31s c-hypatia-01-starter-02 hypatia -> hypatia 0.28s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.30s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.35s c-sagan-01-dessert-01 sagan -> sagan 0.42s c-sagan-01-dessert-01 sagan -> sagan 0.32s c-sagan-01-dessert-01 sagan -> sagan 0.29s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.42s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.37s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-main-01 sagan -> sagan 0.34s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-02 sagan -> sagan 0.33s c-sagan-01-main-03 sagan -> sagan 0.41s c-sagan-01-main-03 sagan -> sagan 0.41s c-sagan-01-starter-01 sagan -> sagan 0.28s c-sagan-01-starter-02 sagan -> sagan 0.42s c-sagan-01-starter-02 sagan -> sagan 0.30s c-sagan-01-starter-03 sagan -> darwin 0.31s c-sagan-01-starter-03 sagan -> sagan 0.36s c-socrates-01-dessert-01 socrates -> socrates 0.42s c-socrates-01-dessert-01 socrates -> socrates 0.29s c-socrates-01-dessert-01 socrates -> socrates 0.37s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-dessert-02 socrates -> socrates 0.39s c-socrates-01-dessert-02 socrates -> socrates 0.30s c-socrates-01-main-01 socrates -> socrates 0.33s c-socrates-01-main-02 socrates -> socrates 0.41s c-socrates-01-main-02 socrates -> socrates 0.30s c-socrates-01-main-02 socrates -> socrates 0.37s c-socrates-01-main-02 socrates -> socrates 0.30s c-socrates-01-main-03 socrates -> hypatia 0.35s c-socrates-01-main-03 socrates -> socrates 0.40s c-socrates-01-starter-01 socrates -> socrates 0.27s c-socrates-01-starter-02 socrates -> socrates 0.33s c-socrates-01-starter-03 socrates -> socrates 0.34s c-socrates-01-starter-03 socrates -> socrates 0.36s c-socrates-01-starter-03 socrates -> socrates 0.34s c-darwin-01-dessert-01 darwin -> darwin 0.28s c-darwin-01-dessert-01 darwin -> darwin 0.39s c-darwin-01-dessert-01 darwin -> darwin 0.30s c-darwin-01-dessert-02 darwin -> darwin 0.41s c-darwin-01-dessert-03 darwin -> darwin 0.42s c-darwin-01-dessert-03 darwin -> darwin 0.42s c-darwin-01-main-01 darwin -> darwin 0.33s c-darwin-01-main-02 darwin -> ibn_sina 0.30s c-darwin-01-main-02 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.41s c-darwin-01-main-03 darwin -> darwin 0.41s c-darwin-01-starter-01 darwin -> sagan 0.23s c-darwin-01-starter-01 darwin -> darwin 0.27s c-darwin-01-starter-01 darwin -> darwin 0.30s c-darwin-01-starter-02 darwin -> darwin 0.27s c-darwin-01-starter-03 darwin -> darwin 0.41s c-darwin-01-starter-03 darwin -> darwin 0.40s c-einstein-01-dessert-01 einstein -> einstein 0.37s c-einstein-01-dessert-01 einstein -> einstein 0.39s c-einstein-01-dessert-02 einstein -> einstein 0.35s c-einstein-01-dessert-02 einstein -> hypatia 0.29s c-einstein-01-dessert-03 einstein -> einstein 0.42s c-einstein-01-main-01 einstein -> hypatia 0.30s c-einstein-01-main-01 einstein -> einstein 0.35s c-einstein-01-main-02 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.34s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.37s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-starter-01 einstein -> einstein 0.31s c-einstein-01-starter-02 einstein -> einstein 0.27s c-einstein-01-starter-02 einstein -> einstein 0.30s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.28s c-hypatia-01-dessert-01 hypatia -> hypatia 0.41s c-hypatia-01-dessert-02 hypatia -> hypatia 0.33s c-hypatia-01-dessert-02 hypatia -> hypatia 0.28s c-hypatia-01-dessert-03 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.38s c-hypatia-01-main-01 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.40s c-hypatia-01-main-01 hypatia -> hypatia 0.34s c-hypatia-01-main-01 hypatia -> hypatia 0.28s c-hypatia-01-main-02 hypatia -> hypatia 0.36s c-hypatia-01-main-03 hypatia -> hypatia 0.37s c-hypatia-01-main-03 hypatia -> hypatia 0.34s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-starter-01 hypatia -> socrates 0.28s c-hypatia-01-starter-01 hypatia -> socrates 0.34s c-hypatia-01-starter-02 hypatia -> hypatia 0.31s c-hypatia-01-starter-02 hypatia -> hypatia 0.28s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.30s c-ibn_sina-01-starter-02 ibn_sina -> socrates 0.32s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.35s c-sagan-01-dessert-01 sagan -> sagan 0.42s c-sagan-01-dessert-01 sagan -> sagan 0.32s c-sagan-01-dessert-01 sagan -> sagan 0.29s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.42s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.37s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-main-01 sagan -> sagan 0.34s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-02 sagan -> sagan 0.33s c-sagan-01-main-03 sagan -> sagan 0.41s c-sagan-01-main-03 sagan -> sagan 0.41s c-sagan-01-starter-01 sagan -> sagan 0.29s c-sagan-01-starter-02 sagan -> sagan 0.42s c-sagan-01-starter-02 sagan -> sagan 0.30s c-sagan-01-starter-03 sagan -> darwin 0.31s c-sagan-01-starter-03 sagan -> sagan 0.36s c-socrates-01-dessert-01 socrates -> socrates 0.42s c-socrates-01-dessert-01 socrates -> socrates 0.29s c-socrates-01-dessert-01 socrates -> socrates 0.37s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-dessert-02 socrates -> socrates 0.39s c-socrates-01-dessert-02 socrates -> hypatia 0.31s c-socrates-01-main-01 socrates -> socrates 0.33s c-socrates-01-main-02 socrates -> socrates 0.41s c-socrates-01-main-02 socrates -> socrates 0.30s c-socrates-01-main-02 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.30s c-socrates-01-main-03 socrates -> hypatia 0.35s c-socrates-01-main-03 socrates -> ibn_sina 0.40s c-socrates-01-starter-01 socrates -> socrates 0.27s c-socrates-01-starter-02 socrates -> socrates 0.33s c-socrates-01-starter-03 socrates -> socrates 0.34s c-socrates-01-starter-03 socrates -> socrates 0.36s c-socrates-01-starter-03 socrates -> socrates 0.34s c-darwin-01-dessert-01 darwin -> darwin 0.28s c-darwin-01-dessert-01 darwin -> darwin 0.39s c-darwin-01-dessert-01 darwin -> darwin 0.30s c-darwin-01-dessert-02 darwin -> darwin 0.41s c-darwin-01-dessert-03 darwin -> darwin 0.42s c-darwin-01-dessert-03 darwin -> darwin 0.42s c-darwin-01-main-01 darwin -> darwin 0.33s c-darwin-01-main-02 darwin -> ibn_sina 0.30s c-darwin-01-main-02 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.41s c-darwin-01-main-03 darwin -> darwin 0.42s c-darwin-01-starter-01 darwin -> sagan 0.23s c-darwin-01-starter-01 darwin -> darwin 0.27s c-darwin-01-starter-01 darwin -> einstein 0.30s c-darwin-01-starter-02 darwin -> darwin 0.28s c-darwin-01-starter-03 darwin -> darwin 0.41s c-darwin-01-starter-03 darwin -> darwin 0.40s c-einstein-01-dessert-01 einstein -> einstein 0.37s c-einstein-01-dessert-01 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> einstein 0.36s c-einstein-01-dessert-02 einstein -> hypatia 0.29s c-einstein-01-dessert-03 einstein -> einstein 0.42s c-einstein-01-main-01 einstein -> hypatia 0.30s c-einstein-01-main-01 einstein -> einstein 0.35s c-einstein-01-main-02 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.37s c-einstein-01-main-03 einstein -> einstein 0.42s c-einstein-01-starter-01 einstein -> einstein 0.31s c-einstein-01-starter-02 einstein -> einstein 0.27s c-einstein-01-starter-02 einstein -> einstein 0.30s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.28s c-hypatia-01-dessert-01 hypatia -> hypatia 0.41s c-hypatia-01-dessert-02 hypatia -> hypatia 0.33s c-hypatia-01-dessert-02 hypatia -> hypatia 0.28s c-hypatia-01-dessert-03 hypatia -> ibn_sina 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.38s c-hypatia-01-main-01 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.40s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.28s c-hypatia-01-main-02 hypatia -> hypatia 0.36s c-hypatia-01-main-03 hypatia -> hypatia 0.37s c-hypatia-01-main-03 hypatia -> hypatia 0.34s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-starter-01 hypatia -> hypatia 0.28s c-hypatia-01-starter-01 hypatia -> socrates 0.34s c-hypatia-01-starter-02 hypatia -> hypatia 0.31s c-hypatia-01-starter-02 hypatia -> hypatia 0.28s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.30s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-sagan-01-dessert-01 sagan -> sagan 0.42s c-sagan-01-dessert-01 sagan -> sagan 0.32s c-sagan-01-dessert-01 sagan -> sagan 0.29s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.43s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.37s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-main-01 sagan -> sagan 0.34s c-sagan-01-main-02 sagan -> sagan 0.38s c-sagan-01-main-02 sagan -> einstein 0.33s c-sagan-01-main-03 sagan -> sagan 0.41s c-sagan-01-main-03 sagan -> sagan 0.41s c-sagan-01-starter-01 sagan -> sagan 0.29s c-sagan-01-starter-02 sagan -> sagan 0.42s c-sagan-01-starter-02 sagan -> sagan 0.30s c-sagan-01-starter-03 sagan -> darwin 0.31s c-sagan-01-starter-03 sagan -> sagan 0.36s c-socrates-01-dessert-01 socrates -> socrates 0.43s c-socrates-01-dessert-01 socrates -> socrates 0.30s c-socrates-01-dessert-01 socrates -> socrates 0.37s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.31s c-socrates-01-main-01 socrates -> socrates 0.34s c-socrates-01-main-02 socrates -> socrates 0.41s c-socrates-01-main-02 socrates -> socrates 0.30s c-socrates-01-main-02 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.31s c-socrates-01-main-03 socrates -> hypatia 0.35s c-socrates-01-main-03 socrates -> ibn_sina 0.40s c-socrates-01-starter-01 socrates -> socrates 0.27s c-socrates-01-starter-02 socrates -> socrates 0.33s c-socrates-01-starter-03 socrates -> socrates 0.34s c-socrates-01-starter-03 socrates -> socrates 0.36s c-socrates-01-starter-03 socrates -> socrates 0.34s c-darwin-01-dessert-01 darwin -> darwin 0.29s c-darwin-01-dessert-01 darwin -> darwin 0.40s c-darwin-01-dessert-01 darwin -> darwin 0.30s c-darwin-01-dessert-02 darwin -> darwin 0.42s c-darwin-01-dessert-03 darwin -> darwin 0.43s c-darwin-01-dessert-03 darwin -> darwin 0.43s c-darwin-01-main-01 darwin -> darwin 0.33s c-darwin-01-main-02 darwin -> ibn_sina 0.30s c-darwin-01-main-02 darwin -> darwin 0.38s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-03 darwin -> darwin 0.42s c-darwin-01-starter-01 darwin -> sagan 0.24s c-darwin-01-starter-01 darwin -> darwin 0.28s c-darwin-01-starter-01 darwin -> darwin 0.30s c-darwin-01-starter-02 darwin -> darwin 0.28s c-darwin-01-starter-03 darwin -> darwin 0.41s c-darwin-01-starter-03 darwin -> darwin 0.40s c-einstein-01-dessert-01 einstein -> einstein 0.38s c-einstein-01-dessert-01 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> einstein 0.36s c-einstein-01-dessert-02 einstein -> hypatia 0.29s c-einstein-01-dessert-03 einstein -> einstein 0.42s c-einstein-01-main-01 einstein -> hypatia 0.31s c-einstein-01-main-01 einstein -> einstein 0.36s c-einstein-01-main-02 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.37s c-einstein-01-main-03 einstein -> einstein 0.42s c-einstein-01-starter-01 einstein -> einstein 0.31s c-einstein-01-starter-02 einstein -> einstein 0.27s c-einstein-01-starter-02 einstein -> einstein 0.30s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.28s c-hypatia-01-dessert-01 hypatia -> hypatia 0.41s c-hypatia-01-dessert-02 hypatia -> ibn_sina 0.33s c-hypatia-01-dessert-02 hypatia -> hypatia 0.28s c-hypatia-01-dessert-03 hypatia -> hypatia 0.31s c-hypatia-01-main-01 hypatia -> hypatia 0.38s c-hypatia-01-main-01 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.40s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.28s c-hypatia-01-main-02 hypatia -> hypatia 0.36s c-hypatia-01-main-03 hypatia -> hypatia 0.37s c-hypatia-01-main-03 hypatia -> hypatia 0.34s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-starter-01 hypatia -> ibn_sina 0.28s c-hypatia-01-starter-01 hypatia -> socrates 0.34s c-hypatia-01-starter-02 hypatia -> hypatia 0.31s c-hypatia-01-starter-02 hypatia -> hypatia 0.28s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.30s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-sagan-01-dessert-01 sagan -> sagan 0.42s c-sagan-01-dessert-01 sagan -> sagan 0.32s c-sagan-01-dessert-01 sagan -> sagan 0.29s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.43s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.37s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-main-01 sagan -> sagan 0.34s c-sagan-01-main-02 sagan -> sagan 0.38s c-sagan-01-main-02 sagan -> sagan 0.33s c-sagan-01-main-03 sagan -> sagan 0.42s c-sagan-01-main-03 sagan -> sagan 0.42s c-sagan-01-starter-01 sagan -> sagan 0.29s c-sagan-01-starter-02 sagan -> sagan 0.42s c-sagan-01-starter-02 sagan -> sagan 0.30s c-sagan-01-starter-03 sagan -> darwin 0.31s c-sagan-01-starter-03 sagan -> sagan 0.36s c-socrates-01-dessert-01 socrates -> socrates 0.43s c-socrates-01-dessert-01 socrates -> socrates 0.30s c-socrates-01-dessert-01 socrates -> socrates 0.37s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.31s c-socrates-01-main-01 socrates -> socrates 0.34s c-socrates-01-main-02 socrates -> socrates 0.41s c-socrates-01-main-02 socrates -> ibn_sina 0.30s c-socrates-01-main-02 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.31s c-socrates-01-main-03 socrates -> hypatia 0.35s c-socrates-01-main-03 socrates -> socrates 0.40s c-socrates-01-starter-01 socrates -> socrates 0.27s c-socrates-01-starter-02 socrates -> socrates 0.33s c-socrates-01-starter-03 socrates -> socrates 0.35s c-socrates-01-starter-03 socrates -> socrates 0.36s c-socrates-01-starter-03 socrates -> socrates 0.34s c-darwin-01-dessert-01 darwin -> darwin 0.29s c-darwin-01-dessert-01 darwin -> darwin 0.40s c-darwin-01-dessert-01 darwin -> darwin 0.30s c-darwin-01-dessert-02 darwin -> darwin 0.42s c-darwin-01-dessert-03 darwin -> darwin 0.43s c-darwin-01-dessert-03 darwin -> darwin 0.43s c-darwin-01-main-01 darwin -> darwin 0.33s c-darwin-01-main-02 darwin -> darwin 0.30s c-darwin-01-main-02 darwin -> darwin 0.38s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-03 darwin -> darwin 0.42s c-darwin-01-starter-01 darwin -> sagan 0.24s c-darwin-01-starter-01 darwin -> darwin 0.28s c-darwin-01-starter-01 darwin -> darwin 0.30s c-darwin-01-starter-02 darwin -> darwin 0.28s c-darwin-01-starter-03 darwin -> darwin 0.41s c-darwin-01-starter-03 darwin -> darwin 0.40s c-einstein-01-dessert-01 einstein -> einstein 0.38s c-einstein-01-dessert-01 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> einstein 0.36s c-einstein-01-dessert-02 einstein -> hypatia 0.29s c-einstein-01-dessert-03 einstein -> einstein 0.42s c-einstein-01-main-01 einstein -> hypatia 0.31s c-einstein-01-main-01 einstein -> einstein 0.36s c-einstein-01-main-02 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.37s c-einstein-01-main-03 einstein -> einstein 0.42s c-einstein-01-starter-01 einstein -> einstein 0.31s c-einstein-01-starter-02 einstein -> einstein 0.27s c-einstein-01-starter-02 einstein -> einstein 0.30s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.28s c-hypatia-01-dessert-01 hypatia -> hypatia 0.41s c-hypatia-01-dessert-02 hypatia -> ibn_sina 0.33s c-hypatia-01-dessert-02 hypatia -> hypatia 0.28s c-hypatia-01-dessert-03 hypatia -> hypatia 0.31s c-hypatia-01-main-01 hypatia -> hypatia 0.38s c-hypatia-01-main-01 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.40s c-hypatia-01-main-01 hypatia -> ibn_sina 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.28s c-hypatia-01-main-02 hypatia -> hypatia 0.36s c-hypatia-01-main-03 hypatia -> hypatia 0.37s c-hypatia-01-main-03 hypatia -> hypatia 0.34s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-starter-01 hypatia -> hypatia 0.28s c-hypatia-01-starter-01 hypatia -> socrates 0.34s c-hypatia-01-starter-02 hypatia -> hypatia 0.31s c-hypatia-01-starter-02 hypatia -> hypatia 0.28s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.30s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-sagan-01-dessert-01 sagan -> sagan 0.42s c-sagan-01-dessert-01 sagan -> sagan 0.32s c-sagan-01-dessert-01 sagan -> sagan 0.29s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.43s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.37s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-main-01 sagan -> sagan 0.34s c-sagan-01-main-02 sagan -> sagan 0.38s c-sagan-01-main-02 sagan -> sagan 0.33s c-sagan-01-main-03 sagan -> sagan 0.42s c-sagan-01-main-03 sagan -> sagan 0.42s c-sagan-01-starter-01 sagan -> sagan 0.29s c-sagan-01-starter-02 sagan -> sagan 0.42s c-sagan-01-starter-02 sagan -> sagan 0.30s c-sagan-01-starter-03 sagan -> darwin 0.31s c-sagan-01-starter-03 sagan -> einstein 0.36s c-socrates-01-dessert-01 socrates -> socrates 0.43s c-socrates-01-dessert-01 socrates -> socrates 0.30s c-socrates-01-dessert-01 socrates -> socrates 0.37s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.31s c-socrates-01-main-01 socrates -> socrates 0.34s c-socrates-01-main-02 socrates -> socrates 0.41s c-socrates-01-main-02 socrates -> socrates 0.31s c-socrates-01-main-02 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.31s c-socrates-01-main-03 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> ibn_sina 0.40s c-socrates-01-starter-01 socrates -> socrates 0.27s c-socrates-01-starter-02 socrates -> socrates 0.33s c-socrates-01-starter-03 socrates -> socrates 0.35s c-socrates-01-starter-03 socrates -> socrates 0.36s c-socrates-01-starter-03 socrates -> socrates 0.34s c-darwin-01-dessert-01 darwin -> darwin 0.29s c-darwin-01-dessert-01 darwin -> darwin 0.40s c-darwin-01-dessert-01 darwin -> darwin 0.30s c-darwin-01-dessert-02 darwin -> darwin 0.42s c-darwin-01-dessert-03 darwin -> darwin 0.43s c-darwin-01-dessert-03 darwin -> darwin 0.43s c-darwin-01-main-01 darwin -> darwin 0.33s c-darwin-01-main-02 darwin -> ibn_sina 0.31s c-darwin-01-main-02 darwin -> darwin 0.38s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-03 darwin -> darwin 0.42s c-darwin-01-starter-01 darwin -> ibn_sina 0.24s c-darwin-01-starter-01 darwin -> darwin 0.28s c-darwin-01-starter-01 darwin -> darwin 0.30s c-darwin-01-starter-02 darwin -> darwin 0.28s c-darwin-01-starter-03 darwin -> darwin 0.41s c-darwin-01-starter-03 darwin -> darwin 0.40s c-einstein-01-dessert-01 einstein -> einstein 0.38s c-einstein-01-dessert-01 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> einstein 0.36s c-einstein-01-dessert-02 einstein -> einstein 0.29s c-einstein-01-dessert-03 einstein -> einstein 0.42s c-einstein-01-main-01 einstein -> hypatia 0.31s c-einstein-01-main-01 einstein -> einstein 0.36s c-einstein-01-main-02 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.35s c-einstein-01-main-03 einstein -> einstein 0.37s c-einstein-01-main-03 einstein -> einstein 0.42s c-einstein-01-starter-01 einstein -> einstein 0.31s c-einstein-01-starter-02 einstein -> einstein 0.28s c-einstein-01-starter-02 einstein -> einstein 0.30s c-einstein-01-starter-03 einstein -> einstein 0.41s c-einstein-01-starter-03 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.29s c-hypatia-01-dessert-01 hypatia -> hypatia 0.41s c-hypatia-01-dessert-02 hypatia -> hypatia 0.33s c-hypatia-01-dessert-02 hypatia -> hypatia 0.28s c-hypatia-01-dessert-03 hypatia -> hypatia 0.31s c-hypatia-01-main-01 hypatia -> hypatia 0.38s c-hypatia-01-main-01 hypatia -> hypatia 0.30s c-hypatia-01-main-01 hypatia -> hypatia 0.40s c-hypatia-01-main-01 hypatia -> ibn_sina 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.28s c-hypatia-01-main-02 hypatia -> hypatia 0.36s c-hypatia-01-main-03 hypatia -> hypatia 0.37s c-hypatia-01-main-03 hypatia -> hypatia 0.34s c-hypatia-01-main-03 hypatia -> hypatia 0.43s c-hypatia-01-starter-01 hypatia -> hypatia 0.28s c-hypatia-01-starter-01 hypatia -> socrates 0.34s c-hypatia-01-starter-02 hypatia -> hypatia 0.31s c-hypatia-01-starter-02 hypatia -> hypatia 0.28s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.32s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.34s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.33s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.30s c-ibn_sina-01-starter-02 ibn_sina -> socrates 0.32s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.36s c-sagan-01-dessert-01 sagan -> sagan 0.42s c-sagan-01-dessert-01 sagan -> sagan 0.32s c-sagan-01-dessert-01 sagan -> sagan 0.29s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.43s c-sagan-01-dessert-03 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.37s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-main-01 sagan -> sagan 0.34s c-sagan-01-main-02 sagan -> sagan 0.38s c-sagan-01-main-02 sagan -> sagan 0.33s c-sagan-01-main-03 sagan -> sagan 0.42s c-sagan-01-main-03 sagan -> sagan 0.42s c-sagan-01-starter-01 sagan -> sagan 0.29s c-sagan-01-starter-02 sagan -> sagan 0.42s c-sagan-01-starter-02 sagan -> sagan 0.30s c-sagan-01-starter-03 sagan -> darwin 0.31s c-sagan-01-starter-03 sagan -> sagan 0.36s c-socrates-01-dessert-01 socrates -> socrates 0.43s c-socrates-01-dessert-01 socrates -> socrates 0.30s c-socrates-01-dessert-01 socrates -> socrates 0.37s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.31s c-socrates-01-main-01 socrates -> socrates 0.34s c-socrates-01-main-02 socrates -> socrates 0.41s c-socrates-01-main-02 socrates -> socrates 0.31s c-socrates-01-main-02 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.31s c-socrates-01-main-03 socrates -> hypatia 0.35s c-socrates-01-main-03 socrates -> socrates 0.40s c-socrates-01-starter-01 socrates -> socrates 0.28s c-socrates-01-starter-02 socrates -> socrates 0.33s c-socrates-01-starter-03 socrates -> socrates 0.35s c-socrates-01-starter-03 socrates -> socrates 0.36s c-socrates-01-starter-03 socrates -> socrates 0.34s {"n": 648, "n_reached": 648, "n_labelled": 648, "refused": 0, "refused_by_reason": {}, "correct": 592, "errors": 0, "brier": 0.1390518086426339, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.4, ANNOUNCE box benchbox · cards GPU-46890836-d8f, GPU-7aa0be10-974 · arm openjev-fp8-generate · task creorder · start 2026-09-22T09:56:18Z · expect ~10 min c-darwin-01-dessert-01 darwin -> darwin 0.31s c-darwin-01-dessert-01 darwin -> darwin 0.44s c-darwin-01-dessert-01 darwin -> darwin 0.35s c-darwin-01-dessert-02 darwin -> darwin 0.46s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-main-01 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> ibn_sina 0.35s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.47s c-darwin-01-main-02 darwin -> darwin 0.46s c-darwin-01-main-03 darwin -> darwin 0.46s c-darwin-01-starter-01 darwin -> sagan 0.28s c-darwin-01-starter-01 darwin -> darwin 0.32s c-darwin-01-starter-01 darwin -> darwin 0.34s c-darwin-01-starter-02 darwin -> darwin 0.32s c-darwin-01-starter-03 darwin -> darwin 0.46s c-darwin-01-starter-03 darwin -> darwin 0.44s c-einstein-01-dessert-01 einstein -> einstein 0.42s c-einstein-01-dessert-01 einstein -> einstein 0.44s c-einstein-01-dessert-02 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> hypatia 0.33s c-einstein-01-dessert-03 einstein -> einstein 0.47s c-einstein-01-main-01 einstein -> hypatia 0.35s c-einstein-01-main-01 einstein -> einstein 0.40s c-einstein-01-main-02 einstein -> einstein 0.44s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-main-03 einstein -> einstein 0.46s c-einstein-01-starter-01 einstein -> einstein 0.35s c-einstein-01-starter-02 einstein -> einstein 0.32s c-einstein-01-starter-02 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.45s c-einstein-01-starter-03 einstein -> einstein 0.39s c-einstein-01-starter-03 einstein -> einstein 0.33s c-hypatia-01-dessert-01 hypatia -> hypatia 0.45s c-hypatia-01-dessert-02 hypatia -> hypatia 0.38s c-hypatia-01-dessert-02 hypatia -> hypatia 0.32s c-hypatia-01-dessert-03 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.42s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.44s c-hypatia-01-main-01 hypatia -> hypatia 0.39s c-hypatia-01-main-01 hypatia -> hypatia 0.32s c-hypatia-01-main-02 hypatia -> hypatia 0.40s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-main-03 hypatia -> hypatia 0.38s c-hypatia-01-main-03 hypatia -> hypatia 0.47s c-hypatia-01-starter-01 hypatia -> hypatia 0.32s c-hypatia-01-starter-01 hypatia -> socrates 0.38s c-hypatia-01-starter-02 hypatia -> hypatia 0.35s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-hypatia-01-starter-02 hypatia -> hypatia 0.37s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.39s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.34s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.40s c-sagan-01-dessert-01 sagan -> sagan 0.46s c-sagan-01-dessert-01 sagan -> sagan 0.36s c-sagan-01-dessert-01 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.47s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-dessert-03 sagan -> sagan 0.46s c-sagan-01-main-01 sagan -> sagan 0.39s c-sagan-01-main-02 sagan -> sagan 0.42s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-starter-01 sagan -> sagan 0.33s c-sagan-01-starter-02 sagan -> sagan 0.46s c-sagan-01-starter-02 sagan -> sagan 0.34s c-sagan-01-starter-03 sagan -> darwin 0.35s c-sagan-01-starter-03 sagan -> sagan 0.41s c-socrates-01-dessert-01 socrates -> socrates 0.47s c-socrates-01-dessert-01 socrates -> socrates 0.34s c-socrates-01-dessert-01 socrates -> socrates 0.41s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.44s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-main-01 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.46s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-02 socrates -> socrates 0.42s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> hypatia 0.39s c-socrates-01-main-03 socrates -> socrates 0.44s c-socrates-01-starter-01 socrates -> socrates 0.32s c-socrates-01-starter-02 socrates -> socrates 0.37s c-socrates-01-starter-03 socrates -> socrates 0.39s c-socrates-01-starter-03 socrates -> socrates 0.41s c-socrates-01-starter-03 socrates -> socrates 0.38s c-darwin-01-dessert-01 darwin -> darwin 0.33s c-darwin-01-dessert-01 darwin -> darwin 0.44s c-darwin-01-dessert-01 darwin -> darwin 0.35s c-darwin-01-dessert-02 darwin -> darwin 0.46s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-main-01 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> ibn_sina 0.35s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.47s c-darwin-01-main-02 darwin -> darwin 0.46s c-darwin-01-main-03 darwin -> darwin 0.46s c-darwin-01-starter-01 darwin -> sagan 0.28s c-darwin-01-starter-01 darwin -> darwin 0.32s c-darwin-01-starter-01 darwin -> darwin 0.35s c-darwin-01-starter-02 darwin -> darwin 0.32s c-darwin-01-starter-03 darwin -> darwin 0.46s c-darwin-01-starter-03 darwin -> darwin 0.44s c-einstein-01-dessert-01 einstein -> einstein 0.42s c-einstein-01-dessert-01 einstein -> einstein 0.44s c-einstein-01-dessert-02 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> hypatia 0.33s c-einstein-01-dessert-03 einstein -> einstein 0.47s c-einstein-01-main-01 einstein -> hypatia 0.35s c-einstein-01-main-01 einstein -> einstein 0.40s c-einstein-01-main-02 einstein -> einstein 0.44s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-main-03 einstein -> einstein 0.46s c-einstein-01-starter-01 einstein -> einstein 0.35s c-einstein-01-starter-02 einstein -> einstein 0.32s c-einstein-01-starter-02 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.45s c-einstein-01-starter-03 einstein -> einstein 0.39s c-einstein-01-starter-03 einstein -> einstein 0.33s c-hypatia-01-dessert-01 hypatia -> hypatia 0.45s c-hypatia-01-dessert-02 hypatia -> hypatia 0.38s c-hypatia-01-dessert-02 hypatia -> hypatia 0.32s c-hypatia-01-dessert-03 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.42s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.45s c-hypatia-01-main-01 hypatia -> hypatia 0.39s c-hypatia-01-main-01 hypatia -> hypatia 0.32s c-hypatia-01-main-02 hypatia -> hypatia 0.40s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-main-03 hypatia -> hypatia 0.38s c-hypatia-01-main-03 hypatia -> hypatia 0.47s c-hypatia-01-starter-01 hypatia -> socrates 0.32s c-hypatia-01-starter-01 hypatia -> socrates 0.38s c-hypatia-01-starter-02 hypatia -> hypatia 0.35s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-hypatia-01-starter-02 hypatia -> hypatia 0.37s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.39s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.46s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-starter-02 ibn_sina -> socrates 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.40s c-sagan-01-dessert-01 sagan -> sagan 0.46s c-sagan-01-dessert-01 sagan -> sagan 0.37s c-sagan-01-dessert-01 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.47s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-dessert-03 sagan -> sagan 0.46s c-sagan-01-main-01 sagan -> sagan 0.39s c-sagan-01-main-02 sagan -> sagan 0.42s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-starter-01 sagan -> sagan 0.33s c-sagan-01-starter-02 sagan -> sagan 0.46s c-sagan-01-starter-02 sagan -> sagan 0.35s c-sagan-01-starter-03 sagan -> darwin 0.35s c-sagan-01-starter-03 sagan -> sagan 0.41s c-socrates-01-dessert-01 socrates -> socrates 0.47s c-socrates-01-dessert-01 socrates -> socrates 0.34s c-socrates-01-dessert-01 socrates -> socrates 0.42s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.44s c-socrates-01-dessert-02 socrates -> hypatia 0.35s c-socrates-01-main-01 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.46s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-02 socrates -> socrates 0.42s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> hypatia 0.40s c-socrates-01-main-03 socrates -> ibn_sina 0.44s c-socrates-01-starter-01 socrates -> socrates 0.32s c-socrates-01-starter-02 socrates -> socrates 0.37s c-socrates-01-starter-03 socrates -> socrates 0.39s c-socrates-01-starter-03 socrates -> socrates 0.41s c-socrates-01-starter-03 socrates -> socrates 0.38s c-darwin-01-dessert-01 darwin -> darwin 0.33s c-darwin-01-dessert-01 darwin -> darwin 0.44s c-darwin-01-dessert-01 darwin -> darwin 0.35s c-darwin-01-dessert-02 darwin -> darwin 0.46s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-main-01 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> ibn_sina 0.35s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.47s c-darwin-01-main-02 darwin -> darwin 0.46s c-darwin-01-main-03 darwin -> darwin 0.46s c-darwin-01-starter-01 darwin -> sagan 0.28s c-darwin-01-starter-01 darwin -> darwin 0.32s c-darwin-01-starter-01 darwin -> einstein 0.35s c-darwin-01-starter-02 darwin -> darwin 0.32s c-darwin-01-starter-03 darwin -> darwin 0.46s c-darwin-01-starter-03 darwin -> darwin 0.44s c-einstein-01-dessert-01 einstein -> einstein 0.42s c-einstein-01-dessert-01 einstein -> einstein 0.44s c-einstein-01-dessert-02 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> hypatia 0.34s c-einstein-01-dessert-03 einstein -> einstein 0.47s c-einstein-01-main-01 einstein -> hypatia 0.35s c-einstein-01-main-01 einstein -> einstein 0.40s c-einstein-01-main-02 einstein -> einstein 0.44s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-main-03 einstein -> einstein 0.46s c-einstein-01-starter-01 einstein -> einstein 0.35s c-einstein-01-starter-02 einstein -> einstein 0.32s c-einstein-01-starter-02 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.45s c-einstein-01-starter-03 einstein -> einstein 0.39s c-einstein-01-starter-03 einstein -> einstein 0.33s c-hypatia-01-dessert-01 hypatia -> hypatia 0.46s c-hypatia-01-dessert-02 hypatia -> hypatia 0.38s c-hypatia-01-dessert-02 hypatia -> hypatia 0.32s c-hypatia-01-dessert-03 hypatia -> ibn_sina 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.42s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.45s c-hypatia-01-main-01 hypatia -> hypatia 0.39s c-hypatia-01-main-01 hypatia -> hypatia 0.32s c-hypatia-01-main-02 hypatia -> hypatia 0.40s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-main-03 hypatia -> hypatia 0.38s c-hypatia-01-main-03 hypatia -> hypatia 0.47s c-hypatia-01-starter-01 hypatia -> hypatia 0.32s c-hypatia-01-starter-01 hypatia -> socrates 0.38s c-hypatia-01-starter-02 hypatia -> hypatia 0.35s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-hypatia-01-starter-02 hypatia -> hypatia 0.37s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.39s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.40s c-sagan-01-dessert-01 sagan -> sagan 0.46s c-sagan-01-dessert-01 sagan -> sagan 0.37s c-sagan-01-dessert-01 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.47s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-dessert-03 sagan -> sagan 0.46s c-sagan-01-main-01 sagan -> sagan 0.39s c-sagan-01-main-02 sagan -> sagan 0.42s c-sagan-01-main-02 sagan -> einstein 0.37s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-starter-01 sagan -> sagan 0.33s c-sagan-01-starter-02 sagan -> sagan 0.46s c-sagan-01-starter-02 sagan -> sagan 0.35s c-sagan-01-starter-03 sagan -> darwin 0.35s c-sagan-01-starter-03 sagan -> sagan 0.41s c-socrates-01-dessert-01 socrates -> socrates 0.47s c-socrates-01-dessert-01 socrates -> socrates 0.34s c-socrates-01-dessert-01 socrates -> socrates 0.42s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.44s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-main-01 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.46s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-02 socrates -> socrates 0.42s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> hypatia 0.39s c-socrates-01-main-03 socrates -> ibn_sina 0.44s c-socrates-01-starter-01 socrates -> socrates 0.32s c-socrates-01-starter-02 socrates -> socrates 0.37s c-socrates-01-starter-03 socrates -> socrates 0.39s c-socrates-01-starter-03 socrates -> socrates 0.41s c-socrates-01-starter-03 socrates -> socrates 0.38s c-darwin-01-dessert-01 darwin -> darwin 0.33s c-darwin-01-dessert-01 darwin -> darwin 0.44s c-darwin-01-dessert-01 darwin -> darwin 0.35s c-darwin-01-dessert-02 darwin -> darwin 0.46s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-main-01 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> ibn_sina 0.35s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.47s c-darwin-01-main-02 darwin -> darwin 0.46s c-darwin-01-main-03 darwin -> darwin 0.46s c-darwin-01-starter-01 darwin -> sagan 0.28s c-darwin-01-starter-01 darwin -> darwin 0.32s c-darwin-01-starter-01 darwin -> darwin 0.35s c-darwin-01-starter-02 darwin -> darwin 0.32s c-darwin-01-starter-03 darwin -> darwin 0.46s c-darwin-01-starter-03 darwin -> darwin 0.44s c-einstein-01-dessert-01 einstein -> einstein 0.42s c-einstein-01-dessert-01 einstein -> einstein 0.44s c-einstein-01-dessert-02 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> hypatia 0.34s c-einstein-01-dessert-03 einstein -> einstein 0.47s c-einstein-01-main-01 einstein -> hypatia 0.35s c-einstein-01-main-01 einstein -> einstein 0.40s c-einstein-01-main-02 einstein -> einstein 0.44s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.42s c-einstein-01-main-03 einstein -> einstein 0.46s c-einstein-01-starter-01 einstein -> einstein 0.35s c-einstein-01-starter-02 einstein -> einstein 0.32s c-einstein-01-starter-02 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.45s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.33s c-hypatia-01-dessert-01 hypatia -> hypatia 0.46s c-hypatia-01-dessert-02 hypatia -> ibn_sina 0.38s c-hypatia-01-dessert-02 hypatia -> hypatia 0.32s c-hypatia-01-dessert-03 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.42s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.45s c-hypatia-01-main-01 hypatia -> hypatia 0.39s c-hypatia-01-main-01 hypatia -> hypatia 0.32s c-hypatia-01-main-02 hypatia -> hypatia 0.40s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-main-03 hypatia -> hypatia 0.38s c-hypatia-01-main-03 hypatia -> hypatia 0.47s c-hypatia-01-starter-01 hypatia -> ibn_sina 0.32s c-hypatia-01-starter-01 hypatia -> socrates 0.38s c-hypatia-01-starter-02 hypatia -> hypatia 0.35s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-hypatia-01-starter-02 hypatia -> hypatia 0.37s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.39s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.46s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.40s c-sagan-01-dessert-01 sagan -> sagan 0.46s c-sagan-01-dessert-01 sagan -> sagan 0.36s c-sagan-01-dessert-01 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.47s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-dessert-03 sagan -> sagan 0.46s c-sagan-01-main-01 sagan -> sagan 0.39s c-sagan-01-main-02 sagan -> sagan 0.42s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-starter-01 sagan -> sagan 0.33s c-sagan-01-starter-02 sagan -> sagan 0.46s c-sagan-01-starter-02 sagan -> sagan 0.35s c-sagan-01-starter-03 sagan -> darwin 0.35s c-sagan-01-starter-03 sagan -> sagan 0.41s c-socrates-01-dessert-01 socrates -> socrates 0.47s c-socrates-01-dessert-01 socrates -> socrates 0.34s c-socrates-01-dessert-01 socrates -> socrates 0.41s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.44s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-main-01 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.46s c-socrates-01-main-02 socrates -> ibn_sina 0.35s c-socrates-01-main-02 socrates -> socrates 0.42s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> hypatia 0.40s c-socrates-01-main-03 socrates -> socrates 0.44s c-socrates-01-starter-01 socrates -> socrates 0.32s c-socrates-01-starter-02 socrates -> socrates 0.37s c-socrates-01-starter-03 socrates -> socrates 0.39s c-socrates-01-starter-03 socrates -> socrates 0.41s c-socrates-01-starter-03 socrates -> socrates 0.38s c-darwin-01-dessert-01 darwin -> darwin 0.33s c-darwin-01-dessert-01 darwin -> darwin 0.44s c-darwin-01-dessert-01 darwin -> darwin 0.35s c-darwin-01-dessert-02 darwin -> darwin 0.46s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-main-01 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> darwin 0.35s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.47s c-darwin-01-main-02 darwin -> darwin 0.46s c-darwin-01-main-03 darwin -> darwin 0.46s c-darwin-01-starter-01 darwin -> sagan 0.28s c-darwin-01-starter-01 darwin -> darwin 0.32s c-darwin-01-starter-01 darwin -> darwin 0.35s c-darwin-01-starter-02 darwin -> darwin 0.32s c-darwin-01-starter-03 darwin -> darwin 0.46s c-darwin-01-starter-03 darwin -> darwin 0.45s c-einstein-01-dessert-01 einstein -> einstein 0.42s c-einstein-01-dessert-01 einstein -> einstein 0.44s c-einstein-01-dessert-02 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> hypatia 0.34s c-einstein-01-dessert-03 einstein -> einstein 0.47s c-einstein-01-main-01 einstein -> hypatia 0.35s c-einstein-01-main-01 einstein -> einstein 0.40s c-einstein-01-main-02 einstein -> einstein 0.44s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-main-03 einstein -> einstein 0.46s c-einstein-01-starter-01 einstein -> einstein 0.35s c-einstein-01-starter-02 einstein -> einstein 0.32s c-einstein-01-starter-02 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.45s c-einstein-01-starter-03 einstein -> einstein 0.39s c-einstein-01-starter-03 einstein -> einstein 0.33s c-hypatia-01-dessert-01 hypatia -> hypatia 0.46s c-hypatia-01-dessert-02 hypatia -> ibn_sina 0.38s c-hypatia-01-dessert-02 hypatia -> hypatia 0.32s c-hypatia-01-dessert-03 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.42s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.45s c-hypatia-01-main-01 hypatia -> ibn_sina 0.39s c-hypatia-01-main-01 hypatia -> hypatia 0.32s c-hypatia-01-main-02 hypatia -> hypatia 0.40s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-main-03 hypatia -> hypatia 0.38s c-hypatia-01-main-03 hypatia -> hypatia 0.47s c-hypatia-01-starter-01 hypatia -> hypatia 0.32s c-hypatia-01-starter-01 hypatia -> socrates 0.38s c-hypatia-01-starter-02 hypatia -> hypatia 0.35s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-hypatia-01-starter-02 hypatia -> hypatia 0.37s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.39s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.46s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-starter-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.40s c-sagan-01-dessert-01 sagan -> sagan 0.46s c-sagan-01-dessert-01 sagan -> sagan 0.37s c-sagan-01-dessert-01 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.47s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-dessert-03 sagan -> sagan 0.46s c-sagan-01-main-01 sagan -> sagan 0.39s c-sagan-01-main-02 sagan -> sagan 0.42s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-starter-01 sagan -> sagan 0.33s c-sagan-01-starter-02 sagan -> sagan 0.46s c-sagan-01-starter-02 sagan -> sagan 0.35s c-sagan-01-starter-03 sagan -> darwin 0.35s c-sagan-01-starter-03 sagan -> einstein 0.41s c-socrates-01-dessert-01 socrates -> socrates 0.47s c-socrates-01-dessert-01 socrates -> socrates 0.34s c-socrates-01-dessert-01 socrates -> socrates 0.42s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.44s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-main-01 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.46s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-02 socrates -> socrates 0.42s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> socrates 0.40s c-socrates-01-main-03 socrates -> ibn_sina 0.44s c-socrates-01-starter-01 socrates -> socrates 0.32s c-socrates-01-starter-02 socrates -> socrates 0.37s c-socrates-01-starter-03 socrates -> socrates 0.39s c-socrates-01-starter-03 socrates -> socrates 0.41s c-socrates-01-starter-03 socrates -> socrates 0.38s c-darwin-01-dessert-01 darwin -> darwin 0.33s c-darwin-01-dessert-01 darwin -> darwin 0.44s c-darwin-01-dessert-01 darwin -> darwin 0.35s c-darwin-01-dessert-02 darwin -> darwin 0.46s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-dessert-03 darwin -> darwin 0.47s c-darwin-01-main-01 darwin -> darwin 0.37s c-darwin-01-main-02 darwin -> ibn_sina 0.35s c-darwin-01-main-02 darwin -> darwin 0.42s c-darwin-01-main-02 darwin -> darwin 0.47s c-darwin-01-main-02 darwin -> darwin 0.46s c-darwin-01-main-03 darwin -> darwin 0.46s c-darwin-01-starter-01 darwin -> ibn_sina 0.28s c-darwin-01-starter-01 darwin -> darwin 0.32s c-darwin-01-starter-01 darwin -> darwin 0.35s c-darwin-01-starter-02 darwin -> darwin 0.32s c-darwin-01-starter-03 darwin -> darwin 0.46s c-darwin-01-starter-03 darwin -> darwin 0.45s c-einstein-01-dessert-01 einstein -> einstein 0.42s c-einstein-01-dessert-01 einstein -> einstein 0.44s c-einstein-01-dessert-02 einstein -> einstein 0.40s c-einstein-01-dessert-02 einstein -> einstein 0.34s c-einstein-01-dessert-03 einstein -> einstein 0.47s c-einstein-01-main-01 einstein -> hypatia 0.35s c-einstein-01-main-01 einstein -> einstein 0.40s c-einstein-01-main-02 einstein -> einstein 0.44s c-einstein-01-main-03 einstein -> einstein 0.39s c-einstein-01-main-03 einstein -> einstein 0.40s c-einstein-01-main-03 einstein -> einstein 0.41s c-einstein-01-main-03 einstein -> einstein 0.46s c-einstein-01-starter-01 einstein -> einstein 0.35s c-einstein-01-starter-02 einstein -> einstein 0.32s c-einstein-01-starter-02 einstein -> einstein 0.35s c-einstein-01-starter-03 einstein -> einstein 0.45s c-einstein-01-starter-03 einstein -> einstein 0.40s c-einstein-01-starter-03 einstein -> einstein 0.33s c-hypatia-01-dessert-01 hypatia -> hypatia 0.46s c-hypatia-01-dessert-02 hypatia -> hypatia 0.38s c-hypatia-01-dessert-02 hypatia -> hypatia 0.32s c-hypatia-01-dessert-03 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.42s c-hypatia-01-main-01 hypatia -> hypatia 0.35s c-hypatia-01-main-01 hypatia -> hypatia 0.45s c-hypatia-01-main-01 hypatia -> ibn_sina 0.39s c-hypatia-01-main-01 hypatia -> hypatia 0.32s c-hypatia-01-main-02 hypatia -> hypatia 0.40s c-hypatia-01-main-03 hypatia -> hypatia 0.42s c-hypatia-01-main-03 hypatia -> hypatia 0.38s c-hypatia-01-main-03 hypatia -> hypatia 0.47s c-hypatia-01-starter-01 hypatia -> hypatia 0.32s c-hypatia-01-starter-01 hypatia -> socrates 0.38s c-hypatia-01-starter-02 hypatia -> hypatia 0.35s c-hypatia-01-starter-02 hypatia -> hypatia 0.32s c-hypatia-01-starter-02 hypatia -> hypatia 0.37s c-ibn_sina-01-dessert-01 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.38s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-02 ibn_sina -> ibn_sina 0.39s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-dessert-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.37s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.40s c-ibn_sina-01-main-02 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.45s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-main-03 ibn_sina -> ibn_sina 0.46s c-ibn_sina-01-starter-01 ibn_sina -> ibn_sina 0.35s c-ibn_sina-01-starter-02 ibn_sina -> socrates 0.37s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.41s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.42s c-ibn_sina-01-starter-03 ibn_sina -> ibn_sina 0.40s c-sagan-01-dessert-01 sagan -> sagan 0.46s c-sagan-01-dessert-01 sagan -> sagan 0.37s c-sagan-01-dessert-01 sagan -> sagan 0.34s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.47s c-sagan-01-dessert-03 sagan -> sagan 0.38s c-sagan-01-dessert-03 sagan -> sagan 0.41s c-sagan-01-dessert-03 sagan -> sagan 0.46s c-sagan-01-main-01 sagan -> sagan 0.39s c-sagan-01-main-02 sagan -> sagan 0.42s c-sagan-01-main-02 sagan -> sagan 0.37s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-main-03 sagan -> sagan 0.46s c-sagan-01-starter-01 sagan -> sagan 0.33s c-sagan-01-starter-02 sagan -> sagan 0.46s c-sagan-01-starter-02 sagan -> sagan 0.35s c-sagan-01-starter-03 sagan -> darwin 0.35s c-sagan-01-starter-03 sagan -> sagan 0.41s c-socrates-01-dessert-01 socrates -> socrates 0.47s c-socrates-01-dessert-01 socrates -> socrates 0.34s c-socrates-01-dessert-01 socrates -> socrates 0.41s c-socrates-01-dessert-02 socrates -> socrates 0.40s c-socrates-01-dessert-02 socrates -> socrates 0.44s c-socrates-01-dessert-02 socrates -> socrates 0.35s c-socrates-01-main-01 socrates -> socrates 0.38s c-socrates-01-main-02 socrates -> socrates 0.46s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-02 socrates -> socrates 0.42s c-socrates-01-main-02 socrates -> socrates 0.35s c-socrates-01-main-03 socrates -> hypatia 0.39s c-socrates-01-main-03 socrates -> socrates 0.44s c-socrates-01-starter-01 socrates -> socrates 0.32s c-socrates-01-starter-02 socrates -> socrates 0.37s c-socrates-01-starter-03 socrates -> socrates 0.39s c-socrates-01-starter-03 socrates -> socrates 0.41s c-socrates-01-starter-03 socrates -> socrates 0.38s {"n": 648, "n_reached": 648, "n_labelled": 648, "refused": 0, "refused_by_reason": {}, "correct": 592, "errors": 0, "brier": 0.1728395061728395, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.4, [2026-09-22T10:00:45Z] gap 4 RC=0 [2026-09-22T10:00:45Z] stopping server pid 5006 [2026-09-22T10:00:57Z] cards after the stop: GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 22.37 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 15.66 W [2026-09-22T10:00:57Z] === gap 5 — the same checkpoint with the eyes on, image:1 [2026-09-22T10:02:58Z] gap5 server READY after 120s {"object":"list","data":[{"id":"openjev-fp8","object":"model","created":1790071378,"owned_by":"vllm","root":"/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10","parent":null,"max_model_len":16384,"permission":[{"id":"modelperm-84666a5b0bf17c93","object":"model_permission","created":1790071378,"allow_create_engine":false,"allow_sampling":true,"allow_logprobs":true,"allow_search_indices":false,"allow_view":true,"allow_fine_tuning":false,"organization":"*","group":null,"is_blocking":false}]}]} ANNOUNCE box benchbox · cards 0+1 (both RTX 3090s, 250 W caps) · gap 5 · vLLM 0.29.0 serve openjev/openjev-FP8 TP=2 with --limit-mm-per-prompt image:1 · start 2026-09-22T10:00:57Z · expect ~10 min to ready, then ~10 min of task arms (APIServer pid=7671) INFO 09-22 10:01:05 [api_utils.py:286] non-default args: {'model_tag': '/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', 'host': '127.0.0.1', 'model': '/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', 'trust_remote_code': True, 'max_model_len': 16384, 'quantization': 'fp8', 'max_logprobs': 64, 'served_model_name': ['openjev-fp8'], 'tensor_parallel_size': 2, 'gpu_memory_utilization': 0.9, 'enable_prefix_caching': True, 'limit_mm_per_prompt': {'image': 1}, 'max_num_seqs': 1, 'gdn_prefill_backend': 'triton'} (APIServer pid=7671) INFO 09-22 10:01:07 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']) (APIServer pid=7671) [transformers] The `use_fast` parameter is deprecated and will be removed in a future version. Use `backend="torchvision"` instead of `use_fast=True`, or `backend="pil"` instead of `use_fast=False`. (EngineCore pid=7839) INFO 09-22 10:01:21 [core.py:123] Initializing a V1 LLM engine (v0.29.0) with config: model='/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', speculative_config=None, tokenizer='/workshop/hf-cache/hub/models--openjev--openjev-FP8/snapshots/4ec320f267401e67c9be04d5df1be4d2b6b64f10', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=16384, download_dir=None, load_format=auto, tensor_parallel_size=2, pipeline_parallel_size=1, data_parallel_size=1, decode_context_parallel_size=1, dcp_comm_backend=ag_rs, disable_custom_all_reduce=False, quantization=fp8, quantization_config=None, enforce_eager=False, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, per_request_spec_decode_metrics='none', kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False, jit_monitor_mode='warn', jit_monitor_verbose=False), seed=0, served_model_name=openjev-fp8, enable_prefix_caching=True, enable_chunked_prefill=True, pooler_config=None, compilation_config={'mode': , 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['+quant_fp8', 'none', '+quant_fp8'], 'ir_enable_torch_wrap': True, 'splitting_ops': ['vllm::unified_attention_with_output', 'vllm::unified_mla_attention_with_output', 'vllm::mamba_mixer2', 'vllm::mamba_mixer', 'vllm::short_conv', 'vllm::qwen4_exp_compute_ple_ngram_ids', 'vllm::qwen4_exp_ple_short_conv', 'vllm::qwen4_exp_qsa_with_output', 'vllm::linear_attention', 'vllm::qwen_gdn_attention_core', 'vllm::qwen_gdn_attention_core_fused_norm_packed', 'vllm::gdn_attention_core_xpu', 'vllm::olmo_hybrid_gdn_full_forward', 'vllm::sparse_attn_indexer', 'vllm::rocm_aiter_sparse_attn_indexer', 'vllm::deepseek_v4_attention', 'vllm::hpc_rope_norm_forward', 'vllm::unified_kv_cache_update', 'vllm::unified_mla_kv_cache_update'], 'compile_mm_encoder': False, 'cudagraph_mm_encoder': False, 'encoder_cudagraph_token_budgets': [], 'encoder_cudagraph_max_vision_items_per_batch': 0, 'encoder_cudagraph_max_frames_per_batch': None, 'compile_sizes': [], 'compile_ranges_endpoints': [2048], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': , 'cudagraph_num_of_warmups': 1, 'cudagraph_capture_sizes': [1, 2], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': True, 'fuse_act_quant': True, 'fuse_attn_quant': False, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False, 'enable_qk_norm_rope_fusion': False, 'fuse_rope_kvcache_cat_mla': False, 'fuse_act_padding': False, 'fuse_qk_norm_rope_kvcache': False}, 'max_cudagraph_capture_size': 2, 'dynamic_shapes_config': {'type': , 'evaluate_guards': False, 'assume_32_bit_indexing': False}, 'local_cache_dir': None, 'fast_moe_cold_start': False, 'static_all_moe_layers': []}, kernel_config=KernelConfig(ir_op_priority=IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']), enable_flashinfer_autotune=True, enable_cutedsl_warmup=True, enable_jit_warmup=True, enable_bf16x3_router_gemm=False, moe_backend='auto', linear_backend='auto') (Worker_TP0 pid=7948) INFO 09-22 10:01:30 [mm_encoder_attention.py:372] Using AttentionBackendEnum.FLASH_ATTN for MMEncoderAttention. (Worker_TP0 pid=7948) INFO 09-22 10:01:30 [__init__.py:695] Selected MarlinFP8ScaledMMLinearKernel for Fp8LinearMethod (Worker_TP0 pid=7948) INFO 09-22 10:01:30 [qwen_gdn_linear_attn.py:167] Using Triton/FLA GDN prefill kernel (requested=triton, head_k_dim=128). (Worker_TP0 pid=7948) INFO 09-22 10:01:30 [qwen_gdn_linear_attn.py:519] GDN decode kernel: cuda (Worker_TP0 pid=7948) WARNING 09-22 10:01:51 [marlin_utils_fp8.py:112] Your GPU does not have native support for FP8 computation but FP8 quantization is being used. Weight-only FP8 compression will be used leveraging the Marlin kernel. This may degrade performance for compute-heavy workloads. (Worker_TP1 pid=7949) [transformers] The `use_fast` parameter is deprecated and will be removed in a future version. Use `backend="torchvision"` instead of `use_fast=True`, or `backend="pil"` instead of `use_fast=False`. (Worker_TP0 pid=7948) [transformers] The `use_fast` parameter is deprecated and will be removed in a future version. Use `backend="torchvision"` instead of `use_fast=True`, or `backend="pil"` instead of `use_fast=False`. (Worker_TP0 pid=7948) INFO 09-22 10:01:59 [encoder_runner.py:131] Encoder cache will be initialized with a budget of 16384 tokens, and profiled with 1 image items of the maximum feature size. (Worker_TP0 pid=7948) INFO 09-22 10:02:17 [kernel_warmup.py:124] JIT kernel warmup starting. (Worker_TP0 pid=7948) INFO 09-22 10:02:17 [kernel_warmup.py:134] JIT kernel warmup finished in 0.00s. (Worker_TP0 pid=7948) INFO 09-22 10:02:17 [qwen_triton_warmup.py:270] Warming up Qwen Triton kernels for model_type=qwen3_5_text. (Worker_TP1 pid=7949) INFO 09-22 10:02:17 [kernel_warmup.py:124] JIT kernel warmup starting. (Worker_TP1 pid=7949) INFO 09-22 10:02:17 [kernel_warmup.py:134] JIT kernel warmup finished in 0.00s. (Worker_TP1 pid=7949) INFO 09-22 10:02:17 [qwen_triton_warmup.py:270] Warming up Qwen Triton kernels for model_type=qwen3_5_text. (Worker_TP1 pid=7949) INFO 09-22 10:02:20 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn. (Worker_TP0 pid=7948) INFO 09-22 10:02:20 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn. (EngineCore pid=7839) [transformers] The `use_fast` parameter is deprecated and will be removed in a future version. Use `backend="torchvision"` instead of `use_fast=True`, or `backend="pil"` instead of `use_fast=False`. (EngineCore pid=7839) INFO 09-22 10:02:28 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']) [2026-09-22T10:02:58Z] === gap 5 tasks shot_title, shot_kind — readout then the generating control ANNOUNCE box benchbox · cards GPU-46890836-d8f, GPU-7aa0be10-974 · arm openjev-fp8-readout-mm · task shot_title · start 2026-09-22T10:02:58Z · expect ~4 min a-rig-your-friend-already-owns a-rig-your-friend-already-owns -> a-rig-your-friend-already-owns 2.90s chair-trials chair-trials -> chair-trials 1.85s compression-is-the-objective compression-is-the-objective -> compression-is-the-objective 1.82s fifty-seven-milliseconds fifty-seven-milliseconds -> fifty-seven-milliseconds 1.81s how-a-vision-model-sees how-a-vision-model-sees -> how-a-vision-model-sees 1.88s how-the-beat-lab-works how-the-beat-lab-works -> how-the-beat-lab-works 1.80s how-we-work how-we-work -> how-we-work 1.78s licences licences -> licences 1.80s nine-worlds-one-dog nine-worlds-one-dog -> nine-worlds-one-dog 1.82s outside-judges outside-judges -> outside-judges 1.83s reading-is-fast reading-is-fast -> reading-is-fast 1.83s seat-trials seat-trials -> seat-trials 1.81s ten-minutes-with-living-artists ten-minutes-with-living-artists -> ten-minutes-with-living-artists 1.83s the-beat-lab-asked-and-answered the-beat-lab-asked-and-answered -> the-beat-lab-asked-and-answered 1.80s the-ceiling-is-not-the-corpus the-ceiling-is-not-the-corpus -> the-ceiling-is-not-the-corpus 1.81s the-dog-the-dice-and-the-painter the-dog-the-dice-and-the-painter -> the-dog-the-dice-and-the-painter 1.81s the-indifferent-prediction the-indifferent-prediction -> the-indifferent-prediction 1.80s the-move the-move -> the-move 1.81s the-open-call the-open-call -> the-open-call 1.82s three-at-the-table three-at-the-table -> three-at-the-table 1.81s three-librarians three-librarians -> three-librarians 1.81s two-new-frontier-models-at-the-rules-desk two-new-frontier-models-at-the-rules-desk -> two-new-frontier-models-at-the-rul 1.83s what-150-watts-buys what-150-watts-buys -> what-150-watts-buys 1.81s where-new-knowledge-comes-from where-new-knowledge-comes-from -> where-new-knowledge-comes-from 1.83s root root -> root 1.79s playground playground -> playground 1.75s rulesage rulesage -> rulesage 1.73s longtable longtable -> longtable 1.73s studio studio -> studio 1.72s design design -> memory 1.76s easel easel -> easel 1.75s brain brain -> brain 1.74s sharpsignal sharpsignal -> sharpsignal 1.74s forge forge -> forge 1.74s kiln kiln -> kiln 1.73s memory memory -> memory 1.74s {"n": 36, "n_reached": 36, "n_labelled": 36, "refused": 0, "refused_by_reason": {}, "correct": 35, "errors": 0, "brier": 0.03557077102904395, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.4, "h ANNOUNCE box benchbox · cards GPU-46890836-d8f, GPU-7aa0be10-974 · arm openjev-fp8-readout-mm · task shot_kind · start 2026-09-22T10:04:14Z · expect ~4 min a-rig-your-friend-already-owns article -> article 0.75s chair-trials article -> article 0.75s compression-is-the-objective article -> article 0.75s fifty-seven-milliseconds article -> article 0.75s how-a-vision-model-sees article -> article 0.75s how-the-beat-lab-works article -> article 0.75s how-we-work article -> article 0.75s licences article -> article 0.75s nine-worlds-one-dog article -> article 0.75s outside-judges article -> article 0.75s reading-is-fast article -> article 0.75s seat-trials article -> article 0.75s ten-minutes-with-living-artists article -> article 0.75s the-beat-lab-asked-and-answered article -> article 0.74s the-ceiling-is-not-the-corpus article -> article 0.74s the-dog-the-dice-and-the-painter article -> article 0.75s the-indifferent-prediction article -> article 0.75s the-move article -> article 0.75s the-open-call article -> article 0.75s three-at-the-table article -> article 0.75s three-librarians article -> article 0.75s two-new-frontier-models-at-the-rules-desk article -> article 0.75s what-150-watts-buys article -> article 0.75s where-new-knowledge-comes-from article -> article 0.75s root front_door -> front_door 0.75s playground front_door -> front_door 0.76s rulesage front_door -> front_door 0.75s longtable front_door -> front_door 0.75s studio front_door -> front_door 0.74s design front_door -> front_door 0.76s easel front_door -> front_door 0.75s brain front_door -> front_door 0.74s sharpsignal front_door -> front_door 0.75s forge front_door -> front_door 0.74s kiln front_door -> front_door 0.74s memory front_door -> front_door 0.75s {"n": 36, "n_reached": 36, "n_labelled": 36, "refused": 0, "refused_by_reason": {}, "correct": 36, "errors": 0, "brier": 0.0005809062057264215, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.4, ANNOUNCE box benchbox · cards GPU-46890836-d8f, GPU-7aa0be10-974 · arm openjev-fp8-generate-mm · task shot_title · start 2026-09-22T10:04:51Z · expect ~4 min a-rig-your-friend-already-owns a-rig-your-friend-already-owns -> a-rig-your-friend-already-owns 0.93s chair-trials chair-trials -> chair-trials 0.94s compression-is-the-objective compression-is-the-objective -> compression-is-the-objective 0.93s fifty-seven-milliseconds fifty-seven-milliseconds -> fifty-seven-milliseconds 0.93s how-a-vision-model-sees how-a-vision-model-sees -> how-a-vision-model-sees 0.94s how-the-beat-lab-works how-the-beat-lab-works -> how-the-beat-lab-works 0.91s how-we-work how-we-work -> how-we-work 0.90s licences licences -> licences 0.93s nine-worlds-one-dog nine-worlds-one-dog -> nine-worlds-one-dog 0.93s outside-judges outside-judges -> outside-judges 0.93s reading-is-fast reading-is-fast -> reading-is-fast 0.92s seat-trials seat-trials -> seat-trials 0.91s ten-minutes-with-living-artists ten-minutes-with-living-artists -> ten-minutes-with-living-artists 0.93s the-beat-lab-asked-and-answered the-beat-lab-asked-and-answered -> the-beat-lab-asked-and-answered 0.90s the-ceiling-is-not-the-corpus the-ceiling-is-not-the-corpus -> the-ceiling-is-not-the-corpus 0.90s the-dog-the-dice-and-the-painter the-dog-the-dice-and-the-painter -> the-dog-the-dice-and-the-painter 0.91s the-indifferent-prediction the-indifferent-prediction -> the-indifferent-prediction 0.90s the-move the-move -> the-move 0.91s the-open-call the-open-call -> the-open-call 0.91s three-at-the-table three-at-the-table -> three-at-the-table 0.91s three-librarians three-librarians -> three-librarians 0.91s two-new-frontier-models-at-the-rules-desk two-new-frontier-models-at-the-rules-desk -> two-new-frontier-models-at-the-rul 0.93s what-150-watts-buys what-150-watts-buys -> what-150-watts-buys 0.91s where-new-knowledge-comes-from where-new-knowledge-comes-from -> where-new-knowledge-comes-from 0.93s root root -> root 0.82s playground playground -> playground 0.84s rulesage rulesage -> rulesage 0.82s longtable longtable -> longtable 0.82s studio studio -> studio 0.82s design design -> memory 0.85s easel easel -> easel 0.84s brain brain -> brain 0.83s sharpsignal sharpsignal -> sharpsignal 0.84s forge forge -> forge 0.83s kiln kiln -> kiln 0.82s memory memory -> memory 0.83s {"n": 36, "n_reached": 36, "n_labelled": 36, "refused": 0, "refused_by_reason": {}, "correct": 35, "errors": 0, "brier": 0.05555555555555555, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.4, "h ANNOUNCE box benchbox · cards GPU-46890836-d8f, GPU-7aa0be10-974 · arm openjev-fp8-generate-mm · task shot_kind · start 2026-09-22T10:05:34Z · expect ~4 min a-rig-your-friend-already-owns article -> article 0.77s chair-trials article -> article 0.77s compression-is-the-objective article -> article 0.77s fifty-seven-milliseconds article -> article 0.77s how-a-vision-model-sees article -> article 0.77s how-the-beat-lab-works article -> article 0.77s how-we-work article -> article 0.77s licences article -> article 0.77s nine-worlds-one-dog article -> article 0.77s outside-judges article -> article 0.77s reading-is-fast article -> article 0.77s seat-trials article -> article 0.77s ten-minutes-with-living-artists article -> article 0.77s the-beat-lab-asked-and-answered article -> article 0.77s the-ceiling-is-not-the-corpus article -> article 0.77s the-dog-the-dice-and-the-painter article -> article 0.77s the-indifferent-prediction article -> article 0.77s the-move article -> article 0.77s the-open-call article -> article 0.77s three-at-the-table article -> article 0.77s three-librarians article -> article 0.77s two-new-frontier-models-at-the-rules-desk article -> article 0.77s what-150-watts-buys article -> article 0.77s where-new-knowledge-comes-from article -> article 0.77s root front_door -> front_door 0.77s playground front_door -> front_door 0.78s rulesage front_door -> front_door 0.76s longtable front_door -> front_door 0.77s studio front_door -> front_door 0.77s design front_door -> front_door 0.78s easel front_door -> front_door 0.78s brain front_door -> front_door 0.77s sharpsignal front_door -> front_door 0.77s forge front_door -> front_door 0.77s kiln front_door -> front_door 0.77s memory front_door -> front_door 0.77s {"n": 36, "n_reached": 36, "n_labelled": 36, "refused": 0, "refused_by_reason": {}, "correct": 36, "errors": 0, "brier": 0.0, "reliability": [{"lo": 0.0, "hi": 0.1, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.1, "hi": 0.2, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.2, "hi": 0.3, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.3, "hi": 0.4, "n": 0, "sum_p": 0.0, "correct": 0, "mean_p": null, "accuracy": null, "gap": null}, {"lo": 0.4, "hi": 0.5, "n": 0, [2026-09-22T10:06:13Z] gap 5 RC=0 [2026-09-22T10:06:13Z] stopping server pid 7671 [2026-09-22T10:06:27Z] cards after the stop: GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 21.75 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 14.08 W [2026-09-22T10:06:27Z] === both boards, free: GPU-7aa0be10-974f-6430-52fe-09018a0e2e08, 1 MiB, 21.75 W GPU-46890836-d8f7-e868-1977-c1ce28db0d7a, 1 MiB, 14.08 W /dev/mapper/ubuntu--vg-ubuntu--lv 295G 163G 120G 58% / [2026-09-22T10:06:27Z] GAPS-CARD CHAIN END