{
 "schema": "s2s-bench-v1",
 "kind": "registered-mini-bench-extract",
 "what_this_is": "The two arms of this page, asked the seminar's recurring question — can the robber go back to the desert? — under a pre-registered rule: n=5 scored calls per arm per question after one unscored warm-up, serial with 2s pauses, temperature 0, seed 0, think false, num_ctx 32768, beside live traffic (disclosed). At temperature 0 every arm's five replies were byte-identical, so one verbatim reply per cell carries all five. The full four-arm run (including the same 12B at two quantizations) publishes with the quantization exhibit; its pre-registration sha is quoted below.",
 "prereg": "ROBBER-PREREG.md sha 77b3c4f080cfd4b64bf0fe492122428f6075e6a133f763888a4941b76f89a9e4",
 "measured_utc": "2026-08-19 ~22:3X UTC, runtime ollama 0.32.13",
 "referee_note": "The two arms disagree about the rule. This kit does not referee them; the product's cited answer to the same question is public as rulesage-live ruling 4615.",
 "cells": [
  {
   "question": "Q1-simple",
   "model": "gemma4:26b",
   "decode_tok_s_median": 213.07,
   "decode_tok_s_min": 211.82,
   "decode_tok_s_max": 213.23,
   "n": 5,
   "replies_byte_identical": true,
   "reply_verbatim": "No, you cannot move the robber back to the desert. \n\nWhen you roll a 7, you must move the robber from its current hex to **any other** hex on the board. The desert is a special hex that doesn't produce resources, so it's usually not a strategic place to put the robber. \n\nThe only way the robber ends up on the desert is if it was already there and you chose to leave it there, or if you moved it there from a different hex. But once it's on a playable hex, you must move it to a new location to block someone's production!",
   "reply_sha256": "d2db508f5f499e2c4a4b66115e8fc97ad79cc51d89d4728bbb42e9c01a856a25",
   "prompt_eval_count": 68,
   "eval_count_first": 130
  },
  {
   "question": "Q1-simple",
   "model": "qwen3.8:27b",
   "decode_tok_s_median": 123.94,
   "decode_tok_s_min": 122.32,
   "decode_tok_s_max": 124.11,
   "n": 5,
   "replies_byte_identical": true,
   "reply_verbatim": "Yes, you can! When you roll a 7, you have to move the robber to any hex that isn’t already occupied by it. The desert hex is a perfectly valid spot to place it.\n\nStrategically, moving the robber to the desert is often a good move because it doesn’t block any resources for anyone. It’s a \"safe\" choice if you don’t want to annoy your neighbors or if you’re just trying to get rid of the robber without causing drama. Just remember, you still have to discard your cards if you have more than seven, but the robber placement itself is completely up to you. So, feel free to park it in the sand!",
   "reply_sha256": "8839c9788ac054957bd724368469b43d3eefbbd87db147ba61b706c37bd95610",
   "prompt_eval_count": 66,
   "eval_count_first": 139
  },
  {
   "question": "Q2-complex",
   "model": "gemma4:26b",
   "decode_tok_s_median": 210.72,
   "decode_tok_s_min": 207.27,
   "decode_tok_s_max": 211.95,
   "n": 5,
   "replies_byte_identical": true,
   "reply_verbatim": "If you roll a 7, you **must** move the robber from the desert to any other hex of your choice. The desert provides no protection; a 7 always triggers a move.\n\nLater in the game, you can move the robber back onto the desert, but only if you choose to do so during your active roll of a 7.\n\nIf the robber lands on a hex with multiple settlements, you choose which specific settlement to block and which player to steal from. You do not block all players on that hex; you pick one.\n\nIf the chosen player has zero cards, you simply take nothing. You still get to steal a card from the bank (if you have a development card effect) or just move the robber, but you cannot take a resource that doesn't exist.",
   "reply_sha256": "0b97cfb59ae957930e26c1c493113c2827a5b7ca9c63a14d4126d574d9d3d2d6",
   "prompt_eval_count": 106,
   "eval_count_first": 164
  },
  {
   "question": "Q2-complex",
   "model": "qwen3.8:27b",
   "decode_tok_s_median": 117.73,
   "decode_tok_s_min": 117.53,
   "decode_tok_s_max": 117.96,
   "n": 5,
   "replies_byte_identical": true,
   "reply_verbatim": "No, you are not required to move the robber if it is already on the desert. The rule states you must move it *if* it is on a numbered hex. Since the desert has no number, rolling a 7 does not force a move. You can leave it there.\n\nYes, a player may move the robber back onto the desert at any time. This is a standard strategic move to block opponents from stealing from that hex or to prevent them from using the \"7\" rule to move it off a productive hex.\n\nWhen the robber lands on a hex touched by two different players, you choose which player to steal from. You do not get to pick the specific card; you simply take one random card from that player’s hand.\n\nIf the player you choose has zero cards in hand, you simply do not steal anything. The turn proceeds normally. You do not get to steal from the other player on that hex, nor do you get to steal from a different hex. The theft is void because there were no cards to take. This is a common tactical consideration: players often try to keep their hand low to avoid being a target, or they may position their settlements to minimize the risk of being chosen when the robber lands on a shared hex.",
   "reply_sha256": "71d8322eb41ac1ff68ccb2ac2d3ec1e048efac37b8514246be0d3ea67a6a8979",
   "prompt_eval_count": 104,
   "eval_count_first": 257
  }
 ]
}