sim-balance: BALANCE.md v1.1 re-run on engine RULESET_V1_1 hooks

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
2026-11-17 00:31:56 -05:00
co-authored by Claude Opus 5.5
parent ed6a59c97f
commit 8ef2a28841
+98 -2
View File
@@ -13,7 +13,103 @@ Owner: sim-balance (claude/wikideck#4). Harness: `shared/bots/`, `scripts/sim/`
- focused starters + owned round robin: 2,000 matches per ruleset
- greedy lever sweeps: 2,000–3,000 per variant
### TL;DR for the council
## v1.1 re-run on the real engine hooks (00:31)
**Engine:** `night/engine/v1-1` @ 4a0dbd0, with `RULESET_V1_1` (DESIGN #32): `viral {base 1, cap 3}`, `encyclopedic {sides 1}`, `rising.powerDelta -1`, `cultureKeyword: home`, `costThresholds [26,39,51,63,78]`. It is the same focused run as above: the §2.1 starters plus 4 owned decks (cost thresholds and Culture keyword per v1.1), 2,000 matches per ruleset.
| | v1 | **v1.1 (#32, exact)** | v1.1 + item 6 |
|---|---|---|---|
| starter deck WR, overall (FG / Head / Pio / Star) | 65 / 40 / 57 / 54 | **52 / 52 / 52 / 53** ✅ | 50 / 56 / 50 / 52 |
| starter pairings, min–max | 23–77% | 39–61% (only FG–Head 61%, n = 51, is outside 45–55) | 42–58% |
| owned vs starters (FG / Head / Pio / Star) | 37 / 54 / 40 / 41 | 51 / 42 / 47 / 43 | 51 / 41 / 46 / 48 |
| first player | 53.4% | **51.2% [48.8–53.6]** ✅ | 51.0% [48.6–53.5] |
| decided in the first third | 4.1% | 3.3% | 4.1% |
| greedy > maxpower, lookahead-lite > greedy | 62%, 60% | 63%, 65% | 51%, 70% |
Net keyword value per card under the exact v1.1 (counterfactual trigger value plus `powerDelta`):
| keyword | v1.1 net per card |
|---|---|
| translated | **+1.64** |
| nostalgic | **+1.69** |
| viral | +1.15 (base included) |
| encyclopedic | +0.77 |
| rising | 1.71 − 1 = +0.71 |
| local | +0.69 |
My earlier flat-+1 stand-in for encyclopedic overstated it: the real hook is worth +0.77, not +1.23.
**Updated recommendation:**
1. **Ship #32 (v1.1) as it is.** Every starter's overall WR is 52–53% and first player is 51.2%. The one out-of-band pairing (FG vs Headliners at 61%) is within this run's noise.
2. **Item 6 is an optional v1.2 candidate.** `nostalgic` and `translated` at `powerDelta -1` would bring translated and nostalgic (about +1.65) in line with the others (0.7–1.15). It fixes FG vs Headliners (50%), but at n ≈ 55 per pairing it isn't clearly better overall (42–58% vs 39–61%). Decide it on a larger run.
3. **Owned vs starters is 42–51%:** roughly the variety-not-power goal, slightly weak against Headliners and Stargazers.
Raw tables:
#### `v1.1`: 2000 matches, 10 draws, 0 engine errors
- First player (turn-1 initiative), symmetric games: **51.2% [48.8–53.6] (n=1641)**
- Decided early: 3.3% of decisive games locked in during the first third, 12.1% by half-time
- Skill: greedy>maxpower 63.3% (n=147), lookahead-lite>greedy 64.6% (n=99), greedy>random 83.5% (n=103)
| starters (row vs col) | field-guide | headliners | pioneers | stargazers | vs all decks |
|---|---|---|---|---|---|
| field-guide | – | 61% (n=51) | 49% (n=53) | 56% (n=55) | 51.8% |
| headliners | 39% (n=51) | – | 44% (n=54) | 50% (n=54) | 52.1% |
| pioneers | 51% (n=53) | 56% (n=54) | – | 48% (n=58) | 52.3% |
| stargazers | 44% (n=55) | 50% (n=54) | 52% (n=58) | – | 53.2% |
| owned (random 12 from card-sample) vs | field-guide | headliners | pioneers | stargazers | all |
|---|---|---|---|---|---|
| owned-0 | 39% | 32% | 41% | 46% | 40.3% |
| owned-1 | 50% | 43% | 42% | 38% | 45.1% |
| owned-2 | 55% | 37% | 62% | 44% | 49.7% |
| owned-3 | 62% | 55% | 43% | 45% | 55.0% |
| **all owned** | **51%** (n=233) | **42%** (n=196) | **47%** (n=198) | **43%** (n=198) | |
| keyword | power per card | games decided by it | cards played |
|---|---|---|---|
| rising | +1.71 | 13.3% | 1503 |
| nostalgic | +1.69 | 13.4% | 1791 |
| translated | +1.64 | 17.8% | 4976 |
| viral | +1.15 | 7.3% | 1852 |
| encyclopedic | +0.77 | 6.2% | 2349 |
| local | +0.69 | 6.4% | 4052 |
#### `v1.1+item6`: 2000 matches, 9 draws, 0 engine errors
- First player (turn-1 initiative), symmetric games: **51.0% [48.6–53.5] (n=1640)**
- Decided early: 4.1% of decisive games locked in during the first third, 12.6% by half-time
- Skill: greedy>maxpower 51.0% (n=147), lookahead-lite>greedy 70.0% (n=100), greedy>random 82.7% (n=104)
| starters (row vs col) | field-guide | headliners | pioneers | stargazers | vs all decks |
|---|---|---|---|---|---|
| field-guide | – | 50% (n=52) | 50% (n=52) | 53% (n=55) | 49.7% |
| headliners | 50% (n=52) | – | 58% (n=55) | 48% (n=54) | 56.1% |
| pioneers | 50% (n=52) | 42% (n=55) | – | 42% (n=57) | 49.7% |
| stargazers | 47% (n=55) | 52% (n=54) | 58% (n=57) | – | 51.9% |
| owned (random 12 from card-sample) vs | field-guide | headliners | pioneers | stargazers | all |
|---|---|---|---|---|---|
| owned-0 | 48% | 41% | 50% | 39% | 47.1% |
| owned-1 | 41% | 44% | 47% | 52% | 47.2% |
| owned-2 | 57% | 36% | 38% | 51% | 48.8% |
| owned-3 | 60% | 41% | 49% | 49% | 49.4% |
| **all owned** | **51%** (n=233) | **41%** (n=197) | **46%** (n=200) | **48%** (n=198) | |
| keyword | power per card | games decided by it | cards played |
|---|---|---|---|
| rising | +1.72 | 14.2% | 1546 |
| translated | +1.69 | 17.0% | 4787 |
| nostalgic | +1.68 | 13.2% | 1709 |
| viral | +1.15 | 8.8% | 1924 |
| encyclopedic | +0.79 | 6.7% | 2403 |
| local | +0.70 | 6.7% | 4127 |
### TL;DR for the council (report v1, 00:25; see the v1.1 re-run above for the updated recommendation)
1. **Seat and initiative are fine:** 51.5% [49.6–53.5] for the turn-1 initiative holder (n = 2,421 symmetric games), and seat 0 51.2%. Draws are 0.4%. The tie-break (total power) decides 4.7% of games. *This full-field run started before the bot-side queue-count fix (PR #14); the effect is at most a 0.02 nudge to the heuristic. The focused starters run, after the fix, gives a borderline 53.4% [51.0–55.8] under v1 and **51.0% [48.6–53.4]** under the recommended v1.1. Initiative only matters through reveal order, and v1.1 removes most of the order-sensitive power.*
2. **Keyword values are lopsided, confirming the critic's figures within 0.2:**
@@ -46,7 +142,7 @@ Owner: sim-balance (claude/wikideck#4). Harness: `shared/bots/`, `scripts/sim/`
| 3 | viral: "+1, plus +1 per earlier reveal this turn, max +3" (critic) | viral +0.19; buffing amount/cap alone gives +0.24 | **adopt.** It needs the base +1. |
| 4 | encyclopedic: "+2 if *you* have no other cards here" (critic) | +0.19; amount 3 alone gives +0.33 | **adopt.** It needs the condition change. |
| 5 | Culture takes its home-stat keyword (critic) | owned decks drop from 51% viral to 18% | see the v1.1 results |
| 6 | `nostalgic.powerDelta -1`, `translated.powerDelta -1` | +1.45 / +1.53 per card, close to rising. Without them Field Guide beats Headliners 60% under 1–5. | **adopt**: with 1–6, every starter pairing is 45–55% |
| 6 | `nostalgic.powerDelta -1`, `translated.powerDelta -1` | +1.45 / +1.53 per card, close to rising. Without them Field Guide beats Headliners 60% under 1–5 (approximated hooks). | **optional, v1.2**: see the v1.1 re-run above |
| 7 | No change for heavy or swarm | no lever fixes both | – |
| 8 | No change for seat or initiative | 48–52% target met | – |