`make bot-matches` failed on its default seeds because its difficulty checks (easy places worst, hard takes the most eliminations) are noisier than the differences they look for over 20 matches. Measured on three 20-seed batches (seeds 1-20, 21-40, 101-120): easy bots won 0, 4 and 2 matches against an even share of 6.7, and took the fewest eliminations every time. Mean place doesn't separate the levels, and hard is not reliably ahead of normal by any whole-match measure. The batch now checks that easy bots win less than an even share and take the fewest eliminations, and skips the difficulty checks under 20 matches, where they mean nothing. Hard against easy stays covered by the duel test. Closes #76 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
56 lines
1.7 KiB
Makefile
56 lines
1.7 KiB
Makefile
# Tidewall build entry points. Everything runs headless with the repo-local engine.
|
|
GODOT := tools/godot.sh
|
|
|
|
.PHONY: check import parse test test-selfcheck smoke capture-test terrain-capture binaries verify-engine bot-matches match match-captures
|
|
|
|
## Everything that must pass before a push.
|
|
check: verify-engine binaries parse test test-selfcheck smoke
|
|
|
|
verify-engine:
|
|
@$(GODOT) --verify
|
|
|
|
binaries:
|
|
@tools/check_binaries.sh
|
|
|
|
## Refreshes Godot's global class cache, so class_name lookups resolve.
|
|
import:
|
|
@$(GODOT) --import --quit >/dev/null 2>&1 || true
|
|
|
|
parse: import
|
|
@$(GODOT) --script res://tools/parse_all.gd
|
|
|
|
test: import
|
|
@tools/run_tests.sh
|
|
|
|
## Proves the test runner detects each kind of failure.
|
|
test-selfcheck: import
|
|
@tools/test_selfcheck.sh
|
|
|
|
## Boots the headless server for 1,000 ticks and checks exit codes, logs and timing.
|
|
smoke: import
|
|
@tools/smoke.sh
|
|
|
|
## Plays 20 bot-only matches and checks each has a winner, few bots drown and easy
|
|
## bots do worst. Takes about ten minutes, so it isn't part of `check`.
|
|
## BOT_MATCH_SEEDS and BOT_MATCH_FIRST change how many seeds and where they start.
|
|
bot-matches: import
|
|
@tools/bot_matches.sh
|
|
|
|
## Plays one whole offline match, lobby to results, with a scripted player and 23 bots,
|
|
## then replays its command log and checks the replay ends in the same state.
|
|
## MATCH_SEED picks the seed.
|
|
match: import
|
|
@tools/match.sh
|
|
|
|
## Renders each stage of the match `make match` last played. Needs Docker.
|
|
match-captures: import
|
|
@tools/match_captures.sh
|
|
|
|
## Renders the capture test scenes in the offscreen container. Needs Docker.
|
|
capture-test: import
|
|
@tools/capture_selfcheck.sh
|
|
|
|
## Renders the terrain crack check and its control in the offscreen container. Needs Docker.
|
|
terrain-capture: import
|
|
@tools/terrain_capture_check.sh
|