gauntlet

Overview ¶

gauntlet runs choudoufu's real-estate test suite against stock OpenTofu and renders everything the project says about its own progress from the result. live/GAUNTLET.md, rendered by this tool, is the contract.

go run ./tools/gauntlet render                 # regenerate artifact, spec, site pages
go run ./tools/gauntlet next [-n N] [-json]    # the next unit(s) of work, deterministically
go run ./tools/gauntlet run [-set core] [-parallel N] [name] # run crossing scripts, record verdicts, render
go run ./tools/gauntlet behaviors [-all] [-port N] [-parallel N] [id...] # run the tier-1 behavior matrix (#522), record verdicts, render
go run ./tools/gauntlet add <name> <url> <ref> -lane <lane> -source "..." [-core -reason "..."]
go run ./tools/gauntlet import-legacy          # one-time seed from live/corpus-crossing-manifest.json
go run ./tools/gauntlet snapshot <version>     # copy the artifact to live/history/<version>.json
go run ./tools/gauntlet notes <old.json> <new.json> # release-highlights markdown from a snapshot diff
go run ./tools/gauntlet set-notes -estate <name> -file <path> # replace one row's free-text notes and nothing else (#1374)
go run ./tools/gauntlet check                  # exit 1 if a rendered file is stale; always prints which rows predate their own estate script (#1264, reported, never fatal)
go run ./tools/gauntlet estates [-set core|all] [-json] [name...] # the estates one CI run measures, from the manifest: the matrix the board is sharded over (#1550)
go run ./tools/gauntlet combine-shards -shards <dir> [-set core|all | -estates 'a b'] [-kind-image DIGEST] # fold one shard-per-estate CI run back into one live/gauntlet.json (#1550)
go run ./tools/gauntlet merge-artifact <base> <ours> <theirs> # row-granular artifact merge across sibling estate PRs (#488)
go run ./tools/gauntlet merge-rendered <path> <ours-file> # git merge driver for the rendered files: keep ours whole, re-render after (#1308)
go run ./tools/gauntlet scale-backfill [rev...]  # regenerate live/gauntlet-scale.json (#1051) from live/gauntlet.json at HEAD and, optionally, past revisions
go run ./tools/gauntlet scale-import-slice [-estate name] <slice_out.json> # merge a slicing-bench SLICE_OUT report's plan_calls (the CLI cold/warm plan pair) and audit_calls (the CollectUnclaimed sweep) into live/gauntlet-scale.json (#1053)
go run ./tools/gauntlet scale-patch-seconds -estate E -target T -scale N [-stage id=seconds]... [-note text] [-accounting-inconsistent] # patch an existing ScaleRecord's stage wall-durations from a source scale-backfill cannot read, or name a record's own arithmetic as a known inconsistency (#1051/#1053/#1069)
go run ./tools/gauntlet backfill-stage-provenance [-n] # one-shot, re-runnable: write per-stage provenance (#1069) into every committed row the artifact can honestly support one for