Directories
¶
| Path | Synopsis |
|---|---|
|
Command lessons-bench runs the active experiment: does the seamark lessons hook change what a headless agent writes? Two arms differing in exactly one bit (the hook wired or absent), a fresh synthetic or pinned-public worktree per trial, a frozen task, and a deterministic judge.
|
Command lessons-bench runs the active experiment: does the seamark lessons hook change what a headless agent writes? Two arms differing in exactly one bit (the hook wired or absent), a fresh synthetic or pinned-public worktree per trial, a frozen task, and a deterministic judge. |
|
Command lessons-bench-prepare materializes immutable public-repository source and offline dependencies before a lessons benchmark run.
|
Command lessons-bench-prepare materializes immutable public-repository source and offline dependencies before a lessons benchmark run. |
|
Command lessons-bench-report renders explicit benchmark JSONL inputs into a deterministic Markdown report evaluated against frozen claims.
|
Command lessons-bench-report renders explicit benchmark JSONL inputs into a deterministic Markdown report evaluated against frozen claims. |
|
Command seamark is the CLI entry point.
|
Command seamark is the CLI entry point. |
|
Command skills-bench runs the skills workflow experiment: does installing the seamark agent skills change what a headless agent does on a companion-file task, compared with the seamark MCP server alone? Two arms that differ in exactly one thing (the skills installed and callable, or not), a fresh fixture whose history carries the companion pair, a frozen task, and the lessons benchmark's deterministic judges.
|
Command skills-bench runs the skills workflow experiment: does installing the seamark agent skills change what a headless agent does on a companion-file task, compared with the seamark MCP server alone? Two arms that differ in exactly one thing (the skills installed and callable, or not), a fresh fixture whose history carries the companion pair, a frozen task, and the lessons benchmark's deterministic judges. |
|
Command skills-bench-report renders workflow result files, and optionally activation result files, into a deterministic Markdown report evaluated against the frozen workflow claims and activation criteria.
|
Command skills-bench-report renders workflow result files, and optionally activation result files, into a deterministic Markdown report evaluated against the frozen workflow claims and activation criteria. |
Click to show internal directories.
Click to hide internal directories.