Directories
¶
| Path | Synopsis |
|---|---|
|
whetstone
Package whetstone implements the whetstone CLI: the authoring front end for the skill specification, generation, lint, contract, and suite engine under internal/eval, plus the evaluation commands (eval, drift, repair, report) built on top of it.
|
Package whetstone implements the whetstone CLI: the authoring front end for the skill specification, generation, lint, contract, and suite engine under internal/eval, plus the evaluation commands (eval, drift, repair, report) built on top of it. |
|
whetstone/gen
Package gen writes a skill bundle from an approved spec.
|
Package gen writes a skill bundle from an approved spec. |
|
cmd
|
|
|
migrate
command
|
|
|
server
command
|
|
|
skael
command
|
|
|
skael-worker
command
Command skael-worker runs the eval queue's claim/materialise/evaluate/report loop against real infrastructure: a Docker sandbox, the direct Anthropic API gateway, and the linked-in agent adapter registry.
|
Command skael-worker runs the eval queue's claim/materialise/evaluate/report loop against real infrastructure: a Docker sandbox, the direct Anthropic API gateway, and the linked-in agent adapter registry. |
|
whetstone
command
Command whetstone is the standalone skill authoring and evaluation CLI.
|
Command whetstone is the standalone skill authoring and evaluation CLI. |
|
internal
|
|
|
contest
Package contest decides which of two or more candidate skill versions is better, from runs measured side by side.
|
Package contest decides which of two or more candidate skill versions is better, from runs measured side by side. |
|
eval/agent
Package agent defines the interface every coding-agent CLI is driven through.
|
Package agent defines the interface every coding-agent CLI is driven through. |
|
eval/derive
Package derive builds an eval suite for a skill that has none, by recovering a spec from the bundle and drafting evals from it.
|
Package derive builds an eval suite for a skill that has none, by recovering a spec from the bundle and drafting evals from it. |
|
eval/lint
Package lint validates a skill bundle across three layers: spec conformance, quality, and injection (security scan).
|
Package lint validates a skill bundle across three layers: spec conformance, quality, and injection (security scan). |
|
eval/llm
Package llm is the single seam through which every model call passes.
|
Package llm is the single seam through which every model call passes. |
|
eval/llm/agentcli
Package agentcli implements the LLM gateway by shelling out to a coding-agent CLI in print mode, billing to the operator's existing subscription.
|
Package agentcli implements the LLM gateway by shelling out to a coding-agent CLI in print mode, billing to the operator's existing subscription. |
|
eval/llm/api
Package api implements the LLM gateway against a direct Anthropic-compatible HTTP endpoint.
|
Package api implements the LLM gateway against a direct Anthropic-compatible HTTP endpoint. |
|
eval/llm/fake
Package fake provides an in-memory Gateway for tests.
|
Package fake provides an in-memory Gateway for tests. |
|
eval/propose
Package propose turns what a candidate missed in a contest into one change to the skill's prose.
|
Package propose turns what a candidate missed in a contest into one change to the skill's prose. |
|
eval/provider
Package provider is the one place the environment is mapped onto an LLM backend.
|
Package provider is the one place the environment is mapped onto an LLM backend. |
|
eval/report
Package report defines the machine-readable result of an eval run: the schema a CI job reads, the worker posts, and the UI charts.
|
Package report defines the machine-readable result of an eval run: the schema a CI job reads, the worker posts, and the UI charts. |
|
eval/runner
Package runner plans and executes an evaluation: which sessions to run, in what environment, with what resumed from a previous attempt.
|
Package runner plans and executes an evaluation: which sessions to run, in what environment, with what resumed from a previous attempt. |
|
eval/sandbox
Package sandbox is the seam every evaluation run executes through.
|
Package sandbox is the seam every evaluation run executes through. |
|
eval/sandbox/docker
Package docker implements the sandbox driver on the Docker CLI.
|
Package docker implements the sandbox driver on the Docker CLI. |
|
eval/sandbox/imagespec
Package imagespec renders everything an image needs as text: the base Dockerfile, a per-skill layer over it, the proxy configuration that enforces a network allowlist, and the digest that makes a layer cacheable.
|
Package imagespec renders everything an image needs as text: the base Dockerfile, a per-skill layer over it, the proxy configuration that enforces a network allowlist, and the digest that makes a layer cacheable. |
|
eval/sandbox/kubernetes
Package kubernetes implements the sandbox driver on the Kubernetes API.
|
Package kubernetes implements the sandbox driver on the Kubernetes API. |
|
eval/sandbox/northflank
Package northflank implements the sandbox driver on Northflank's API.
|
Package northflank implements the sandbox driver on Northflank's API. |
|
eval/sandbox/resolve
Package resolve is the one place the environment becomes a sandbox driver.
|
Package resolve is the one place the environment becomes a sandbox driver. |
|
eval/sandbox/sandboxtest
Package sandboxtest holds the contract every sandbox.Driver must satisfy.
|
Package sandboxtest holds the contract every sandbox.Driver must satisfy. |
|
eval/spec
Package spec holds the SkillSpec IR that generation, suite drafting, and scoring all derive from.
|
Package spec holds the SkillSpec IR that generation, suite drafting, and scoring all derive from. |
|
eval/store
Package store owns the .whetstone/ workspace: SQLite index, completion cache, and the on-disk artifact layout.
|
Package store owns the .whetstone/ workspace: SQLite index, completion cache, and the on-disk artifact layout. |
|
eval/suite
Package suite is a skill's eval set: the evals/evals.json tasks it is measured against, the evals/triggers.json queries its description is measured against, and a shipped distractor pack that makes a trigger measurement discriminating.
|
Package suite is a skill's eval set: the evals/evals.json tasks it is measured against, the evals/triggers.json queries its description is measured against, and a shipped distractor pack that makes a trigger measurement discriminating. |
|
eval/suite/assets
Package assets embeds the static suite assets.
|
Package assets embeds the static suite assets. |
|
eval/tune
Package tune optimizes a skill's description for trigger accuracy.
|
Package tune optimizes a skill's description for trigger accuracy. |
|
evalqueue
Package evalqueue is the eval job queue, backed by Postgres claim/lease/heartbeat.
|
Package evalqueue is the eval job queue, backed by Postgres claim/lease/heartbeat. |
|
evalsuite
Package evalsuite is the registry-side counterpart to internal/eval/suite: evaluation task-suites become content-addressable artifacts stored alongside skill bundles, so a quality score can be re-run later against the exact same tasks with a different model panel.
|
Package evalsuite is the registry-side counterpart to internal/eval/suite: evaluation task-suites become content-addressable artifacts stored alongside skill bundles, so a quality score can be re-run later against the exact same tasks with a different model panel. |
|
gate
Package gate decides whether a skill version may be published, held for review, or refused outright.
|
Package gate decides whether a skill version may be published, held for review, or refused outright. |
|
ownership
Package ownership resolves who owns a skill name and who may manage a pattern.
|
Package ownership resolves who owns a skill name and who may manage a pattern. |
|
quality
Package quality stores and retrieves per-version quality scores.
|
Package quality stores and retrieves per-version quality scores. |
|
testutil
Package testutil provides the Postgres a DB-backed test runs against.
|
Package testutil provides the Postgres a DB-backed test runs against. |
|
worker
Package worker implements the eval queue worker's run loop: claim, materialise, evaluate, report.
|
Package worker implements the eval queue worker's run loop: claim, materialise, evaluate, report. |
Click to show internal directories.
Click to hide internal directories.




