benchmarks/

Tok Benchmark Publication Workflow

This directory is the publication surface for Tok benchmarks.

It complements:

• tok/benchmarks/run.sh for the offline quality and root-package benchmark wrapper
• tok/evals/pipeline-bench.sh for pipeline latency and allocation benchmarks
• tok/benchmarks/quality/ for the offline compression-quality harness
• tok/benchmarks/manifests/ for machine-readable suite definitions

Official suite ids

• tok-quality-core
• tok-pipeline-microbench

See the Hawk-side benchmark registry at hawk/docs/benchmarks/SUITES.md.

Current published baselines

• tok-quality-core: results/tok-quality-core/2026-06-27/
• tok-pipeline-microbench: results/tok-pipeline-microbench/2026-06-27/

Current runnable commands

/bin/zsh -lc 'GOCACHE=$PWD/.gocache ./benchmarks/run.sh'
/bin/zsh -lc 'GOCACHE=$PWD/.gocache ./evals/pipeline-bench.sh'

Publication layout

Recommended committed layout:

benchmarks/
  README.md
  manifests/
    tok-quality-core.yaml
    tok-pipeline-microbench.yaml
  results/
    tok-quality-core/
      2026-06-27/
        report.md
        result.txt
        notes.md
    tok-pipeline-microbench/
      2026-06-27/
        report.md
        result.txt
        notes.md

Promotion rule

Do not cite a Tok benchmark as evidence in cross-project comparison docs unless:

1. the command used is recorded
2. the repo state is identified as a committed snapshot or workspace snapshot
3. the benchmark scope is stated clearly
4. the raw output or generated report is committed