pig-evals

command
v0.5.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 22, 2026 License: MIT Imports: 9 Imported by: 0

Documentation

Overview

Command pig-evals runs PiG's documentation evals, the Go port of Pi's packages/evals.

pig-evals docs [--provider P --model M] [--runs-per-variant N] [-t PATTERN] [FILE...]

builds the without_docs and with_docs images, runs every planned case in a fresh container and writes the paired comparison under internal/evals/.eval (src/cli.ts). Inside an image the same binary is the entry point (`pig-evals entrypoint`, docker/entrypoint.ts) and runs the suites.

pig-evals host [-t PATTERN] [FILE...]

runs the host evals on this machine (`vitest run --project host`) and writes vitest.json to the current directory.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL