piguard-eval

Overview ¶

piguard-eval is an offline evaluation harness for the piguard heuristics detector.

Reads a manifest JSONL (one EmailRecord per line) from --manifest or stdin, screens each .eml with the built-in HeuristicsDetector, and writes one prediction JSON line per message to stdout.

Usage:

piguard-eval --base-dir /path/to/e2a-paper --manifest dataset/prompt-injection/manifest.jsonl
cat combined.jsonl | piguard-eval --base-dir /path/to/e2a-paper