eval

Overview ¶

Command eval runs the search quality evaluation harness against NornicDB.

Usage:

go run ./cmd/eval [flags]

Flags:

-url        NornicDB server URL (default: http://localhost:7474)
-suite      Path to test suite JSON file
-output     Output format: summary, detailed, json, compact (default: summary)
-save       Save results to JSON file
-threshold  Override pass/fail thresholds (format: p10=0.5,mrr=0.5,hit=0.8)

This command evaluates search quality by: 1. Connecting to a running NornicDB server 2. Running test queries against the search API 3. Computing IR metrics (Precision, Recall, MRR, NDCG) 4. Reporting pass/fail based on thresholds