Documentation
¶
Overview ¶
Package report aggregates scenario results and renders them: a human-readable stdout summary, a machine-readable JSON file, and per-scenario diagnostic dumps (see dump.go). There is deliberately no overall pass/fail field — the final OK/NG decision is a human's; the report only presents per-check verdicts and an informational pass ratio.
Index ¶
- func ComputeScore(verdicts []evaltype.CheckVerdict) evaltype.Score
- func Dump(dir string, r evaltype.ScenarioResult, traces map[string]json.RawMessage, ...) (string, error)
- func Summary(w io.Writer, results []evaltype.ScenarioResult, opts SummaryOptions) error
- func WriteJSON(path string, results []evaltype.ScenarioResult) error
- type SummaryOptions
- type Totals
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func ComputeScore ¶
func ComputeScore(verdicts []evaltype.CheckVerdict) evaltype.Score
ComputeScore counts passed checks over total.
func Dump ¶
func Dump(dir string, r evaltype.ScenarioResult, traces map[string]json.RawMessage, language string) (string, error)
Dump writes the diagnostic bundle for one scenario under <dir>/<scenario-id>/<eval-id>/ and returns that directory. traces is the raw gollem trace snapshot (keyed sessionID/traceID).
func Summary ¶
func Summary(w io.Writer, results []evaltype.ScenarioResult, opts SummaryOptions) error
Summary writes the human-readable summary to w.
Types ¶
type SummaryOptions ¶
SummaryOptions controls stdout rendering verbosity.