report

package
v0.2.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 28, 2026 License: Apache-2.0 Imports: 8 Imported by: 0

Documentation

Overview

Package report aggregates scenario results and renders them: a human-readable stdout summary, a machine-readable JSON file, and per-scenario diagnostic dumps (see dump.go). There is deliberately no overall pass/fail field — the final OK/NG decision is a human's; the report only presents per-check verdicts and an informational pass ratio.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func ComputeScore

func ComputeScore(verdicts []evaltype.CheckVerdict) evaltype.Score

ComputeScore counts passed checks over total.

func Dump

func Dump(dir string, r evaltype.ScenarioResult, traces map[string]json.RawMessage, language string) (string, error)

Dump writes the diagnostic bundle for one scenario under <dir>/<scenario-id>/<eval-id>/ and returns that directory. traces is the raw gollem trace snapshot (keyed sessionID/traceID).

func Summary

func Summary(w io.Writer, results []evaltype.ScenarioResult, opts SummaryOptions) error

Summary writes the human-readable summary to w.

func WriteJSON

func WriteJSON(path string, results []evaltype.ScenarioResult) error

WriteJSON writes the machine-readable report to path.

Types

type SummaryOptions

type SummaryOptions struct {
	Quiet   bool
	Verbose bool
}

SummaryOptions controls stdout rendering verbosity.

type Totals

type Totals struct {
	Scenarios    int `json:"scenarios"`
	RunOK        int `json:"run_ok"`
	Errors       int `json:"errors"`
	ChecksPassed int `json:"checks_passed"`
	ChecksTotal  int `json:"checks_total"`
}

Totals is the suite-level roll-up.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL