Documentation
¶
Overview ¶
Package judge evaluates arbitrary subjects with a structured-output chat model. Subject validation and prompt construction remain owned by callers.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Config ¶
type Config[T any] struct { Model chat.Model Metric eval.Metric Prompt Prompt[T] Options chat.Options // Threshold is optional. Without one, evaluation produces a score without // inventing a pass/fail decision. Threshold *eval.Score Samples int }
Config binds a portable metric and subject prompt to a structured-output model judge. Multiple samples use a deterministic median aggregation.
type Evaluator ¶
type Evaluator[T any] struct { // contains filtered or unexported fields }
Evaluator asks a chat model for normalized scores without teaching the eval kernel any domain vocabulary.
func NewEvaluator ¶
NewEvaluator freezes metric identity, options, threshold, and sampling policy.
Source Files
Click to show internal directories.
Click to hide internal directories.