audit

type CostEstimator ¶

type CostEstimator interface {
	Estimate(provider, model string, inputTokens, outputTokens int) float64
}

CostEstimator prices one turn. → the caller's loop.CostEstimator, or defaults.ZeroCost

type ModelIdentifier ¶

type ModelIdentifier interface {
	Identity() (provider, model string)
}

ModelIdentifier names the provider and model for each turn. It is asked once per turn, so it may change during a run. → the caller's loop.ModelIdentifier, or defaults.NoIdentity

type Recorder ¶

type Recorder struct {
	// contains filtered or unexported fields
}

func NewRecorder(identity ModelIdentifier, cost CostEstimator, stopLabel string) *Recorder

func (r *Recorder) Record(t Turn) event.LLMTurnData

type Turn ¶

type Turn struct {
	Index         int
	InputTokens   int
	OutputTokens  int
	Request       []*schema.Message
	Reply         *schema.Message
	DurationMs    int64
	MaxIterations int
}

Turn is what happened in one model call.