Documentation
¶
Overview ¶
Package suite defines evaluation suites — named collections of test cases targeting a specific system prompt, model, and optional persona.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type ListFilter ¶
ListFilter constrains suite listing.
type Store ¶
type Store interface {
CreateSuite(ctx context.Context, s *Suite) error
GetSuite(ctx context.Context, suiteID id.SuiteID) (*Suite, error)
GetSuiteByName(ctx context.Context, appID, name string) (*Suite, error)
UpdateSuite(ctx context.Context, s *Suite) error
DeleteSuite(ctx context.Context, suiteID id.SuiteID) error
ListSuites(ctx context.Context, filter *ListFilter) ([]*Suite, error)
}
Store defines persistence operations for evaluation suites.
type Suite ¶
type Suite struct {
sentinel.Entity
ID id.SuiteID `json:"id" bun:"id,pk"`
Name string `json:"name" bun:"name,notnull"`
Description string `json:"description" bun:"description"`
AppID string `json:"app_id" bun:"app_id,notnull"`
SystemPrompt string `json:"system_prompt" bun:"system_prompt"`
Model string `json:"model" bun:"model,notnull"`
Temperature float64 `json:"temperature" bun:"temperature,notnull,default:0"`
PersonaRef string `json:"persona_ref,omitempty" bun:"persona_ref"`
Metadata map[string]any `json:"metadata" bun:"metadata,type:jsonb,default:'{}'"`
}
Suite is an evaluation suite that groups test cases together.
Click to show internal directories.
Click to hide internal directories.