Documentation
¶
Index ¶
- Constants
- type BenchmarkConfigdeprecated
- type EvalConfig
- func (c *EvalConfig) ContextRoot() string
- func (c *EvalConfig) FixtureDir() string
- func (c *EvalConfig) LogPath() string
- func (c *EvalConfig) OutputPath() string
- func (c *EvalConfig) Spec() *models.EvalSpec
- func (c *EvalConfig) SpecDir() string
- func (c *EvalConfig) TranscriptDir() string
- func (c *EvalConfig) Verbose() bool
- type Option
- type RegistrySource
Constants ¶
const DefaultPublicRegistryURL = "https://github.com/waza-evals"
DefaultPublicRegistryURL is the built-in public registry index source.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type BenchmarkConfig
deprecated
type BenchmarkConfig = EvalConfig
Deprecated: Use EvalConfig instead.
type EvalConfig ¶ added in v0.31.0
type EvalConfig struct {
// contains filtered or unexported fields
}
EvalConfig is the main configuration with functional options.
Deprecated alias: BenchmarkConfig is provided for backward compatibility.
func NewBenchmarkConfig
deprecated
func NewBenchmarkConfig(spec *models.EvalSpec, opts ...Option) *EvalConfig
Deprecated: Use NewEvalConfig instead.
func NewEvalConfig ¶ added in v0.31.0
func NewEvalConfig(spec *models.EvalSpec, opts ...Option) *EvalConfig
NewEvalConfig creates a new configuration with options
func (*EvalConfig) ContextRoot ¶ added in v0.31.0
func (c *EvalConfig) ContextRoot() string
func (*EvalConfig) FixtureDir ¶ added in v0.31.0
func (c *EvalConfig) FixtureDir() string
func (*EvalConfig) LogPath ¶ added in v0.31.0
func (c *EvalConfig) LogPath() string
func (*EvalConfig) OutputPath ¶ added in v0.31.0
func (c *EvalConfig) OutputPath() string
func (*EvalConfig) SpecDir ¶ added in v0.31.0
func (c *EvalConfig) SpecDir() string
func (*EvalConfig) TranscriptDir ¶ added in v0.31.0
func (c *EvalConfig) TranscriptDir() string
func (*EvalConfig) Verbose ¶ added in v0.31.0
func (c *EvalConfig) Verbose() bool
type Option ¶
type Option func(*EvalConfig)
Option is a functional option for EvalConfig
func WithContextRoot ¶
WithContextRoot is an alias for WithFixtureDir for compatibility
func WithFixtureDir ¶
WithFixtureDir sets the fixture directory (for loading resource files)
func WithOutputPath ¶
WithOutputPath sets the output file path
func WithSpecDir ¶
WithSpecDir sets the spec directory (for resolving test patterns)
func WithTranscriptDir ¶
WithTranscriptDir sets the directory for per-task transcript files
type RegistrySource ¶ added in v0.38.6
type RegistrySource struct {
Name string `yaml:"name" json:"name"`
URL string `yaml:"url" json:"url"`
Priority int `yaml:"priority,omitempty" json:"priority,omitempty"`
}
RegistrySource describes one configured registry index source used for discovery. Resolver/package content remains canonical outside the index.
func DefaultRegistrySources ¶ added in v0.38.6
func DefaultRegistrySources() []RegistrySource
DefaultRegistrySources returns the built-in public registry sources.