llm

package

v0.0.9 Latest Latest Go to latest Published: Mar 31, 2026 License: MIT Imports: 3 Imported by: 0

Details

View Source

const DefaultMaxTokens = 1024

DefaultMaxTokens is used when MaxTokens is 0 and the provider requires it (e.g. Anthropic).

This section is empty.

This section is empty.

type LLMConfig struct {
	APIKey   string
	Model    string
	BaseURL  string
	Logger   log.Logger
	LogLevel string
}

func BuildConfig(opts ...Option) (*LLMConfig, error)

BuildConfig builds LLMConfig from options. Defaults when not set:

Sampling (Temperature, MaxTokens, TopP, TopK) is per-agent—use agent.WithTemperature etc.

type Option func(*LLMConfig)

func WithAPIKey(apiKey string) Option

func WithBaseURL(baseURL string) Option

func WithLogLevel(level string) Option

func WithLogger(logger log.Logger) Option

func WithModel(model string) Option