providers

type Embedder ¶

type Embedder interface {
	Embed(context.Context, embedding.Request) (embedding.Response, usage.Usage, error)
}

Embedder is an optional interface for providers that support embedding.

type ModelLoader ¶

type ModelLoader interface {
	LoadModel(ctx context.Context, name string) error
	UnloadModel(ctx context.Context, name string) error
}

ModelLoader is an optional interface for providers that support explicit model load/unload.

type Provider ¶

type Provider interface {
	Chat(context.Context, request.Request, stream.Func) (message.Message, usage.Usage, error)
	Models(context.Context) (model.Models, error)
	Model(context.Context, string) (model.Model, error)
	Estimate(context.Context, request.Request, string) (int, error)
}

Provider defines the core interface for LLM provider implementations.

type RateLimitError ¶

type RateLimitError struct {
	RetryAfter time.Duration
	Err        error
}

RateLimitError carries retry metadata alongside the ErrRateLimit sentinel. RetryAfter is parsed from the Retry-After header where available (Anthropic, OpenAI). Providers without header access (Google, Ollama, OpenRouter) get DefaultRetryAfter.

func (e *RateLimitError) Error() string

func (e *RateLimitError) Is(target error) bool

func (e *RateLimitError) Unwrap() error

type Reranker ¶

type Reranker interface {
	Rerank(context.Context, rerank.Request) (rerank.Response, error)
}

Reranker is an optional interface for providers that support reranking.

type RetryProvider ¶

type RetryProvider struct {
	Provider // embedded for pass-through of Models, Model, Estimate, etc.
	Bo       backoff.BackOff
}

RetryProvider wraps a Provider with exponential-backoff retry logic for Chat(). All other Provider methods pass through to the embedded provider unchanged.

Retry is stream-safe: once the stream callback has been invoked (partial content emitted to the terminal), the error is marked permanent and no retry is attempted.

Fields are exported because the factory creating RetryProvider lives in internal/providers/ (different package).

func (r *RetryProvider) Chat(ctx context.Context, req request.Request, fn stream.Func) (message.Message, usage.Usage, error)

func (r *RetryProvider) Unwrap() Provider

type Synthesizer ¶

type Synthesizer interface {
	Synthesize(context.Context, synthesize.Request) (synthesize.Response, error)
}

Synthesizer is an optional interface for providers that support speech synthesis.

type Transcriber ¶

type Transcriber interface {
	Transcribe(context.Context, transcribe.Request) (transcribe.Response, error)
}

Transcriber is an optional interface for providers that support audio transcription.