providers

package

v0.7.0 Latest Latest Go to latest Published: May 4, 2026 License: MIT Imports: 8 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type CompletionRequest struct {
	SystemPrompt string
	UserPrompt   string
	MaxTokens    int
}

CompletionRequest is a chat completion request.

type EmbeddingProvider interface {
	Embed(ctx context.Context, texts []string) ([][]float32, error)
	Dimension() int
	ModelName() string
}

EmbeddingProvider generates vector embeddings for text.

func NewEmbedding(cfg *config.EmbeddingProviderConfig) EmbeddingProvider

NewEmbedding creates an EmbeddingProvider for an OpenAI-compatible /v1/embeddings endpoint.

type GenerationProvider interface {
	Complete(ctx context.Context, req CompletionRequest) (string, error)
	ModelName() string
}

GenerationProvider generates text completions.

func NewGeneration(cfg *config.GenerationProviderConfig) GenerationProvider

NewGeneration creates a GenerationProvider for an OpenAI-compatible /v1/chat/completions endpoint.

type RerankProvider interface {
	Rerank(ctx context.Context, query string, passages []string) ([]float64, error)
	ModelName() string
}

RerankProvider scores candidate passages for relevance to a query.

func NewRerank(cfg *config.RerankProviderConfig) RerankProvider

NewRerank creates a RerankProvider for a rerank API endpoint.