llm

package

v1.2.0 Latest Latest Go to latest Published: Aug 14, 2025 License: MIT Imports: 9 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type OllamaProvider struct {
	// contains filtered or unexported fields
}

OllamaProvider implements the LLMProvider interface for Ollama

func NewOllamaProvider(host string) *OllamaProvider

NewOllamaProvider creates a new Ollama provider

func (o *OllamaProvider) Complete(ctx context.Context, req ai.CompletionRequest) (*ai.CompletionResponse, error)

Complete generates a completion for the given request

func (o *OllamaProvider) Dimension() int

Dimension returns the embedding dimension

func (o *OllamaProvider) Embed(ctx context.Context, text string) ([]float64, error)

Embed generates an embedding for the given text (if model supports it)

func (o *OllamaProvider) EmbedBatch(ctx context.Context, texts []string) ([][]float64, error)

EmbedBatch generates embeddings for multiple texts

func (o *OllamaProvider) IsConfigured() bool

IsConfigured checks if the provider is properly configured

func (o *OllamaProvider) ListModels(ctx context.Context) ([]string, error)

ListModels returns available models

func (o *OllamaProvider) Name() string

Name returns the provider name

func (o *OllamaProvider) Stream(ctx context.Context, req ai.CompletionRequest) (<-chan string, error)

Stream generates a streaming completion