ollama

package module

v0.0.0-...-ac6641e Latest Latest Go to latest Published: Mar 20, 2025 License: Apache-2.0 Imports: 5 Imported by: 0

Details

The Ollama provider for agent-api

👷🏗️ The Ollama provider is a work in progress and the API may change unexpectedly.

This section is empty.

This section is empty.

This section is empty.

type Provider struct {
	// contains filtered or unexported fields
}

Provider implements the LLMProvider interface for Ollama

func NewProvider(opts *ProviderOpts) *Provider

NewProvider creates a new Ollama provider

TODO: - need to handle base URL better (with trailing slashes, etc.) - need to construct actual URL using baseURL, port, etc.

func (p *Provider) Generate(ctx context.Context, opts *core.GenerateOptions) (*core.Message, error)

Generate implements the LLMProvider interface for basic responses

func (p *Provider) GenerateStream(ctx context.Context, opts *core.GenerateOptions) (<-chan *core.Message, <-chan string, <-chan error)

GenerateStream streams the response token by token

func (p *Provider) GetCapabilities(ctx context.Context) (*core.Capabilities, error)

func (p *Provider) UseModel(ctx context.Context, model *core.Model) error

type ProviderOpts struct {
	BaseURL string
	Port    int
	Logger  *logr.Logger
}

Path	Synopsis
client
models