ollama

type Client ¶

type Client struct {
	*core.BaseClient
}

Client is an Ollama LLM client.

Ollama allows you to run large language models locally on your machine. This client connects to a local Ollama server (default: localhost:11434) and provides the same interface as cloud-based providers.

No API key is required. The client uses a longer default timeout (60s) since local models may take more time to generate responses.

func DefaultOllamaClient() (*Client, error)

func NewOllamaClient(config core.Config) (*Client, error)

func (c *Client) Chat(ctx context.Context, messages []core.Message, opts ...core.Option) (*core.Response, error)

func (c *Client) ChatStream(ctx context.Context, messages []core.Message, opts ...core.Option) (*core.Stream, error)