Documentation
¶
Overview ¶
Package llmapi defines LLM and tool-calling interfaces so that implementers (e.g. openai) and consumers (e.g. mcp) can depend on it without import cycles with the full services package.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type LLMService ¶
type LLMService interface {
Chat(ctx context.Context, messages []map[string]any, onToken func(*frames.LLMTextFrame)) error
}
LLMService provides chat completion; may stream text frames.
type LLMServiceWithTools ¶
type LLMServiceWithTools interface {
LLMService
RegisterTool(schema schemas.FunctionSchema, handler ToolHandler)
ToolsSchema() *schemas.ToolsSchema
}
LLMServiceWithTools is an LLM service that supports registering tools (e.g. from MCP).
Source Files
Click to show internal directories.
Click to hide internal directories.