Documentation
¶
Overview ¶
Package ai wires the Genkit runtime and the SpeechKit model catalog into a single LLM/embedding/reranker surface used by Assist and the Voice Agent pipeline-fallback path.
It owns provider keys, model selection, OpenAI-compatible model registration, and the per-Modality plumbing (Utility, Assist, Agent). Routing decisions live in github.com/kombifyio/SpeechKit/internal/router and github.com/kombifyio/SpeechKit/internal/tts; this package is the model substrate they call into.
Index ¶
Constants ¶
This section is empty.
Variables ¶
var AICallValidation = netsec.ValidationOptions{}
AICallValidation controls URL validation for OpenAI-compatible LLM calls. Zero value = strict (public https only). Tests relax it to allow loopback.
Functions ¶
This section is empty.
Types ¶
type Config ¶
type Config struct {
GoogleAPIKey string
OpenAIAPIKey string
GroqAPIKey string
HuggingFaceToken string
OllamaBaseURL string
LocalLLMBaseURL string
GoogleUtilityModel string
GoogleAssistModel string
GoogleAgentModel string
OpenAIUtilityModel string
OpenAIAssistModel string
OpenAIAgentModel string
GroqUtilityModel string
GroqAssistModel string
GroqAgentModel string
HFUtilityModel string
HFAssistModel string
HFAgentModel string
LocalLLMUtilityModel string
LocalLLMAssistModel string
LocalLLMAgentModel string
OllamaUtilityModel string
OllamaAssistModel string
OllamaAgentModel string
OpenRouterAPIKey string
OpenRouterUtilityModel string
OpenRouterAssistModel string
OpenRouterAgentModel string
OrderedAssistModels []OrderedModelSelection
OrderedAgentModels []OrderedModelSelection
UseOrderedAssistModels bool
UseOrderedAgentModels bool
}
Config holds all provider API keys and model selections for Genkit initialization.
type ModelInfo ¶
type ModelInfo struct {
ID string `json:"id"`
Provider string `json:"provider"`
Name string `json:"name"`
Tier string `json:"tier"` // e.g. "utility", "assist", "agent", "utility+assist", or "all"
}
ModelInfo describes a registered model for the UI.
type OrderedModelSelection ¶ added in v0.21.1
type Runtime ¶
Runtime holds the Genkit instance and categorized model references.
func (*Runtime) AgentModels ¶
AgentModels returns the models configured for agent tasks (reasoning, autonomous).
func (*Runtime) AssistModels ¶ added in v0.18.0
AssistModels returns the models configured for direct Assist replies.
func (*Runtime) ModelInfos ¶
ModelInfos returns metadata about all registered models for the UI.
func (*Runtime) UtilityModels ¶
UtilityModels returns the models configured for utility tasks (summarize, codewords).
Source Files
Directories