Documentation
¶
Overview ¶
Package ai wires the Genkit runtime and the SpeechKit model catalog into a single LLM/embedding/reranker surface used by Assist and the Voice Agent pipeline-fallback path.
It owns provider keys, model selection, OpenAI-compatible model registration, and the per-Modality plumbing (Utility, Assist, Agent). Routing decisions live in github.com/kombifyio/SpeechKit/internal/router and github.com/kombifyio/SpeechKit/internal/tts; this package is the model substrate they call into.
Index ¶
Constants ¶
This section is empty.
Variables ¶
var AICallValidation = netsec.ValidationOptions{}
AICallValidation controls URL validation for OpenAI-compatible LLM calls. Zero value = strict (public https only). Tests relax it to allow loopback.
Functions ¶
This section is empty.
Types ¶
type Config ¶
type Config struct {
GoogleAPIKey string
OpenAIAPIKey string
GroqAPIKey string
HuggingFaceToken string
OllamaBaseURL string
LocalLLMBaseURL string
// LocalLLMTransport wraps the HTTP transport that carries requests to the
// bundled local model server. The desktop host uses it to wake a server it
// paused to free memory and to notice when the server was last used. Nil
// leaves the transport as built.
LocalLLMTransport func(next http.RoundTripper) http.RoundTripper
GoogleUtilityModel string
GoogleAssistModel string
GoogleAgentModel string
OpenAIUtilityModel string
OpenAIAssistModel string
OpenAIAgentModel string
GroqUtilityModel string
GroqAssistModel string
GroqAgentModel string
HFUtilityModel string
HFAssistModel string
HFAgentModel string
LocalLLMUtilityModel string
LocalLLMAssistModel string
LocalLLMAgentModel string
OllamaUtilityModel string
OllamaAssistModel string
OllamaAgentModel string
OpenRouterAPIKey string
OpenRouterUtilityModel string
OpenRouterAssistModel string
OpenRouterAgentModel string
AssemblyAIAPIKey string
AssemblyAILLMGatewayBaseURL string
AssemblyAIUtilityModel string
AssemblyAIAssistModel string
AssemblyAIAgentModel string
CloudflareAPIKey string
CloudflareAccountID string
CloudflareGatewayID string
CloudflareUtilityModel string
CloudflareAssistModel string
CloudflareAgentModel string
FoundryAPIKey string
// FoundryBearerToken mints a token per request when the Foundry resource
// is used with a Microsoft sign-in instead of the resource key. Either
// the key or the token source enables the Foundry models.
FoundryBearerToken speechkit.BearerTokenFunc
// FoundryBaseURL is the OpenAI-compatible base (https://<host>/openai/v1);
// FoundryMAIBaseURL serves Microsoft-publisher deployments such as
// MAI-Thinking-1 (https://<host>/mai/v1). Empty skips those deployments.
FoundryBaseURL string
FoundryMAIBaseURL string
FoundryUtilityModel string
FoundryAssistModel string
FoundryAgentModel string
OrderedAssistModels []OrderedModelSelection
OrderedAgentModels []OrderedModelSelection
UseOrderedAssistModels bool
UseOrderedAgentModels bool
}
Config holds all provider API keys and model selections for Genkit initialization.
type ModelInfo ¶
type ModelInfo struct {
ID string `json:"id"`
Provider string `json:"provider"`
Name string `json:"name"`
Tier string `json:"tier"` // e.g. "utility", "assist", "agent", "utility+assist", or "all"
}
ModelInfo describes a registered model for the UI.
type OrderedModelSelection ¶ added in v0.21.1
type Runtime ¶
Runtime holds the Genkit instance and categorized model references.
func (*Runtime) AgentModels ¶
AgentModels returns the models configured for agent tasks (reasoning, autonomous).
func (*Runtime) AssistModels ¶ added in v0.18.0
AssistModels returns the models configured for direct Assist replies.
func (*Runtime) Generator ¶ added in v0.67.0
func (r *Runtime) Generator() generation.Generator
Generator exposes the configured model pool through SpeechKit's provider-neutral generation boundary.
func (*Runtime) ModelInfos ¶
ModelInfos returns metadata about all registered models for the UI.
func (*Runtime) UtilityModels ¶
UtilityModels returns the models configured for utility tasks (summarize, codewords).
Directories
¶
| Path | Synopsis |
|---|---|
|
Package generation defines SpeechKit's provider-neutral text generation boundary.
|
Package generation defines SpeechKit's provider-neutral text generation boundary. |