Documentation
¶
Overview ¶
Package groq provides Groq-backed LLM, STT, and TTS via OpenAI-compatible API.
Index ¶
Constants ¶
View Source
const DefaultLLMModel = "llama-3.1-8b-instant"
DefaultLLMModel is the default Groq chat model when none is specified.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type LLMService ¶
type LLMService struct {
// contains filtered or unexported fields
}
LLMService implements services.LLMService using Groq's OpenAI-compatible chat API.
func NewLLMService ¶
func NewLLMService(apiKey, model string) *LLMService
NewLLMService creates a Groq LLM service. If apiKey is empty, config.GetEnv("GROQ_API_KEY", "") is used. If model is empty, DefaultLLMModel is used.
func (*LLMService) Chat ¶
func (s *LLMService) Chat(ctx context.Context, messages []map[string]any, onToken func(*frames.LLMTextFrame)) error
Chat runs a completion and calls onToken for each streamed content delta (as LLMTextFrame).
Source Files
Click to show internal directories.
Click to hide internal directories.