Documentation
¶
Index ¶
Constants ¶
View Source
const DefaultLLMModel = "gpt-4o"
Variables ¶
This section is empty.
Functions ¶
Types ¶
type LLMService ¶
type LLMService struct {
// contains filtered or unexported fields
}
LLMService implements services.LLMService using AsyncAI's OpenAI-compatible API.
func NewLLMService ¶
func NewLLMService(apiKey, model string) *LLMService
NewLLMService creates an AsyncAI LLM service.
func (*LLMService) Chat ¶
func (s *LLMService) Chat(ctx context.Context, messages []map[string]any, onToken func(*frames.LLMTextFrame)) error
Chat runs a completion and streams tokens as LLMTextFrame.
Source Files
Click to show internal directories.
Click to hide internal directories.