Documentation
¶
Index ¶
Constants ¶
View Source
const ( ErrBadRequest = faults.Type("bad request") ErrServiceIO = faults.Type("service IO error") )
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Encoder ¶
type Encoder[A any] interface { WithInferrer(Inferrer) WithCommand(chatter.Cmd) AsStratum(chatter.Stratum) error AsText(chatter.Text) error AsPrompt(*chatter.Prompt) error AsAnswer(*chatter.Answer) error AsReply(*chatter.Reply) error Build() A }
LLM request encoder.
type Inferrer ¶
type Inferrer struct {
Temperature float64
TopP float64
TopK float64
MaxTokens int
StopSequences []string
}
Inferrer is a set of parameters that influence the LLM's inference behavior.
Click to show internal directories.
Click to hide internal directories.