chatui

package
v0.1.0-devel.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Sep 7, 2025 License: Unlicense Imports: 19 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func New

func New(providers types.Providers, vecdb *vecdb.VectorDB, llmConfig LLMConfig) *model

New creates a new [model].

Types

type LLMConfig

type LLMConfig struct {
	Models             []types.ModelConfig // Models lists optional per model metadata.
	DefaultModel       string              // DefaultModel is the model used for chat/generation when none is specified.
	UserPromptTmpl     string              // UserPromptTmpl is a go template used to build the user query + context.
	EmbeddingModel     string              // EmbeddingModel is the model used to produce embeddings.
	RetrievalTopK      int                 // RetrievalTopK is the number of results to fetch from the vector DB for RAG. Use 0 to disable retrieval.
	DefaultContext     int                 // DefaultContext is the fallback maximum context length (in tokens).
	DefaultTemperature *float64            // DefaultTemperature is the fallback sampling temperature.
}

LLMConfig contains high-level LLM settings for the RAG pipeline.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL