compact

package

v0.2.3 Latest Latest Go to latest Published: Oct 27, 2026 License: AGPL-3.0 Imports: 6 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/openfastchat/openfastchat-core

Links

Open Source Insights

Documentation ¶

Index ¶

func DefaultPrompt() string
func Run(ctx context.Context, p Params) (string, error)
func Title(ctx context.Context, llm LLM, model, prompt, answer string) (string, error)
type LLM
type Params

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func DefaultPrompt ¶

func DefaultPrompt() string

DefaultPrompt returns the embedded fallback system prompt used when a compact node has no per-node prompt set.

func Run ¶

func Run(ctx context.Context, p Params) (string, error)

func Title ¶

func Title(
	ctx context.Context,
	llm LLM, model, prompt, answer string,
) (string, error)

Title generates a short (max ~6 words) human-readable title for a chat thread given the first user prompt and the assistant's response. The call goes through the billed LLM client, so its tokens are accounted for.

Types ¶

type LLM ¶

type LLM interface {
	Complete(
		ctx context.Context,
		model string,
		messages []llmclient.Message,
		maxTokens int,
	) (string, error)
}

LLM is the subset of billedllm.Recorder that compact needs. Declared locally so this package stays free of a direct billedllm dependency.

type Params ¶

type Params struct {
	LLM             LLM
	Model           string
	SystemPrompt    string
	Query           string
	Content         string
	MaxOutputTokens int
}

Source Files ¶

View all Source files

compact.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL