backend

package

v1.0.0 Latest Latest Go to latest Published: Nov 20, 2025 License: Apache-2.0 Imports: 6 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type App struct {
	// contains filtered or unexported fields
}

App struct

func NewApp() *App

NewApp creates a new App application struct

func (a *App) DownloadModel(url string, name string) string

DownloadModel triggers a download and emits events for progress

func (a *App) ListModels() []models.ModelInfo

ListModels returns the available models

func (a *App) LoadModelOnly(modelFile string) string

LoadModelOnly starts the engine without chatting

func (a *App) Shutdown(ctx context.Context)

shutdown is called at termination

func (a *App) StartChat(prompt string, modelFile string, temp float64, system string, topP float64, topK int, maxTokens int) string

StartChat starts the inference and emits tokens via events StartChat starts the inference

func (a *App) Startup(ctx context.Context)

startup is called at application startup

func (a *App) StopChat()

StopChat kills the current process