server

package
v0.17.3 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Feb 27, 2026 License: MIT Imports: 18 Imported by: 0

Documentation

Index

Constants

View Source
const STILL_ACTIVE = 259

Variables

This section is empty.

Functions

This section is empty.

Types

type InferenceCompute

type InferenceCompute struct {
	Library string
	Variant string
	Compute string
	Driver  string
	Name    string
	VRAM    string
}

type InferenceInfo added in v0.17.0

type InferenceInfo struct {
	Computes             []InferenceCompute
	DefaultContextLength int
}

func GetInferenceInfo added in v0.17.0

func GetInferenceInfo(ctx context.Context) (*InferenceInfo, error)

Attempt to retrieve inference compute information from the server log. Set ctx to timeout to control how long to wait for the logs to appear

type Server

type Server struct {
	// contains filtered or unexported fields
}

Server is a managed ollama server process

func New

func New(s *store.Store, devMode bool) *Server

func (*Server) Run

func (s *Server) Run(ctx context.Context) error

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL