provider

package
v0.6.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Sep 12, 2025 License: Apache-2.0 Imports: 12 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func EnsureEngineReady added in v0.6.0

func EnsureEngineReady(engineName string) error

EnsureEngineReady ensures the engine is in ready state

Types

type EngineInfoProvider added in v0.6.0

type EngineInfoProvider interface {
	GetVersion(ctx context.Context, resp *types.EngineVersionResponse) (*types.EngineVersionResponse, error)
	GetOperateStatus() int
	SetOperateStatus(status int)
}

EngineInfoProvider defines informational operations

type EngineInstaller added in v0.6.0

type EngineInstaller interface {
	CheckEngine() bool
	InstallEngine(cover bool) error
	InitEnv() error
	UpgradeEngine() error
}

EngineInstaller defines engine installation and setup operations

type EngineLifecycleManager added in v0.6.0

type EngineLifecycleManager interface {
	StartEngine(mode string) error
	StopEngine() error
	HealthCheck() error
	GetConfig() *types.EngineRecommendConfig
}

ModelServiceProvider model service provider interface EngineLifecycleManager defines core engine lifecycle operations

type EngineManager added in v0.6.0

type EngineManager interface {
	// 启动所有引擎
	StartAllEngines(mode string) error
	// 停止所有引擎
	StopAllEngines() error
	// 启动引擎保活监控
	StartKeepAlive()
	// 停止引擎保活监控
	StopKeepAlive()
	// 获取引擎状态
	GetEngineStatus() map[string]string
	// 注册引擎到管理器
	RegisterEngine(name string, provider ModelServiceProvider)
}

EngineManager defines unified engine management operations

func GetEngineManager added in v0.6.0

func GetEngineManager() EngineManager

GetEngineManager returns the global engine manager instance (singleton)

type ModelManager added in v0.6.0

type ModelManager interface {
	PullModel(ctx context.Context, req *types.PullModelRequest, fn types.PullProgressFunc) (*types.ProgressResponse, error)
	PullModelStream(ctx context.Context, req *types.PullModelRequest) (chan []byte, chan error)
	DeleteModel(ctx context.Context, req *types.DeleteRequest) error
	ListModels(ctx context.Context) (*types.ListResponse, error)
	LoadModel(ctx context.Context, req *types.LoadRequest) error
	UnloadModel(ctx context.Context, req *types.UnloadModelRequest) error
	GetRunningModels(ctx context.Context) (*types.ListResponse, error)
}

ModelManager defines model management operations

type ModelServiceProvider

type ModelServiceProvider interface {
	EngineLifecycleManager
	EngineInstaller
	ModelManager
	EngineInfoProvider
}

ModelServiceProvider defines the complete interface for AI model service providers This is a composite interface that includes all specialized interfaces

func GetModelEngine

func GetModelEngine(engineName string) ModelServiceProvider

GetModelEngine get model service provider by engine name (singleton pattern)

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL