Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func EnsureEngineReady ¶ added in v0.6.0
EnsureEngineReady ensures the engine is in ready state
Types ¶
type EngineInfoProvider ¶ added in v0.6.0
type EngineInfoProvider interface {
GetVersion(ctx context.Context, resp *types.EngineVersionResponse) (*types.EngineVersionResponse, error)
GetOperateStatus() int
SetOperateStatus(status int)
}
EngineInfoProvider defines informational operations
type EngineInstaller ¶ added in v0.6.0
type EngineInstaller interface {
CheckEngine() bool
InstallEngine(cover bool) error
InitEnv() error
UpgradeEngine() error
}
EngineInstaller defines engine installation and setup operations
type EngineLifecycleManager ¶ added in v0.6.0
type EngineLifecycleManager interface {
StartEngine(mode string) error
StopEngine() error
HealthCheck() error
GetConfig() *types.EngineRecommendConfig
}
ModelServiceProvider model service provider interface EngineLifecycleManager defines core engine lifecycle operations
type EngineManager ¶ added in v0.6.0
type EngineManager interface {
// 启动所有引擎
StartAllEngines(mode string) error
// 停止所有引擎
StopAllEngines() error
// 启动引擎保活监控
StartKeepAlive()
// 停止引擎保活监控
StopKeepAlive()
// 获取引擎状态
GetEngineStatus() map[string]string
// 注册引擎到管理器
RegisterEngine(name string, provider ModelServiceProvider)
}
EngineManager defines unified engine management operations
func GetEngineManager ¶ added in v0.6.0
func GetEngineManager() EngineManager
GetEngineManager returns the global engine manager instance (singleton)
type ModelManager ¶ added in v0.6.0
type ModelManager interface {
PullModel(ctx context.Context, req *types.PullModelRequest, fn types.PullProgressFunc) (*types.ProgressResponse, error)
PullModelStream(ctx context.Context, req *types.PullModelRequest) (chan []byte, chan error)
DeleteModel(ctx context.Context, req *types.DeleteRequest) error
ListModels(ctx context.Context) (*types.ListResponse, error)
LoadModel(ctx context.Context, req *types.LoadRequest) error
UnloadModel(ctx context.Context, req *types.UnloadModelRequest) error
GetRunningModels(ctx context.Context) (*types.ListResponse, error)
}
ModelManager defines model management operations
type ModelServiceProvider ¶
type ModelServiceProvider interface {
EngineLifecycleManager
EngineInstaller
ModelManager
EngineInfoProvider
}
ModelServiceProvider defines the complete interface for AI model service providers This is a composite interface that includes all specialized interfaces
func GetModelEngine ¶
func GetModelEngine(engineName string) ModelServiceProvider
GetModelEngine get model service provider by engine name (singleton pattern)