constants

package
v0.4.0-rc.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 31, 2025 License: Apache-2.0 Imports: 0 Imported by: 0

Documentation

Index

Constants

View Source
const (
	// ModelNameLabel is the label for identifying the model name
	// Example: "model.aibrix.ai/name": "deepseek-llm-7b-chat"
	ModelNameLabel = "model.aibrix.ai/name"

	// ModelEngineLabel is the label for identifying the inference engine
	// Example: "model.aibrix.ai/engine": "vllm"
	ModelEngineLabel = "model.aibrix.ai/engine"

	// ModelMetricPortLabel is the label for specifying the metrics port
	// Example: "model.aibrix.ai/metric-port": "8000"
	ModelMetricPortLabel = "model.aibrix.ai/metric-port"

	// ModelPortLabel is the label for specifying the service port
	// Example: "model.aibrix.ai/port": "8080"
	ModelPortLabel = "model.aibrix.ai/port"
)

Variables

This section is empty.

Functions

func GetInferenceEngine

func GetInferenceEngine(labels map[string]string) string

GetInferenceEngine retrieves the inference engine from pod labels

func GetModelName

func GetModelName(labels map[string]string) string

GetModelName retrieves the model name from pod labels

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL