Documentation
¶
Index ¶
Constants ¶
View Source
const ( // ModelNameLabel is the label for identifying the model name // Example: "model.aibrix.ai/name": "deepseek-llm-7b-chat" ModelNameLabel = "model.aibrix.ai/name" // ModelEngineLabel is the label for identifying the inference engine // Example: "model.aibrix.ai/engine": "vllm" ModelEngineLabel = "model.aibrix.ai/engine" // ModelMetricPortLabel is the label for specifying the metrics port // Example: "model.aibrix.ai/metric-port": "8000" ModelMetricPortLabel = "model.aibrix.ai/metric-port" // ModelPortLabel is the label for specifying the service port // Example: "model.aibrix.ai/port": "8080" ModelPortLabel = "model.aibrix.ai/port" )
Variables ¶
This section is empty.
Functions ¶
func GetInferenceEngine ¶
GetInferenceEngine retrieves the inference engine from pod labels
func GetModelName ¶
GetModelName retrieves the model name from pod labels
Types ¶
This section is empty.
Click to show internal directories.
Click to hide internal directories.