vllmmetal

package

v1.0.16 Latest Latest Go to latest Published: Feb 11, 2026 License: Apache-2.0 Imports: 17 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/docker/model-runner

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
Variables
func New(log logging.Logger, modelManager *models.Manager, serverLog logging.Logger, ...) (inference.Backend, error)

Constants ¶

View Source

const (
	// Name is the backend name.
	Name = "vllm-metal"
)

Variables ¶

View Source

var (
	// ErrPlatformNotSupported indicates the platform is not supported.
	ErrPlatformNotSupported = errors.New("vllm-metal is only available on macOS ARM64")
)

Functions ¶

func New ¶

func New(log logging.Logger, modelManager *models.Manager, serverLog logging.Logger, customPythonPath string) (inference.Backend, error)

New creates a new vllm-metal backend. customPythonPath is an optional path to a custom python3 binary; if empty, the default installation is used.

Types ¶

This section is empty.

Source Files ¶

View all Source files

vllmmetal.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL