vllm

package

v1.46.0 Latest Latest Go to latest Published: Apr 27, 2026 License: Apache-2.0 Imports: 6 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type HTTPClient struct {
	// contains filtered or unexported fields
}

HTTPClient is a struct that represents an HTTP client.

func NewHTTPClient(addr string) *HTTPClient

NewHTTPClient creates a new HTTP client with the given address.

func (c *HTTPClient) ListModels(ctx context.Context) (*ListModelsResponse, error)

ListModels lists all models.

func (c *HTTPClient) LoadLoRAAdapter(ctx context.Context, loraName, loraPath string) (int, error)

LoadLoRAAdapter loads a LoRA adapter from the given path.

func (c *HTTPClient) UnloadLoRAAdapter(ctx context.Context, loraName string) (int, error)

UnloadLoRAAdapter unnloads a LoRA adapter from the given path.

type ListModelsResponse struct {
	Data []*Model `json:"data"`
}

ListModelsResponse is a struct that represents the response from the list models endpoint.

type Model struct {
	ID string `json:"id"`
	// Parent is set to a base model ID if the model is a LoRA adapter..
	Parent *string `json:"parent"`
}

Model is a struct that represents a model. This mostly follows the OpenAI API format but havs extra field like "parent".