Documentation
¶
Index ¶
- type Client
- func (c *Client) InspectModel(ctx context.Context, namespace string, name string) (*types.ModelResponse, error)
- func (c *Client) ListModels(ctx context.Context) ([]types.ModelResponse, error)
- func (c *Client) OpenAIEndpoint() string
- func (c *Client) PullModel(ctx context.Context, fullyQualifiedModelName string) error
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Client ¶
type Client struct {
// contains filtered or unexported fields
}
Client is the client for the Docker Model Runner
func (*Client) InspectModel ¶
func (c *Client) InspectModel(ctx context.Context, namespace string, name string) (*types.ModelResponse, error)
InspectModel returns a model that is already pulled using the Docker Model Runner format. The name of the model is in the format of <name>:<tag>. The namespace and name defines Models as OCI Artifacts in Docker Hub, therefore the namespace is the organization and the name is the repository. E.g. "ai/smollm2:360M-Q4_K_M". See Models_as_OCI_Artifacts for more information.
func (*Client) ListModels ¶
ListModels lists all models that are already pulled using the Docker Model Runner format.
func (*Client) OpenAIEndpoint ¶
OpenAIEndpoint returns the OpenAI endpoint for the Docker Model Runner
Source Files
Click to show internal directories.
Click to hide internal directories.