serverless-inference/

directory
v1.192.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 19, 2026 License: BSD-3-Clause, MIT

Directories

Path Synopsis
Command chat-completion runs a non-streaming chat completion via the Serverless Inference API.
Command chat-completion runs a non-streaming chat completion via the Serverless Inference API.
Command chat-completion-streaming streams a chat completion via the Serverless Inference API.
Command chat-completion-streaming streams a chat completion via the Serverless Inference API.
Command embeddings creates embedding vectors via the Serverless Inference API.
Command embeddings creates embedding vectors via the Serverless Inference API.
Command image-generation generates a single image via the Serverless Inference API and writes it to image.png.
Command image-generation generates a single image via the Serverless Inference API and writes it to image.png.
Command image-streaming streams partial-image events via the Serverless Inference API.
Command image-streaming streams partial-image events via the Serverless Inference API.
Command list-models lists the models reachable through the Serverless Inference API.
Command list-models lists the models reachable through the Serverless Inference API.
Command messages sends a non-streaming message via the Anthropic-compatible /v1/messages endpoint of the Serverless Inference API.
Command messages sends a non-streaming message via the Anthropic-compatible /v1/messages endpoint of the Serverless Inference API.
Command messages-streaming streams an Anthropic-style message from the Serverless Inference /v1/messages endpoint.
Command messages-streaming streams an Anthropic-style message from the Serverless Inference /v1/messages endpoint.
Command responses runs a non-streaming /v1/responses call via the Serverless Inference API.
Command responses runs a non-streaming /v1/responses call via the Serverless Inference API.
Command responses-streaming streams a /v1/responses call via the Serverless Inference API.
Command responses-streaming streams a /v1/responses call via the Serverless Inference API.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL