Directories
¶
| Path | Synopsis |
|---|---|
|
abstractions
|
|
|
common/llmroute
Package llmroute contains the LLM-aware request inspection, replica scoring and affinity primitives used to route OpenAI-compatible inference traffic.
|
Package llmroute contains the LLM-aware request inspection, replica scoring and affinity primitives used to route OpenAI-compatible inference traffic. |
|
managedendpoint
Package managedendpoint hosts inference endpoints deployed from the endpoints repo on spare GPU capacity and serves them under an OpenAI-compatible /v1 route.
|
Package managedendpoint hosts inference endpoints deployed from the endpoints repo on spare GPU capacity and serves them under an OpenAI-compatible /v1 route. |
|
vast
Package vast contains the compatibility shim for machines that are already listed on Vast.
|
Package vast contains the compatibility shim for machines that are already listed on Vast. |
|
api
|
|
|
Package disk implements qcow2-backed durable disks for workers.
|
Package disk implements qcow2-backed durable disks for workers. |
|
microvm
Package microvm holds the contract between the worker's microvm runtime (pkg/runtime) and the guest init (cmd/vminit): the VM spec the host writes into the shared canvas, the control messages exchanged over vsock, and the fixed paths both sides agree on.
|
Package microvm holds the contract between the worker's microvm runtime (pkg/runtime) and the guest init (cmd/vminit): the VM spec the host writes into the shared canvas, the control messages exchanged over vsock, and the fixed paths both sides agree on. |
Click to show internal directories.
Click to hide internal directories.