pkg/

Package llmroute contains the LLM-aware request inspection, replica scoring and affinity primitives used to route OpenAI-compatible inference traffic.

Package managedendpoint hosts inference endpoints deployed from the endpoints repo on spare GPU capacity and serves them under an OpenAI-compatible /v1 route.

Package vm owns persistent VM identities and reuses sandbox scheduling and durable disks for each cold boot.

Package vast contains the compatibility shim for machines that are already listed on Vast.

Package microvm holds the contract between the worker's microvm runtime (pkg/runtime) and the guest init (cmd/vminit): the VM spec the host writes into the shared canvas, the control messages exchanged over vsock, and the fixed paths both sides agree on.

Package egress enforces outbound policy and brokers sandbox credentials.