Directories
¶
| Path | Synopsis |
|---|---|
|
llmroute
Package llmroute contains the LLM-aware request inspection, replica scoring and affinity primitives used to route OpenAI-compatible inference traffic.
|
Package llmroute contains the LLM-aware request inspection, replica scoring and affinity primitives used to route OpenAI-compatible inference traffic. |
|
experimental
|
|
|
Package managedendpoint hosts inference endpoints deployed from the endpoints repo on spare GPU capacity and serves them under an OpenAI-compatible /v1 route.
|
Package managedendpoint hosts inference endpoints deployed from the endpoints repo on spare GPU capacity and serves them under an OpenAI-compatible /v1 route. |
|
Package vm owns persistent VM identities and reuses sandbox scheduling and durable disks for each cold boot.
|
Package vm owns persistent VM identities and reuses sandbox scheduling and durable disks for each cold boot. |
Click to show internal directories.
Click to hide internal directories.