Directories
¶
| Path | Synopsis |
|---|---|
|
Package capacity is modeld's hardware capacity planner: it resolves the EFFECTIVE context window a model can actually be served at on this device, from the model's KV-cache footprint and the device's free memory — not the model's trained ceiling alone.
|
Package capacity is modeld's hardware capacity planner: it resolves the EFFECTIVE context window a model can actually be served at on this device, from the model's KV-cache footprint and the device's free memory — not the model's trained ceiling alone. |
|
Package devicelease guards physical accelerator residency across modeld data roots.
|
Package devicelease guards physical accelerator residency across modeld data roots. |
|
internal
|
|
|
sessionkit
Package sessionkit holds the small backend-neutral helpers shared by the modeld transport.Session adapters (llama.cpp in modeld/llama/llamasession and OpenVINO in modeld/openvino).
|
Package sessionkit holds the small backend-neutral helpers shared by the modeld transport.Session adapters (llama.cpp in modeld/llama/llamasession and OpenVINO in modeld/openvino). |
|
Package llama defines the modeld-side llama backend contract: persistent inference sessions keep a stable prefix's KV hot and re-prefill only the changed suffix.
|
Package llama defines the modeld-side llama backend contract: persistent inference sessions keep a stable prefix's KV hot and re-prefill only the changed suffix. |
|
llamacppshim
Package llamacppshim owns the direct llama.cpp C API boundary for modeld.
|
Package llamacppshim owns the direct llama.cpp C API boundary for modeld. |
|
llamasession
Capability mapping kept in an untagged, cgo-free file so the backend-parity contract can pin it verbatim in plain CI: capability drift must fail there, not only in tagged native builds.
|
Capability mapping kept in an untagged, cgo-free file so the backend-parity contract can pin it verbatim in plain CI: capability drift must fail there, not only in tagged native builds. |
|
Package openvino implements the runtime/transport.Service boundary for the OpenVINO (Intel) backend: it opens persistent, manifest-keyed sessions on the owned device (CPU / GPU) that the runtime drives over the transport.
|
Package openvino implements the runtime/transport.Service boundary for the OpenVINO (Intel) backend: it opens persistent, manifest-keyed sessions on the owned device (CPU / GPU) that the runtime drives over the transport. |
|
ovsession
Package ovsession contains the native OpenVINO session/KV bridge used by the openvino modelrepo provider.
|
Package ovsession contains the native OpenVINO session/KV bridge used by the openvino modelrepo provider. |
|
Package owner manages lease-based ownership of the local runtime's resident state.
|
Package owner manages lease-based ownership of the local runtime's resident state. |
|
Package residency contains modeld's backend-neutral KV residency policy.
|
Package residency contains modeld's backend-neutral KV residency policy. |
|
Package slot enforces modeld's single active local model invariant.
|
Package slot enforces modeld's single active local model invariant. |
Click to show internal directories.
Click to hide internal directories.