modeld

Overview ¶

Command modeld is the contenox model daemon: the per-user, per-data-root owner of resident model state. It claims a cross-platform lease, renews it, and while it holds the lease it serves the runtime/transport.Service contract over gRPC (fenced by the owner instance id) so the runtime can open sessions and probe health. The served inference backend is selected at build time (-tags 'openvino openvino_genai' or -tags llamanode); a build with no local backend still owns the lease and answers health probes.

Usage:

modeld serve   [--data-root DIR] [--ttl DURATION] [--listen ADDR] [--models-dir DIR] [--mem-max 8GiB] [--mem-reserve 2GiB] [--mem-cold 16GiB] [--min-hot-context 4096]
modeld status  [--data-root DIR] [--json]
modeld version [--json]