Documentation
¶
Overview ¶
Package openvino contains the modelrepo catalog/provider shell for in-process OpenVINO (Intel) inference.
The actual native backend lives in the isolated sub-package ./ovsession and is gated behind the 'openvino' build tag, so the default build and CI never require OpenVINO or a C++ toolchain. Without the tag, ovsession reports Available == false and this provider advertises no models.
The native session layer currently proves token-ID-level KV snapshot/restore. Text chat, prompt, stream, embedding, tokenizer, and chat-template wiring are still explicit follow-up work.
Build and test the native backend with Makefile.openvino:
make -f Makefile.openvino deps # one-time: venv + OpenVINO SDK make -f Makefile.openvino model # pull the tiny KV round-trip model make -f Makefile.openvino test # build + run the S0 KV snapshot test
Index ¶
Constants ¶
const ( KindSystem = contextasm.KindSystem KindTools = contextasm.KindTools KindRepoRules = contextasm.KindRepoRules KindRepoMap = contextasm.KindRepoMap KindPinned = contextasm.KindPinned KindDiff = contextasm.KindDiff KindTerminal = contextasm.KindTerminal KindUserTurn = contextasm.KindUserTurn )
Variables ¶
This section is empty.
Functions ¶
func AssembleContext ¶
func ShutdownGenAISessions ¶
func ShutdownGenAISessions() error
ShutdownGenAISessions closes every pooled OpenVINO GenAI session and empties the pool. It is safe to call on an empty pool (including builds without the native backend) and is intended for deterministic teardown on runtime exit.
Types ¶
type Segment ¶
type Segment = contextasm.Segment
type SegmentKind ¶
type SegmentKind = contextasm.SegmentKind
Kept as local aliases while OpenVINO call sites finish migrating to the backend-neutral contextasm package.
Source Files
Directories