Documentation
¶
Overview ¶
Package model groups everything about which LLM runs, what it costs, and what it embeds. It holds no code of its own; each concern is a subpackage: catalog (the models.dev snapshot, local overrides, and the effective-model merge of provider override plus discovery over that metadata), usage (per-turn token and cost accounting), and embedding (embedding providers, indexing, and storage).
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
Package catalog provides the embedded and optionally synchronized models.dev provider/model directory.
|
Package catalog provides the embedded and optionally synchronized models.dev provider/model directory. |
|
Package embedding turns text into vectors for semantic search.
|
Package embedding turns text into vectors for semantic search. |
|
Package usage persists provider-reported LLM usage outside the turn path.
|
Package usage persists provider-reported LLM usage outside the turn path. |
Click to show internal directories.
Click to hide internal directories.