Directories
¶
| Path | Synopsis |
|---|---|
|
Package llmrepo provides a unified facade over LLM backends discovered via runtimestate: prompt, chat, streaming, embedding, and tokenization through a single ModelRepo interface.
|
Package llmrepo provides a unified facade over LLM backends discovered via runtimestate: prompt, chat, streaming, embedding, and tokenization through a single ModelRepo interface. |
|
Package modelrepo defines the provider-facing contracts for LLM backends: the Provider interface, per-capability client interfaces, and shared request/response types.
|
Package modelrepo defines the provider-facing contracts for LLM backends: the Provider interface, per-capability client interfaces, and shared request/response types. |
|
anthropic
Package anthropic is a direct (non-Vertex) provider for the Anthropic API (api.anthropic.com), which speaks the Messages API.
|
Package anthropic is a direct (non-Vertex) provider for the Anthropic API (api.anthropic.com), which speaks the Messages API. |
|
bedrock
Package bedrock is a provider for AWS Bedrock via the unified Converse API.
|
Package bedrock is a provider for AWS Bedrock via the unified Converse API. |
|
codec/chatcompletions
Package chatcompletions is a transport-agnostic codec for the OpenAI Chat Completions wire format (request/response and SSE streaming).
|
Package chatcompletions is a transport-agnostic codec for the OpenAI Chat Completions wire format (request/response and SSE streaming). |
|
codec/messages
Package messages is a transport-agnostic codec for Anthropic's Messages API wire format (request, content-block response, and named-SSE-event streaming).
|
Package messages is a transport-agnostic codec for Anthropic's Messages API wire format (request, content-block response, and named-SSE-event streaming). |
|
gemini
Package gemini implements the modelrepo.Provider contract against Google's Gemini Generative Language API.
|
Package gemini implements the modelrepo.Provider contract against Google's Gemini Generative Language API. |
|
ollama
Package ollama implements the modelrepo.Provider contract against Ollama HTTP endpoints.
|
Package ollama implements the modelrepo.Provider contract against Ollama HTTP endpoints. |
|
openai
Package openai implements the modelrepo.Provider contract against the OpenAI HTTP API and OpenAI-compatible endpoints.
|
Package openai implements the modelrepo.Provider contract against the OpenAI HTTP API and OpenAI-compatible endpoints. |
|
vertex
Package vertex implements the modelrepo.Provider contract against Google Vertex AI publisher endpoints, using OAuth bearer tokens minted from service-account credentials.
|
Package vertex implements the modelrepo.Provider contract against Google Vertex AI publisher endpoints, using OAuth bearer tokens minted from service-account credentials. |
|
vllm
Package vllm implements the modelrepo.Provider contract against vLLM OpenAI-compatible HTTP endpoints.
|
Package vllm implements the modelrepo.Provider contract against vLLM OpenAI-compatible HTTP endpoints. |
|
Package ollamatokenizer provides Tokenizer implementations used by llmrepo to count and split tokens for a given model.
|
Package ollamatokenizer provides Tokenizer implementations used by llmrepo to count and split tokens for a given model. |
|
Package runtimestate reconciles the declared state of LLM backends against their observed state, read-only, intended to run repeatedly from an external background task.
|
Package runtimestate reconciles the declared state of LLM backends against their observed state, read-only, intended to run repeatedly from an external background task. |
Click to show internal directories.
Click to hide internal directories.