Documentation
¶
There is no documentation for this package.
Directories
¶
| Path | Synopsis |
|---|---|
|
Package cmd defines the llm-router CLI using cobra.
|
Package cmd defines the llm-router CLI using cobra. |
|
internal
|
|
|
adapters/generic
Package generic provides a generic OpenAI-compatible backend for custom providers.
|
Package generic provides a generic OpenAI-compatible backend for custom providers. |
|
api/v1
Package v1 implements the OpenAI-compatible /v1/...
|
Package v1 implements the OpenAI-compatible /v1/... |
|
config
Package config holds the runtime configuration populated from CLI flags.
|
Package config holds the runtime configuration populated from CLI flags. |
|
dashboard
Package dashboard serves the admin SPA and its backing JSON API.
|
Package dashboard serves the admin SPA and its backing JSON API. |
|
db
Package db manages the embedded bbolt database and all bucket definitions.
|
Package db manages the embedded bbolt database and all bucket definitions. |
|
errors
Package errors defines standard error types used across llm-router services.
|
Package errors defines standard error types used across llm-router services. |
|
models
Package models defines all shared data structures for llm-router.
|
Package models defines all shared data structures for llm-router. |
|
repository
Package repository provides generic type-safe database operations using Go generics.
|
Package repository provides generic type-safe database operations using Go generics. |
|
server
Package server wires all services together and starts the HTTP servers.
|
Package server wires all services together and starts the HTTP servers. |
|
services/admin
Package admin manages the bootstrap flow and dashboard authentication.
|
Package admin manages the bootstrap flow and dashboard authentication. |
|
services/config
Package config manages RouterConfiguration persisted in the RouterConfiguration bucket.
|
Package config manages RouterConfiguration persisted in the RouterConfiguration bucket. |
|
services/credential
Package credential implements the Credential Pool Service.
|
Package credential implements the Credential Pool Service. |
|
services/geoip
Package geoip resolves the server's country for proxy preference matching.
|
Package geoip resolves the server's country for proxy preference matching. |
|
services/maintenance
Package maintenance implements the Provider Maintenance & Rotation Service.
|
Package maintenance implements the Provider Maintenance & Rotation Service. |
|
services/metrics
Package metrics implements the Metrics Service for tracking API usage.
|
Package metrics implements the Metrics Service for tracking API usage. |
|
services/modelinfo
Package modelinfo manages model metadata caching.
|
Package modelinfo manages model metadata caching. |
|
services/pluginrepo
Package pluginrepo manages external plugin repositories (the plugin store).
|
Package pluginrepo manages external plugin repositories (the plugin store). |
|
services/provider
Package provider owns the unified provider registry.
|
Package provider owns the unified provider registry. |
|
services/proxypool
Package proxypool implements the proxy pool service.
|
Package proxypool implements the proxy pool service. |
|
services/retry
Package retry implements the single retry/fallthrough engine shared by the router (credential rotation) and the agents adapter (model rotation).
|
Package retry implements the single retry/fallthrough engine shared by the router (credential rotation) and the agents adapter (model rotation). |
|
services/router
Package router implements the Router Service.
|
Package router implements the Router Service. |
|
services/token
Package token implements the Internal Token Service.
|
Package token implements the Internal Token Service. |
|
services/virtual
Package virtual implements the Virtual Models service.
|
Package virtual implements the Virtual Models service. |
|
testutil
Package testutil provides shared test utilities for llm-router tests.
|
Package testutil provides shared test utilities for llm-router tests. |
|
util
Package util provides shared utility functions for the llm-router framework.
|
Package util provides shared utility functions for the llm-router framework. |
|
providers
|
|
|
virtual
Package virtual implements the virtual-model provider backend: a virtual model routes each request to its models in list order (fall-through) and fails only when every model failed.
|
Package virtual implements the virtual-model provider backend: a virtual model routes each request to its models in list order (fall-through) and fails only when every model failed. |
Click to show internal directories.
Click to hide internal directories.