Directories
¶
| Path | Synopsis |
|---|---|
|
adapters
|
|
|
generic
Package generic provides a generic OpenAI-compatible backend for custom providers.
|
Package generic provides a generic OpenAI-compatible backend for custom providers. |
|
api
|
|
|
v1
Package v1 implements the OpenAI-compatible /v1/...
|
Package v1 implements the OpenAI-compatible /v1/... |
|
Package config holds the runtime configuration populated from CLI flags.
|
Package config holds the runtime configuration populated from CLI flags. |
|
Package dashboard serves the admin SPA and its backing JSON API.
|
Package dashboard serves the admin SPA and its backing JSON API. |
|
Package db manages the embedded bbolt database and all bucket definitions.
|
Package db manages the embedded bbolt database and all bucket definitions. |
|
Package errors defines standard error types used across llm-router services.
|
Package errors defines standard error types used across llm-router services. |
|
Package httpkit holds shared HTTP transport helpers for the API surfaces.
|
Package httpkit holds shared HTTP transport helpers for the API surfaces. |
|
Package logging provides the bracket log handler for llm-router: [LEVEL][dd.mm.yyyy h:m:s.ms][key: value] message.
|
Package logging provides the bracket log handler for llm-router: [LEVEL][dd.mm.yyyy h:m:s.ms][key: value] message. |
|
Package models defines all shared data structures for llm-router.
|
Package models defines all shared data structures for llm-router. |
|
Package pool runs the single-pass credential failover shared by every backend: each key is tried at most once in pool order, the first success wins, otherwise the last error is returned.
|
Package pool runs the single-pass credential failover shared by every backend: each key is tried at most once in pool order, the first success wins, otherwise the last error is returned. |
|
Package repository provides generic type-safe database operations using Go generics.
|
Package repository provides generic type-safe database operations using Go generics. |
|
Package server wires all services together and starts the HTTP servers.
|
Package server wires all services together and starts the HTTP servers. |
|
services
|
|
|
admin
Package admin manages the bootstrap flow and dashboard authentication.
|
Package admin manages the bootstrap flow and dashboard authentication. |
|
config
Package config manages RouterConfiguration persisted in the RouterConfiguration bucket.
|
Package config manages RouterConfiguration persisted in the RouterConfiguration bucket. |
|
credential
Package credential implements the Credential Pool Service.
|
Package credential implements the Credential Pool Service. |
|
exhausted
Package exhausted owns the unified joint limit-key store (0.1.1).
|
Package exhausted owns the unified joint limit-key store (0.1.1). |
|
geoban
Package geoban owns indefinite geo-block flags: (plugin, provider type, proxy) triples whose exit the upstream refuses for that provider.
|
Package geoban owns indefinite geo-block flags: (plugin, provider type, proxy) triples whose exit the upstream refuses for that provider. |
|
maintenance
Package maintenance implements the Provider Maintenance & Rotation Service.
|
Package maintenance implements the Provider Maintenance & Rotation Service. |
|
metrics
Package metrics implements the Metrics Service for tracking API usage.
|
Package metrics implements the Metrics Service for tracking API usage. |
|
modelinfo
Package modelinfo manages model metadata caching.
|
Package modelinfo manages model metadata caching. |
|
pluginrepo
Package pluginrepo manages external plugin repositories (the plugin store).
|
Package pluginrepo manages external plugin repositories (the plugin store). |
|
provider
Package provider owns the unified provider registry.
|
Package provider owns the unified provider registry. |
|
proxypool
Package proxypool implements the outbound proxy pool.
|
Package proxypool implements the outbound proxy pool. |
|
router
Package router implements the Router Service.
|
Package router implements the Router Service. |
|
token
Package token implements the Internal Token Service.
|
Package token implements the Internal Token Service. |
|
virtual
Package virtual implements the Virtual Models service.
|
Package virtual implements the Virtual Models service. |
|
Package streamgate tracks whether a streaming response committed its first byte to the client.
|
Package streamgate tracks whether a streaming response committed its first byte to the client. |
|
Package testutil provides shared test utilities for llm-router tests.
|
Package testutil provides shared test utilities for llm-router tests. |
|
Package util provides shared utility functions for the llm-router framework.
|
Package util provides shared utility functions for the llm-router framework. |
Click to show internal directories.
Click to hide internal directories.