internal/

directory
v0.3.8 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 7, 2026 License: MIT

Directories

Path Synopsis
adapters
generic
Package generic provides a generic OpenAI-compatible backend for custom providers.
Package generic provides a generic OpenAI-compatible backend for custom providers.
api
v1
Package v1 implements the OpenAI-compatible /v1/...
Package v1 implements the OpenAI-compatible /v1/...
Package config holds the runtime configuration populated from CLI flags.
Package config holds the runtime configuration populated from CLI flags.
Package dashboard serves the admin SPA and its backing JSON API.
Package dashboard serves the admin SPA and its backing JSON API.
Package db manages the embedded bbolt database and all bucket definitions.
Package db manages the embedded bbolt database and all bucket definitions.
Package errors defines standard error types used across llm-router services.
Package errors defines standard error types used across llm-router services.
Package httpkit holds shared HTTP transport helpers for the API surfaces.
Package httpkit holds shared HTTP transport helpers for the API surfaces.
Package logging provides the bracket log handler for llm-router: [LEVEL][dd.mm.yyyy h:m:s.ms][key: value] message.
Package logging provides the bracket log handler for llm-router: [LEVEL][dd.mm.yyyy h:m:s.ms][key: value] message.
Package models compatibility additions: OpenAI prior-generation and Anthropic-compatible wire types plus the router-side async stores backing responses, conversations, assistants, threads, runs and message batches.
Package models compatibility additions: OpenAI prior-generation and Anthropic-compatible wire types plus the router-side async stores backing responses, conversations, assistants, threads, runs and message batches.
Package repository provides generic type-safe database operations using Go generics.
Package repository provides generic type-safe database operations using Go generics.
Package server wires all services together and starts the HTTP servers.
Package server wires all services together and starts the HTTP servers.
services
admin
Package admin manages the bootstrap flow and dashboard authentication.
Package admin manages the bootstrap flow and dashboard authentication.
batches
Package batches persists router-side Anthropic message batches.
Package batches persists router-side Anthropic message batches.
config
Package config manages RouterConfiguration persisted in the RouterConfiguration bucket.
Package config manages RouterConfiguration persisted in the RouterConfiguration bucket.
credential
Package credential implements the Credential Pool Service.
Package credential implements the Credential Pool Service.
healthcheck
Package healthcheck owns failure-triggered credential health verification.
Package healthcheck owns failure-triggered credential health verification.
maintenance
Package maintenance runs plugin background jobs and provider upkeep.
Package maintenance runs plugin background jobs and provider upkeep.
metrics
Package metrics implements the Metrics Service for tracking API usage.
Package metrics implements the Metrics Service for tracking API usage.
modelinfo
Package modelinfo manages model metadata caching.
Package modelinfo manages model metadata caching.
pluginrepo
Package pluginrepo manages external plugin repositories (the plugin store).
Package pluginrepo manages external plugin repositories (the plugin store).
provider
Package provider owns the unified provider registry.
Package provider owns the unified provider registry.
proxypool
Package proxypool adapts the proxypool library to router policy and storage.
Package proxypool adapts the proxypool library to router policy and storage.
responses
Package responses persists router-side compatibility records.
Package responses persists router-side compatibility records.
router
Package router implements the Router Service.
Package router implements the Router Service.
token
Package token implements the Internal Token Service.
Package token implements the Internal Token Service.
videojobs
Package videojobs persists router-side video generation jobs.
Package videojobs persists router-side video generation jobs.
virtual
Package virtual implements the Virtual Models service.
Package virtual implements the Virtual Models service.
Package testutil provides shared test utilities for llm-router tests.
Package testutil provides shared test utilities for llm-router tests.
Package util provides shared utility functions for the llm-router framework.
Package util provides shared utility functions for the llm-router framework.
Package version owns the Version struct plus Parse/String helpers.
Package version owns the Version struct plus Parse/String helpers.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL