Directories
¶
| Path | Synopsis |
|---|---|
|
Package actor carries the identity of the caller making a request.
|
Package actor carries the identity of the caller making a request. |
|
Package adapter provides the generic adapter framework: a Spec type that bundles wire-shape metadata (inbound URL paths, upstream URL path, auth strategy, canonical translator, token extractor), a generic pipeline.Adapter implementation parameterised by path and auth strategy, a Registry of Specs, and a generic route mounter that iterates registered specs.
|
Package adapter provides the generic adapter framework: a Spec type that bundles wire-shape metadata (inbound URL paths, upstream URL path, auth strategy, canonical translator, token extractor), a generic pipeline.Adapter implementation parameterised by path and auth strategy, a Registry of Specs, and a generic route mounter that iterates registered specs. |
|
Package adapters names the wire protocol the relay speaks to an upstream.
|
Package adapters names the wire protocol the relay speaks to an upstream. |
|
Package authz answers "can this actor perform this action on this resource?" — a deliberate seam so the v1 always-allow implementation can later be swapped for Casbin / OpenFGA / Keto without touching call sites.
|
Package authz answers "can this actor perform this action on this resource?" — a deliberate seam so the v1 always-allow implementation can later be swapped for Casbin / OpenFGA / Keto without touching call sites. |
|
Package batch is the batch subsystem: it accepts bulk inference submissions, runs each item as a background job (via the jobq module), and exposes submit/poll/cancel/results over the customer-facing /v1 surface.
|
Package batch is the batch subsystem: it accepts bulk inference submissions, runs each item as a background job (via the jobq module), and exposes submit/poll/cancel/results over the customer-facing /v1 surface. |
|
Package binding is the domain layer for the HostBinding entity — the first-class join that declares "Model M is served by Host H, via wire adapter A, under upstream name U, priced by Pricing P."
|
Package binding is the domain layer for the HostBinding entity — the first-class join that declares "Model M is served by Host H, via wire adapter A, under upstream name U, priced by Pricing P." |
|
Snapshot assembly.
|
Snapshot assembly. |
|
Package catalogembed composes manifest YAML into the SDK catalog embed schema.
|
Package catalogembed composes manifest YAML into the SDK catalog embed schema. |
|
Package catalogvalidate is the cross-entity graph linter for the catalog repo's `data/` tree.
|
Package catalogvalidate is the cross-entity graph linter for the catalog repo's `data/` tree. |
|
Package catalogview builds consumer-facing read projections of catalog data for the admin/UX surface ("API UX"): a model's hosts, its pricing per host, the policies that grant it.
|
Package catalogview builds consumer-facing read projections of catalog data for the admin/UX surface ("API UX"): a model's hosts, its pricing per host, the policies that grant it. |
|
Package host is the domain layer for the Host entity — a serving endpoint the relay forwards requests to.
|
Package host is the domain layer for the Host entity — a serving endpoint the relay forwards requests to. |
|
Package hosthealth records and reads per-host runtime reachability — the observed-state counterpart to host.Spec.
|
Package hosthealth records and reads per-host runtime reachability — the observed-state counterpart to host.Spec. |
|
Package hostkey is the domain layer for the HostKey entity — a credential the relay uses to authenticate to a Host (a serving endpoint).
|
Package hostkey is the domain layer for the HostKey entity — a credential the relay uses to authenticate to a Host (a serving endpoint). |
|
Package httpapi holds the HTTP layer for both Relay planes.
|
Package httpapi holds the HTTP layer for both Relay planes. |
|
control
OIDC login for the control plane: GET /auth/oidc/start redirects to the configured provider's hosted login; GET /auth/oidc/callback exchanges the authorization code and mints the same scs session password login mints, so everything downstream of login is identical for both paths.
|
OIDC login for the control plane: GET /auth/oidc/start redirects to the configured provider's hosted login; GET /auth/oidc/callback exchanges the authorization code and mints the same scs session password login mints, so everything downstream of login is identical for both paths. |
|
inference
Package inference's Dispatch is the shape-agnostic per-request flow.
|
Package inference's Dispatch is the shape-agnostic per-request flow. |
|
Package keypool implements per-key circuit-breaker state and configurable Pool selection over healthy keys.
|
Package keypool implements per-key circuit-breaker state and configurable Pool selection over healthy keys. |
|
Package wire handles conversion between the operator-facing YAML/JSON wire format and the domain structs in the app/* entity packages.
|
Package wire handles conversion between the operator-facing YAML/JSON wire format and the domain structs in the app/* entity packages. |
|
Package meta holds the identity primitives every domain entity carries: UUIDv7 id, DNS-1123 slug name, free-text display name, and provenance.
|
Package meta holds the identity primitives every domain entity carries: UUIDv7 id, DNS-1123 slug name, free-text display name, and provenance. |
|
Package metricslog is the Prometheus observer on the lifecycle spine.
|
Package metricslog is the Prometheus observer on the lifecycle spine. |
|
Package model is the domain layer for the Model entity — a container for a family of dated checkpoints (Snapshots).
|
Package model is the domain layer for the Model entity — a container for a family of dated checkpoints (Snapshots). |
|
Package modelref parses the catalog reference DSL used by Policy grants and the /catalog/resolve admin endpoint.
|
Package modelref parses the catalog reference DSL used by Policy grants and the /catalog/resolve admin endpoint. |
|
Package overlay is the domain layer for catalog overlays: user-owned sparse spec patches applied on top of pristine catalog TEMPLATE rows to produce the EFFECTIVE rows the snapshot serves.
|
Package overlay is the domain layer for catalog overlays: user-owned sparse spec patches applied on top of pristine catalog TEMPLATE rows to produce the EFFECTIVE rows the snapshot serves. |
|
Package payloadlog is the second lifecycle observer (after app/usagelog): it captures the full request + response bodies of opted-in requests for audit, debug, and replay, and pushes them to a Sink (file today, S3 next) off the hot path.
|
Package payloadlog is the second lifecycle observer (after app/usagelog): it captures the full request + response bodies of opted-in requests for audit, debug, and replay, and pushes them to a Sink (file today, S3 next) off the hot path. |
|
Package pipeline orchestrates one inference request: reserve inbound budget, acquire an upstream key (and its upstream reservation) via policy.Service, call the adapter, stream back, commit in post-flight.
|
Package pipeline orchestrates one inference request: reserve inbound budget, acquire an upstream key (and its upstream reservation) via policy.Service, call the adapter, stream back, commit in post-flight. |
|
Package policy is the domain layer for the Policy entity — the named group that bundles Models (m:n), ProviderKeys (m:n), and an optional single RateLimit (m:1, the one rule set that applies to traffic through this Policy).
|
Package policy is the domain layer for the Policy entity — the named group that bundles Models (m:n), ProviderKeys (m:n), and an optional single RateLimit (m:1, the one rule set that applies to traffic through this Policy). |
|
Package pricing is the domain layer for the Pricing entity — a named rate sheet owned by a Host and applied to one or more Models.
|
Package pricing is the domain layer for the Pricing entity — a named rate sheet owned by a Host and applied to one or more Models. |
|
Package provider is the domain layer for the Provider entity — the vendor / author of a Model.
|
Package provider is the domain layer for the Provider entity — the vendor / author of a Model. |
|
Package proxy is the second inference flow: transparent forwarding of caller-supplied upstream credentials.
|
Package proxy is the second inference flow: transparent forwarding of caller-supplied upstream credentials. |
|
Package ratelimit is the domain layer for the RateLimit entity — a named rule set (requests / tokens / concurrency caps) attachable to a Policy, ProviderKey, or Model.
|
Package ratelimit is the domain layer for the RateLimit entity — a named rule set (requests / tokens / concurrency caps) attachable to a Policy, ProviderKey, or Model. |
|
Package relaykey is the domain layer for the RelayKey entity — an inbound API key the relay issues to a client.
|
Package relaykey is the domain layer for the RelayKey entity — an inbound API key the relay issues to a client. |
|
PolicyAllows answers "is this Model reachable through this Policy?" without picking a binding or a key — the question /v1/models needs to answer.
|
PolicyAllows answers "is this Model reachable through this Policy?" without picking a binding or a key — the question /v1/models needs to answer. |
|
agent.go implements pipeline.KeyAgent: the out-of-band handler for failed upstream keys.
|
agent.go implements pipeline.KeyAgent: the out-of-band handler for failed upstream keys. |
|
Package seed orchestrates loading YAML config into Postgres for the app/ arch.
|
Package seed orchestrates loading YAML config into Postgres for the app/ arch. |
|
Package session wraps alexedwards/scs/v2 with a kv.Store-backed session store and the small amount of glue that turns scs payloads into our app/actor.Actor.
|
Package session wraps alexedwards/scs/v2 with a kv.Store-backed session store and the small amount of glue that turns scs payloads into our app/actor.Actor. |
|
Package settings is the typed-sectioned config layer.
|
Package settings is the typed-sectioned config layer. |
|
Package settingswatch applies a value-typed settings section to a live consumer, re-applying whenever the section changes.
|
Package settingswatch applies a value-typed settings section to a live consumer, re-applying whenever the section changes. |
|
transport
|
|
|
ws
Package ws is a customer-facing WebSocket transport for the inference data plane.
|
Package ws is a customer-facing WebSocket transport for the inference data plane. |
|
Package usagelog is the first consumer of pkg/lifecycle's Hook + Collector surface.
|
Package usagelog is the first consumer of pkg/lifecycle's Hook + Collector surface. |
|
store.go is the data-access layer for User.
|
store.go is the data-access layer for User. |
Click to show internal directories.
Click to hide internal directories.