internal/

Package api is the HTTP layer: chi router, request/response glue, and middleware.

Package apierr is the shared HTTP response envelope: the Tinybird-compatible error shape (ADR 0012) and JSON write helpers.

Package auth is the Redis-backed token store (ADR 0005).

Package branch resolves the current git branch to an isolated ClickHouse workspace database (tr_<branch>).

Package clickhouse is TinyRaven's ClickHouse adapter.

Package config loads TinyRaven runtime configuration.

Package datasource parses .datasource project files into model.Datasource values and persists them in the Redis-backed metadata registry (ADR 0001).

Package deploy implements `tr deploy`: it parses every .datasource/.pipe file in a project directory, validates them all before touching ClickHouse (ADR 0027 — validate-all-then-apply), diffs each datasource against the live ClickHouse schema, applies safe additive migrations, creates materialized views (ADR 0010), and registers the datasource definitions in the metadata registry (ADR 0001).

Package gatherer buffers incoming events in-process and flushes them to ClickHouse in batches (ADRs 0004, 0018).

Package job is the Redis-backed model.JobStore (gap #8): persists completed (and, later, in-flight) async job records so GET /v0/jobs and GET /v0/jobs/{id} have something real to serve instead of a dead job_url.

Package metrics owns the Prometheus registry and the collectors exposed at GET /v0/metrics (Phase 2).

Package model is the shared contract for TinyRaven: the data types parsed from .datasource/.pipe files plus the interfaces that decouple the subsystems (gatherer, pipe executor, clickhouse, auth, api) from each other.

Package openapi emits an OpenAPI 3.0 spec for a TinyRaven deployment from the live pipe registry (ADR 0017).

Package pipe parses .pipe project files into model.Pipe values, stores them in a hot-swappable in-memory registry (ADR 0020), and executes published endpoints against ClickHouse (ADRs 0003, 0009, 0012).

Package pipestats implements model.StatsRecorder: it records per-query observability rows and flushes them to ClickHouse in batches via the shared CHInserter, mirroring the gatherer's max(N, interval) flush (ADR 0014).

Package ratelimit provides per-token request rate limiting for the API.

Package scheduler runs TYPE copy pipes on their COPY_SCHEDULE cron expression — the async-execution half of gap #8 that GET /v0/jobs (internal/job) left deferred.

Package sqlproxy serves GET/POST /v0/sql — a read-only ClickHouse SQL proxy.