etl

command
v1.2.12 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 1, 2026 License: Apache-2.0 Imports: 8 Imported by: 0

README

ETL Local Runner

Runs the ETL indexer against a production RPC endpoint and local Postgres. Migrations run automatically on startup.

Quickstart

Start a local Postgres:

docker run -d --name etl-postgres \
  -e POSTGRES_PASSWORD=postgres \
  -e POSTGRES_DB=etl_local \
  -p 5432:5432 \
  postgres:16

Run the indexer:

go run ./examples/etl \
  --rpc https://rpc.audius.co \
  --db "postgres://postgres:postgres@localhost:5432/etl_local?sslmode=disable" \
  --start 21343648

Flags

Flag Env Var Description
--rpc ETL_RPC_URL Core RPC endpoint
--db ETL_DB_URL Postgres connection string
--start Starting block height (0 = resume from last indexed)

Documentation

Overview

etl runs the ETL indexer against a production RPC and local Postgres.

It creates all necessary tables via migrations, then indexes blocks and prints each transaction's payload before processing and a completion message after.

Usage:

go run ./examples/etl \
  --rpc https://core.audius.co \
  --db "postgres://localhost:5432/etl_local?sslmode=disable"

Environment variables ETL_RPC_URL and ETL_DB_URL are used as fallbacks.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL