worker

Overview ¶

cmd/worker is the dedicated crawl worker service. It consumes tasks from Redis Streams, executes crawls, and persists results to Postgres via the batch manager.