indexer

Overview ¶

Command indexer starts the document indexing service.

The indexer consumes document-ingest events from Kafka, tokenises their content (with Porter stemming), and writes inverted-index entries into the appropriate shard. Each shard periodically flushes its in-memory index to immutable on-disk segments for durability.

Usage:

go run ./cmd/indexer [-config configs/development.yaml]