pkg/

directory
v0.0.0-...-84a1714 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 8, 2026 License: Apache-2.0

Directories

Path Synopsis
Package admin is Murmur's read-only control plane.
Package admin is Murmur's read-only control plane.
exec
bootstrap
Package bootstrap drives a Murmur pipeline in Bootstrap mode: it reads from a SnapshotSource (Mongo collection scan, DynamoDB ParallelScan, etc.), applies the pipeline's key/value extractors and monoid Combine, and writes to the primary state store — populating initial state when the live event stream lacks full history.
Package bootstrap drives a Murmur pipeline in Bootstrap mode: it reads from a SnapshotSource (Mongo collection scan, DynamoDB ParallelScan, etc.), applies the pipeline's key/value extractors and monoid Combine, and writes to the primary state store — populating initial state when the live event stream lacks full history.
lambda/dynamodbstreams
Package dynamodbstreams hosts a Murmur pipeline behind an AWS Lambda DynamoDB Streams trigger.
Package dynamodbstreams hosts a Murmur pipeline behind an AWS Lambda DynamoDB Streams trigger.
lambda/kinesis
Package kinesis hosts a Murmur pipeline behind an AWS Lambda Kinesis trigger.
Package kinesis hosts a Murmur pipeline behind an AWS Lambda Kinesis trigger.
lambda/sqs
Package sqs hosts a Murmur pipeline behind an AWS Lambda SQS trigger.
Package sqs hosts a Murmur pipeline behind an AWS Lambda SQS trigger.
processor
Package processor is the shared per-record processing core that every Murmur runtime delegates to.
Package processor is the shared per-record processing core that every Murmur runtime delegates to.
replay
Package replay drives a Murmur pipeline in Replay mode: it consumes historical events from a replay.Driver (typically S3-archived Firehose/Kafka-Connect output, or a Kafka offset range under tiered storage) and applies the same monoid Combine the live runtime would.
Package replay drives a Murmur pipeline in Replay mode: it consumes historical events from a replay.Driver (typically S3-archived Firehose/Kafka-Connect output, or a Kafka offset range under tiered storage) and applies the same monoid Combine the live runtime would.
streaming
Package streaming runs a Murmur Pipeline in Live mode: it reads records from the pipeline's Source, applies the user's key/value extractors and monoid Combine, writes to the primary state store (and optionally a cache), and Acks the source record.
Package streaming runs a Murmur Pipeline in Live mode: it reads records from the pipeline's Source, applies the user's key/value extractors and monoid Combine, writes to the primary state store (and optionally a cache), and Acks the source record.
Package metrics is Murmur's observability surface.
Package metrics is Murmur's observability surface.
Package monoid defines the structural-monoid abstraction at the heart of Murmur.
Package monoid defines the structural-monoid abstraction at the heart of Murmur.
compose
Package compose provides higher-order monoids that combine simpler monoids:
Package compose provides higher-order monoids that combine simpler monoids:
core
Package core provides the standard numeric and basic monoids: Sum, Count, Min, Max, First, Last, Set.
Package core provides the standard numeric and basic monoids: Sum, Count, Min, Max, First, Last, Set.
monoidlaws
Package monoidlaws provides reusable test helpers that verify a monoid.Monoid[V] satisfies the algebraic laws (associativity and identity) required for safe use in Murmur pipelines.
Package monoidlaws provides reusable test helpers that verify a monoid.Monoid[V] satisfies the algebraic laws (associativity and identity) required for safe use in Murmur pipelines.
sketch
Package sketch defines probabilistic-aggregation monoids: HLL (cardinality), TopK (heavy hitters), and Bloom (set membership).
Package sketch defines probabilistic-aggregation monoids: HLL (cardinality), TopK (heavy hitters), and Bloom (set membership).
sketch/bloom
Package bloom is a Bloom filter implementation of monoid.Monoid[[]byte], suitable for approximate set-membership aggregations.
Package bloom is a Bloom filter implementation of monoid.Monoid[[]byte], suitable for approximate set-membership aggregations.
sketch/hll
Package hll is a HyperLogLog implementation of monoid.Monoid[[]byte], suitable for approximate-cardinality aggregations.
Package hll is a HyperLogLog implementation of monoid.Monoid[[]byte], suitable for approximate-cardinality aggregations.
sketch/topk
Package topk is a Misra-Gries top-K heavy-hitters implementation of monoid.Monoid[[]byte].
Package topk is a Misra-Gries top-K heavy-hitters implementation of monoid.Monoid[[]byte].
windowed
Package windowed expresses time-bucketed aggregations on top of any structural monoid.
Package windowed expresses time-bucketed aggregations on top of any structural monoid.
Package murmur is a thin facade over pkg/pipeline for the most common pipeline shapes.
Package murmur is a thin facade over pkg/pipeline for the most common pipeline shapes.
observability
autoscale
Package autoscale emits scaling signals from a Murmur worker so an upstream autoscaler (ECS Fargate target tracking, Kubernetes HPA via the CloudWatch adapter, etc.) can adjust replica count to load.
Package autoscale emits scaling signals from a Murmur worker so an upstream autoscaler (ECS Fargate target tracking, Kubernetes HPA via the CloudWatch adapter, etc.) can adjust replica count to load.
Package pipeline is the Murmur DSL surface — the entry point users touch when defining an aggregation.
Package pipeline is the Murmur DSL surface — the entry point users touch when defining an aggregation.
Package projection provides bucket functions and transition detection for projecting Murmur counter state into search indices, dashboards, or any external system that benefits from a coarse, slow-moving view of a fast-moving counter.
Package projection provides bucket functions and transition detection for projecting Murmur counter state into search indices, dashboards, or any external system that benefits from a coarse, slow-moving view of a fast-moving counter.
Package query provides the read-side merge logic Murmur uses to assemble sliding-window query results from per-bucket state.
Package query provides the read-side merge logic Murmur uses to assemble sliding-window query results from per-bucket state.
grpc
Package grpc serves Murmur's read-side query layer for an application data plane.
Package grpc serves Murmur's read-side query layer for an application data plane.
typed
Package typed provides typed wrappers around the generic Murmur QueryService — the building block for application services that want to expose typed protos to their callers rather than the generic Value{bytes} shape.
Package typed provides typed wrappers around the generic Murmur QueryService — the building block for application services that want to expose typed protos to their callers rather than the generic Value{bytes} shape.
Package replay defines the ReplayDriver contract for Murmur's backfill mode.
Package replay defines the ReplayDriver contract for Murmur's backfill mode.
s3
Package s3 provides a replay.Driver that reads JSON-Lines event archives from S3 (or any S3-compatible store like MinIO) and feeds the records into the pipeline.
Package s3 provides a replay.Driver that reads JSON-Lines event archives from S3 (or any S3-compatible store like MinIO) and feeds the records into the pipeline.
Package source defines the live-event Source contract that Murmur pipelines read from.
Package source defines the live-event Source contract that Murmur pipelines read from.
kafka
Package kafka provides a Kafka-backed implementation of source.Source via the franz-go client.
Package kafka provides a Kafka-backed implementation of source.Source via the franz-go client.
kinesis
Package kinesis provides a Kinesis Data Streams source via aws-sdk-go-v2.
Package kinesis provides a Kinesis Data Streams source via aws-sdk-go-v2.
snapshot
Package snapshot defines the SnapshotSource contract used by Murmur's Bootstrap execution mode.
Package snapshot defines the SnapshotSource contract used by Murmur's Bootstrap execution mode.
snapshot/dynamodb
Package dynamodb provides a snapshot.Source backed by DynamoDB ParallelScan, suitable for bootstrapping a Murmur pipeline from a DDB-resident OLTP table.
Package dynamodb provides a snapshot.Source backed by DynamoDB ParallelScan, suitable for bootstrapping a Murmur pipeline from a DDB-resident OLTP table.
snapshot/jsonl
Package jsonl provides a snapshot.Source that reads JSON Lines from any io.Reader — local files, S3 objects, gzip streams, etc.
Package jsonl provides a snapshot.Source that reads JSON Lines from any io.Reader — local files, S3 objects, gzip streams, etc.
snapshot/mongo
Package mongo provides a Mongo-backed implementation of snapshot.Source for Murmur's Bootstrap execution mode.
Package mongo provides a Mongo-backed implementation of snapshot.Source for Murmur's Bootstrap execution mode.
snapshot/s3
Package s3 provides a snapshot.Source that scans every JSON-Lines object under an S3 prefix and emits records for bootstrap.
Package s3 provides a snapshot.Source that scans every JSON-Lines object under an S3 prefix and emits records for bootstrap.
Package state defines the StateStore abstraction Murmur pipelines write aggregations to.
Package state defines the StateStore abstraction Murmur pipelines write aggregations to.
dynamodb
Package dynamodb provides a DynamoDB-backed implementation of state.Store, the source-of-truth state for Murmur pipelines.
Package dynamodb provides a DynamoDB-backed implementation of state.Store, the source-of-truth state for Murmur pipelines.
valkey
Package valkey provides Valkey-backed cache implementations of state.Cache.
Package valkey provides Valkey-backed cache implementations of state.Cache.
Package swap manages atomic state-table version pointers for backfill cutover.
Package swap manages atomic state-table version pointers for backfill cutover.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL