Directories
¶
| Path | Synopsis |
|---|---|
|
Package consensus provides Raft-based distributed consensus for leader election and state replication using hashicorp/raft.
|
Package consensus provides Raft-based distributed consensus for leader election and state replication using hashicorp/raft. |
|
Package dag provides directed acyclic graph structures for workflow definitions.
|
Package dag provides directed acyclic graph structures for workflow definitions. |
|
Package executor defines the Executor interface and provides implementations for running tasks via shell, Python, Docker, Spark, Hadoop, and HDFS.
|
Package executor defines the Executor interface and provides implementations for running tasks via shell, Python, Docker, Spark, Hadoop, and HDFS. |
|
Package observability provides OpenTelemetry tracing, Prometheus metrics, and structured logging setup for Sparkflow components.
|
Package observability provides OpenTelemetry tracing, Prometheus metrics, and structured logging setup for Sparkflow components. |
|
Package retry provides retry policies with various backoff strategies and a dead letter queue for tasks that exhaust their retries.
|
Package retry provides retry policies with various backoff strategies and a dead letter queue for tasks that exhaust their retries. |
|
Package scheduler provides task scheduling strategies including FIFO, priority-based, and distributed scheduling with cron support.
|
Package scheduler provides task scheduling strategies including FIFO, priority-based, and distributed scheduling with cron support. |
|
Package store defines the storage interface and provides in-memory and PostgreSQL implementations for DAG and task run persistence.
|
Package store defines the storage interface and provides in-memory and PostgreSQL implementations for DAG and task run persistence. |
Click to show internal directories.
Click to hide internal directories.