Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Simulator ¶
Simulator represents a concurrent pipeline simulator that orchestrates multiple processing stages in a data flow pipeline.
func NewSimulator ¶
func NewSimulator() *Simulator
NewSimulator creates a new simulator for a specific pipeline.
func (*Simulator) AddStage ¶
AddStage adds a new stage to the pipeline with validation.
Validation rules:
- Stage cannot be nil
- Stage name cannot be empty
- Stage name must be unique within the pipeline
- Stage config cannot be nil
func (*Simulator) GetStages ¶
GetStages returns a copy of all stages in the pipeline. used by test package
type Stage ¶
type Stage struct {
Name string
Config *StageConfig
// contains filtered or unexported fields
}
Stage represents a processing stage in the pipeline
func NewStage ¶
func NewStage(name string, config *StageConfig) *Stage
NewStage creates a new stage with the provided config or creates a default one.
func (*Stage) GetMetrics ¶
func (s *Stage) GetMetrics() *stageMetrics
GetMetrics is a getting. Used by the test package
type StageConfig ¶
type StageConfig struct {
// Rate at which items are generated (generator only)
InputRate time.Duration
// Custom item generator function (generator only)
ItemGenerator func() any
// Number of goroutines per stage
RoutineNum int
// Channel buffer size per stage
BufferSize int
// Simulated delay per item
WorkerDelay time.Duration
// Number of times to retry on error, since your custom function
// could fail.
RetryCount int
// Drop input if channel is full, when not set to drop it will block
// in case the channels are full.
DropOnBackpressure bool
// Custom worker function that processes each item
WorkerFunc func(item any) (any, error)
// contains filtered or unexported fields
}
StageConfig holds the configuration for a pipeline stage, it can be shared among all pipelines.
func DefaultConfig ¶
func DefaultConfig() *StageConfig
DefaultConfig returns a new SimulationConfig with sensible defaults Used by test package
Source Files
Directories