Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func PrettyPrint ¶ added in v0.1.1
PrettyPrint marshals the provided value into a pretty-printed JSON string.
Types ¶
type DataPipeline ¶
type DataPipeline struct {
// contains filtered or unexported fields
}
DataPipeline defines the structure for a data processing pipeline
func NewDataPipeline ¶
func NewDataPipeline(reader interfaces.Reader, writer interfaces.Writer) *DataPipeline
NewDataPipeline creates a new DataPipeline instance
func (*DataPipeline) Done ¶ added in v0.1.1
func (dp *DataPipeline) Done() <-chan error
Done returns a channel that the pipeline can be waited on
func (*DataPipeline) Metrics ¶ added in v0.1.1
func (dp *DataPipeline) Metrics() *Metrics
Metrics returns the pipeline metrics
type Metrics ¶
type Metrics struct {
RecordsProcessed int64
TotalBytes int64
StartTime time.Time
EndTime time.Time
TotalDuration int64 // nanoseconds
Throughput int64 // records per second * 100 (for two decimal places)
ThroughputBytes int64 // bytes per second
// contains filtered or unexported fields
}
Metrics stores pipeline processing metrics
func (*Metrics) UpdateMetrics ¶ added in v0.1.1
func (m *Metrics) UpdateMetrics()
UpdateMetrics calculates the total duration, throughput, and throughput in bytes.
Source Files
Click to show internal directories.
Click to hide internal directories.