pipeline

package
v0.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Aug 27, 2024 License: MIT Imports: 7 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type DataPipeline 

type DataPipeline struct {
	// contains filtered or unexported fields
}

DataPipeline defines the structure for a data processing pipeline

func NewDataPipeline 

func NewDataPipeline(reader interfaces.Reader, writer interfaces.Writer) *DataPipeline

NewDataPipeline creates a new DataPipeline instance

func (*DataPipeline) Start 

func (dp *DataPipeline) Start(ctx context.Context) error

Start begins the pipeline processing

type Metrics 

type Metrics struct {
	RecordsProcessed int
	StartTime        time.Time
	EndTime          time.Time
}

Metrics stores pipeline processing metrics

func (*Metrics) Duration 

func (m *Metrics) Duration() time.Duration

Duration returns the total duration of the pipeline

func (*Metrics) Report 

func (m *Metrics) Report()

Report logs the collected metrics

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.