fetch

package

v0.9.2 Latest Latest Go to latest Published: Aug 23, 2023 License: Apache-2.0 Imports: 13 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/numaproj/numaflow

Links

Documentation ¶

Index ¶

type Fetcher
- func NewEdgeFetcher(ctx context.Context, bucketName string, ...) Fetcher
- func NewSourceFetcher(ctx context.Context, sourceBufferName string, ...) Fetcher

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Fetcher ¶

type Fetcher interface {
	io.Closer
	// GetWatermark returns the inorder monotonically increasing watermark of the edge connected to Vn-1.
	GetWatermark(offset isb.Offset, fromPartitionIdx int32) wmb.Watermark
	// GetHeadWatermark returns the latest watermark among all processors
	GetHeadWatermark(fromPartitionIdx int32) wmb.Watermark
	// GetHeadWMB returns the latest idle WMB among all processors
	GetHeadWMB(fromPartitionIdx int32) wmb.WMB
}

Fetcher fetches watermark data from Vn-1 vertex.

func NewEdgeFetcher ¶ added in v0.5.6

func NewEdgeFetcher(ctx context.Context, bucketName string, storeWatcher store.WatermarkStoreWatcher, manager *processor.ProcessorManager, fromBufferPartitionCount int) Fetcher

NewEdgeFetcher returns a new edge fetcher.

func NewSourceFetcher ¶ added in v0.5.6

func NewSourceFetcher(ctx context.Context, sourceBufferName string, storeWatcher store.WatermarkStoreWatcher, manager *processor.ProcessorManager) Fetcher

NewSourceFetcher returns a new source fetcher, processorManager has the details about the processors responsible for writing to the buckets of the source buffer.

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL