watermark

package
v1.7.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Feb 14, 2026 License: Apache-2.0 Imports: 12 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type HTTPClient

type HTTPClient interface {
	Do(req *http.Request) (*http.Response, error)
}

HTTPClient interface for making HTTP requests (for testing)

type HTTPWatermarkFetcher

type HTTPWatermarkFetcher struct {
	// contains filtered or unexported fields
}

HTTPWatermarkFetcher fetches watermarks from vertex pods via HTTP /runtime/watermark endpoint

func NewHTTPWatermarkFetcher

func NewHTTPWatermarkFetcher(ctx context.Context, pipeline *v1alpha1.Pipeline, edge v1alpha1.Edge) *HTTPWatermarkFetcher

NewHTTPWatermarkFetcher creates a new HTTP-based watermark fetcher and starts background fetching

func (*HTTPWatermarkFetcher) GetWatermarks

func (h *HTTPWatermarkFetcher) GetWatermarks() ([]*wrapperspb.Int64Value, error)

GetWatermarks returns cached watermarks for all partitions of the edge

func (*HTTPWatermarkFetcher) Stop

func (h *HTTPWatermarkFetcher) Stop()

Stop stops the background fetching and cleans up resources

type HTTPWatermarkService

type HTTPWatermarkService struct {
	// contains filtered or unexported fields
}

HTTPWatermarkService manages HTTP-based watermark fetching for all edges in a pipeline

func NewHTTPWatermarkService

func NewHTTPWatermarkService(ctx context.Context, pipeline *v1alpha1.Pipeline) *HTTPWatermarkService

NewHTTPWatermarkService creates a new HTTP watermark service

func (*HTTPWatermarkService) GetPipelineWatermarks

GetPipelineWatermarks fetches watermarks for all edges in the pipeline

func (*HTTPWatermarkService) Stop

func (s *HTTPWatermarkService) Stop()

Stop stops all background fetching and cleans up resources

type Response added in v1.7.0

type Response struct {
	Partitions map[string]int64 `json:"-"` // Use custom unmarshaling
}

Response represents the JSON response from the /runtime/watermark endpoint Example: {"0": 1752314641078, "1": 1752314641079}

func (*Response) UnmarshalJSON added in v1.7.0

func (w *Response) UnmarshalJSON(data []byte) error

UnmarshalJSON implements custom JSON unmarshaling for WatermarkResponse

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL