Documentation
¶
Index ¶
Constants ¶
const ( // Channel to publish batch metadata updates to, each update contains a list of all Agent IDs that have an update in // the most recent batch MetadataBatchPubsubChannel = "workspace_agent_metadata_batch" )
const (
// uuidBase64Size is the size of a base64-encoded UUID without padding (22 characters).
UUIDBase64Size = 22
)
Variables ¶
This section is empty.
Functions ¶
func EncodeAgentIDChunks ¶
EncodeAgentIDChunks encodes agent IDs into chunks that fit within the PostgreSQL NOTIFY 8KB payload size limit. Each UUID is base64-encoded (without padding) and concatenated into a single byte slice per chunk.
Types ¶
type Batcher ¶
type Batcher struct {
// Metrics collects Prometheus metrics for the batcher.
Metrics Metrics
// contains filtered or unexported fields
}
Batcher holds a buffer of agent metadata updates and periodically flushes them to the database and pubsub. This reduces database write frequency and pubsub publish rate.
func NewBatcher ¶
func NewBatcher(ctx context.Context, reg prometheus.Registerer, store database.Store, ps pubsub.Pubsub, opts ...Option) (*Batcher, error)
NewBatcher creates a new Batcher and starts it. Here ctx controls the lifetime of the batcher, canceling it will result in the Batcher exiting it's processing routine (run).
func (*Batcher) Add ¶
func (b *Batcher) Add(agentID uuid.UUID, keys []string, values []string, errors []string, collectedAt []time.Time) error
Add adds metadata updates for an agent to the batcher by writing to a buffered channel. If the channel is full, updates are dropped. Updates to the same metadata key for the same agent are deduplicated in the batch, keeping only the value with the most recent collectedAt timestamp.
type Metrics ¶
type Metrics struct {
BatchUtilization prometheus.Histogram
FlushDuration *prometheus.HistogramVec
BatchSize prometheus.Histogram
BatchesTotal *prometheus.CounterVec
DroppedKeysTotal prometheus.Counter
MetadataTotal prometheus.Counter
PublishErrors prometheus.Counter
}
func NewMetrics ¶
func NewMetrics() Metrics
func (Metrics) Collectors ¶
func (m Metrics) Collectors() []prometheus.Collector
type Option ¶
type Option func(b *Batcher)
Option is a functional option for configuring a Batcher.
Source Files