monitoring

package

v1.30.2 Latest Latest Go to latest Published: Jul 9, 2025 License: Apache-2.0 Imports: 6 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type MetricsMonitor struct {
	// contains filtered or unexported fields
}

MetricsMonitor holds and updates Prometheus metrics.

func NewMetricsMonitor(p *infprocessor.P, logger logr.Logger) *MetricsMonitor

NewMetricsMonitor returns a new MetricsMonitor.

func (m *MetricsMonitor) ObserveCompletionLatency(modelID string, latency time.Duration)

ObserveCompletionLatency observes a new latency data for a completion request.

func (m *MetricsMonitor) ObserveEmbeddingLatency(modelID string, latency time.Duration)

ObserveEmbeddingLatency observes a new latency data for an embedding request.

func (m *MetricsMonitor) ObserveRequestCount(modelID, tenantID string, statusCode int32)

ObserveRequestCount observes a new request count for a model and tenant.

func (m *MetricsMonitor) ObserveTaskErrorCount()

ObserveTaskErrorCount increments the task error counter.

func (m *MetricsMonitor) Run(ctx context.Context, interval time.Duration) error

Run updates the metrics periodically.

func (m *MetricsMonitor) UnregisterAllCollectors()

UnregisterAllCollectors unregisters all connectors.

func (m *MetricsMonitor) UpdateCompletionRequest(modelID string, c int)

UpdateCompletionRequest updates the number of completion requests.

func (m *MetricsMonitor) UpdateEmbeddingRequest(modelID string, c int)

UpdateEmbeddingRequest updates the number of embedding requests.