Documentation
¶
Overview ¶
Package metrics implements the Metrics Service for tracking API usage.
Index ¶
- type MetricBucket
- type ModelMetrics
- type ProviderMetrics
- type Service
- func (s *Service) GetDistinctModels() ([]string, error)
- func (s *Service) GetTokenUsage() (map[string]*TokenUsageInfo, error)
- func (s *Service) QueryOverview(filters models.MetricsFilters) (*models.MetricsOverview, error)
- func (s *Service) QueryTimeSeries(metric string, filters models.MetricsFilters) ([]models.TimeSeriesPoint, error)
- func (s *Service) RecordRequest(event models.MetricEvent)
- func (s *Service) Start()
- func (s *Service) Stop()
- type TokenMetrics
- type TokenUsageInfo
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type MetricBucket ¶
type MetricBucket struct {
Timestamp time.Time `json:"timestamp"`
TotalRequests int64 `json:"total_requests"`
TotalErrors int64 `json:"total_errors"`
TokensInput int64 `json:"tokens_input"`
TokensOutput int64 `json:"tokens_output"`
PeakRequests int64 `json:"peak_requests"`
PeakInputTokens int64 `json:"peak_input_tokens"`
PeakOutputTokens int64 `json:"peak_output_tokens"`
DurationSum int64 `json:"duration_sum"` // microseconds
DurationCount int64 `json:"duration_count"` // number of requests with duration
ByProviderID map[string]*ProviderMetrics `json:"by_provider_id"`
ByProviderType map[string]*ProviderMetrics `json:"by_provider_type"`
ByModel map[string]*ModelMetrics `json:"by_model"`
ByTokenID map[string]*TokenMetrics `json:"by_token_id"`
ErrorsByType map[string]int64 `json:"errors_by_type"`
}
MetricBucket represents aggregated metrics for a time window.
type ModelMetrics ¶
type ModelMetrics struct {
Requests int64 `json:"requests"`
Errors int64 `json:"errors"`
TokensInput int64 `json:"tokens_input"`
TokensOutput int64 `json:"tokens_output"`
PeakRequests int64 `json:"peak_requests"`
PeakInputTokens int64 `json:"peak_input_tokens"`
PeakOutputTokens int64 `json:"peak_output_tokens"`
}
ModelMetrics tracks metrics for a specific model.
type ProviderMetrics ¶
type ProviderMetrics struct {
Requests int64 `json:"requests"`
Errors int64 `json:"errors"`
TokensInput int64 `json:"tokens_input"`
TokensOutput int64 `json:"tokens_output"`
PeakRequests int64 `json:"peak_requests"`
PeakInputTokens int64 `json:"peak_input_tokens"`
PeakOutputTokens int64 `json:"peak_output_tokens"`
DurationSum int64 `json:"duration_sum"`
DurationCount int64 `json:"duration_count"`
}
ProviderMetrics tracks metrics for a specific provider.
type Service ¶
type Service struct {
// contains filtered or unexported fields
}
Service manages metrics collection, aggregation, and querying on the cache SQLite handle.
func (*Service) GetDistinctModels ¶
GetDistinctModels returns a list of unique models from metrics data: in-memory buckets plus the SQLite model dimension rows.
func (*Service) GetTokenUsage ¶
func (s *Service) GetTokenUsage() (map[string]*TokenUsageInfo, error)
GetTokenUsage returns usage statistics for each token.
func (*Service) QueryOverview ¶
func (s *Service) QueryOverview(filters models.MetricsFilters) (*models.MetricsOverview, error)
QueryOverview returns aggregated metrics for the specified filters.
func (*Service) QueryTimeSeries ¶
func (s *Service) QueryTimeSeries(metric string, filters models.MetricsFilters) ([]models.TimeSeriesPoint, error)
QueryTimeSeries returns time-series data for a specific metric.
func (*Service) RecordRequest ¶
func (s *Service) RecordRequest(event models.MetricEvent)
RecordRequest records a metric event (non-blocking).
type TokenMetrics ¶
type TokenMetrics struct {
Requests int64 `json:"requests"`
Errors int64 `json:"errors"`
TokensInput int64 `json:"tokens_input"`
TokensOutput int64 `json:"tokens_output"`
PeakRequests int64 `json:"peak_requests"`
PeakInputTokens int64 `json:"peak_input_tokens"`
PeakOutputTokens int64 `json:"peak_output_tokens"`
LastUsed *time.Time `json:"last_used,omitempty"`
}
TokenMetrics tracks metrics for a specific token.
type TokenUsageInfo ¶
type TokenUsageInfo struct {
Requests int64 `json:"requests"`
LastUsed *time.Time `json:"last_used,omitempty"`
}
TokenUsageInfo contains usage statistics for a token.