Documentation
¶
Overview ¶
Package guardrail tracks daily token usage and enforces limits.
Index ¶
- Constants
- func FormatUsage(u Usage, limit int64) string
- func WrapModel(llm model.LLM, tracker *Tracker) model.LLM
- type LimitExceededError
- type Tracker
- func (t *Tracker) Add(inputTokens, outputTokens int32) error
- func (t *Tracker) Check() error
- func (t *Tracker) ContextPercentUsed() float64
- func (t *Tracker) ContextWindowSize() int64
- func (t *Tracker) Current() Usage
- func (t *Tracker) LastPromptTokens() int64
- func (t *Tracker) Limit() int64
- func (t *Tracker) PercentUsed() float64
- func (t *Tracker) Remaining() int64
- func (t *Tracker) SetContextWindowSize(size int64)
- func (t *Tracker) SetLimit(limit int64)
- func (t *Tracker) TotalUsed() int64
- type Usage
Constants ¶
const DefaultMaxDailyTokens = 50000000
DefaultMaxDailyTokens is the default daily token limit.
Variables ¶
This section is empty.
Functions ¶
func FormatUsage ¶
FormatUsage returns a human-readable usage summary.
Types ¶
type LimitExceededError ¶
LimitExceededError is returned when the daily token limit is reached.
func (*LimitExceededError) Error ¶
func (e *LimitExceededError) Error() string
type Tracker ¶
type Tracker struct {
// contains filtered or unexported fields
}
Tracker tracks daily token usage and enforces a configurable limit.
func New ¶
New creates a tracker with the given daily token limit. It loads any existing usage for today from ~/.pi-go/usage.json.
func NewWithPath ¶
NewWithPath creates a tracker with a custom file path (for testing).
func (*Tracker) Add ¶
Add records token usage from an LLM response. Returns an error if the daily limit would be exceeded.
func (*Tracker) ContextPercentUsed ¶ added in v0.0.18
ContextPercentUsed returns the percentage of the context window used (0-100+). Returns 0 if context window size is unknown.
func (*Tracker) ContextWindowSize ¶ added in v0.0.18
ContextWindowSize returns the model's context window size.
func (*Tracker) LastPromptTokens ¶ added in v0.0.18
LastPromptTokens returns the most recent prompt token count from an LLM response. This represents how much of the context window is currently used.
func (*Tracker) PercentUsed ¶
PercentUsed returns the percentage of daily limit consumed (0-100+). Returns 0 if unlimited.
func (*Tracker) Remaining ¶
Remaining returns how many tokens are left today. Returns -1 if unlimited.
func (*Tracker) SetContextWindowSize ¶ added in v0.0.18
SetContextWindowSize sets the model's context window size for display.
type Usage ¶
type Usage struct {
Date string `json:"date"` // YYYY-MM-DD
InputTokens int64 `json:"input_tokens"` // total prompt tokens
OutputTokens int64 `json:"output_tokens"` // total completion tokens
Requests int64 `json:"requests"` // number of LLM calls
}
Usage tracks token consumption for the current day.
func (*Usage) TotalTokens ¶
TotalTokens returns the combined input + output token count.
Source Files