Documentation
¶
Index ¶
- Constants
- type PricingData
- type PricingEntry
- type PricingManager
- func (pm *PricingManager) CalculateCost(result *schemas.BifrostResponse, provider schemas.ModelProvider, model string, ...) float64
- func (pm *PricingManager) CalculateCostFromUsage(provider string, model string, usage *schemas.LLMUsage, ...) float64
- func (pm *PricingManager) CalculateCostWithCacheDebug(result *schemas.BifrostResponse, provider schemas.ModelProvider, model string, ...) float64
- func (pm *PricingManager) Cleanup() error
Constants ¶
View Source
const ( DefaultPricingSyncInterval = 24 * time.Hour LastPricingSyncKey = "LastModelPricingSync" PricingFileURL = "https://getbifrost.ai/datasheet" TokenTierAbove128K = 128000 )
Default sync interval and config key
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type PricingData ¶
type PricingData map[string]PricingEntry
PricingData represents the structure of the pricing.json file
type PricingEntry ¶
type PricingEntry struct {
// Basic pricing
InputCostPerToken float64 `json:"input_cost_per_token"`
OutputCostPerToken float64 `json:"output_cost_per_token"`
Provider string `json:"provider"`
Mode string `json:"mode"`
// Additional pricing for media
InputCostPerImage *float64 `json:"input_cost_per_image,omitempty"`
InputCostPerVideoPerSecond *float64 `json:"input_cost_per_video_per_second,omitempty"`
InputCostPerAudioPerSecond *float64 `json:"input_cost_per_audio_per_second,omitempty"`
// Character-based pricing
InputCostPerCharacter *float64 `json:"input_cost_per_character,omitempty"`
OutputCostPerCharacter *float64 `json:"output_cost_per_character,omitempty"`
// Pricing above 128k tokens
InputCostPerTokenAbove128kTokens *float64 `json:"input_cost_per_token_above_128k_tokens,omitempty"`
InputCostPerCharacterAbove128kTokens *float64 `json:"input_cost_per_character_above_128k_tokens,omitempty"`
InputCostPerImageAbove128kTokens *float64 `json:"input_cost_per_image_above_128k_tokens,omitempty"`
InputCostPerVideoPerSecondAbove128kTokens *float64 `json:"input_cost_per_video_per_second_above_128k_tokens,omitempty"`
InputCostPerAudioPerSecondAbove128kTokens *float64 `json:"input_cost_per_audio_per_second_above_128k_tokens,omitempty"`
OutputCostPerTokenAbove128kTokens *float64 `json:"output_cost_per_token_above_128k_tokens,omitempty"`
OutputCostPerCharacterAbove128kTokens *float64 `json:"output_cost_per_character_above_128k_tokens,omitempty"`
// Cache and batch pricing
CacheReadInputTokenCost *float64 `json:"cache_read_input_token_cost,omitempty"`
InputCostPerTokenBatches *float64 `json:"input_cost_per_token_batches,omitempty"`
OutputCostPerTokenBatches *float64 `json:"output_cost_per_token_batches,omitempty"`
}
PricingEntry represents a single model's pricing information
type PricingManager ¶
type PricingManager struct {
// contains filtered or unexported fields
}
func Init ¶
func Init(configStore configstore.ConfigStore, logger schemas.Logger) (*PricingManager, error)
func (*PricingManager) CalculateCost ¶
func (pm *PricingManager) CalculateCost(result *schemas.BifrostResponse, provider schemas.ModelProvider, model string, requestType schemas.RequestType) float64
func (*PricingManager) CalculateCostFromUsage ¶
func (pm *PricingManager) CalculateCostFromUsage(provider string, model string, usage *schemas.LLMUsage, requestType schemas.RequestType, isCacheRead bool, isBatch bool, audioSeconds *int, audioTokenDetails *schemas.AudioTokenDetails) float64
CalculateCostFromUsage calculates cost in dollars using pricing manager and usage data with conditional pricing
func (*PricingManager) CalculateCostWithCacheDebug ¶ added in v1.0.11
func (pm *PricingManager) CalculateCostWithCacheDebug(result *schemas.BifrostResponse, provider schemas.ModelProvider, model string, requestType schemas.RequestType) float64
func (*PricingManager) Cleanup ¶
func (pm *PricingManager) Cleanup() error
Source Files
Click to show internal directories.
Click to hide internal directories.