Documentation
¶
Index ¶
Constants ¶
View Source
const ( ModeChat = "chat" ModeAudioSpeech = "audio_speech" ModeAudioTranscription = "audio_transcription" ModeEmbedding = "embedding" ModeImage = "image" )
Mode values align with LiteLLM model_prices_and_context_window.json.
Variables ¶
This section is empty.
Functions ¶
func EstimateCostUSD ¶
EstimateCostUSD computes USD cost from catalog pricing and a usage event. Returns nil when the model is unknown or required pricing/metrics are missing.
Types ¶
type Entry ¶
type Entry struct {
Mode string `json:"mode"`
MaxInputTokens int `json:"max_input_tokens,omitempty"`
MaxOutputTokens int `json:"max_output_tokens,omitempty"`
InputCostPerMTok *float64 `json:"input_cost_per_mtok,omitempty"`
OutputCostPerMTok *float64 `json:"output_cost_per_mtok,omitempty"`
InputCostPerCharacter *float64 `json:"input_cost_per_character,omitempty"`
InputCostPerSecond *float64 `json:"input_cost_per_second,omitempty"`
InputCostPerImage *float64 `json:"input_cost_per_image,omitempty"`
SupportsStreaming *bool `json:"supports_streaming,omitempty"`
SupportsVision bool `json:"supports_vision,omitempty"`
SupportsTools bool `json:"supports_tools,omitempty"`
}
Entry is curated metadata for a provider target model.
func Lookup ¶
Lookup returns curated metadata for (providerType, targetModel). openai_compatible falls back to openai entries for shared model ids.
func (Entry) IsEmbedding ¶
IsEmbedding reports whether the entry is an embeddings model.
func (Entry) StreamingEnabled ¶
StreamingEnabled returns whether streaming is supported (chat default true).
Click to show internal directories.
Click to hide internal directories.