Documentation
¶
Index ¶
- func CheckLlamaCPPInstalled() bool
- func CheckOllamaInstalled() bool
- func CheckVLLMInstalled() bool
- func GetAnthropicModels() []string
- func GetAvailableModels(providerName string, apiKey string) ([]string, error)
- func GetDeepseekModels() []string
- func GetGoogleModels() []string
- func GetLlamaCPPModels() ([]string, error)
- func GetOpenAIModels(apiKey string) ([]string, error)
- func GetSakanaModels() []string
- func GetXAIModels() []string
- type OllamaModel
- type VLLMModel
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CheckLlamaCPPInstalled ¶ added in v0.0.178
func CheckLlamaCPPInstalled() bool
CheckLlamaCPPInstalled checks if the llama.cpp CLI is installed and runnable.
func CheckOllamaInstalled ¶
func CheckOllamaInstalled() bool
CheckOllamaInstalled checks if the Ollama CLI is installed and runnable.
func CheckVLLMInstalled ¶ added in v0.0.71
func CheckVLLMInstalled() bool
CheckVLLMInstalled checks if the vLLM server is running and accessible.
func GetAnthropicModels ¶
func GetAnthropicModels() []string
GetAnthropicModels returns a hardcoded list of known Anthropic models.
func GetAvailableModels ¶
GetAvailableModels retrieves the list of available models for a given provider. For providers like OpenAI and Ollama, it requires the API key or connection. For others, it returns a hardcoded list.
func GetDeepseekModels ¶
func GetDeepseekModels() []string
GetDeepseekModels returns a hardcoded list of known Deepseek models.
func GetGoogleModels ¶
func GetGoogleModels() []string
GetGoogleModels returns a hardcoded list of known Google models.
func GetLlamaCPPModels ¶ added in v0.0.178
GetLlamaCPPModels discovers GGUF models from LLAMA_CPP_MODEL_DIR or LLAMA_CPP_MODEL_DIRS.
func GetOpenAIModels ¶
GetOpenAIModels fetches the list of available models from the OpenAI API.
func GetSakanaModels ¶ added in v0.0.187
func GetSakanaModels() []string
GetSakanaModels returns a hardcoded list of known Sakana models.
func GetXAIModels ¶
func GetXAIModels() []string
GetXAIModels returns a hardcoded list of known X.AI models.
Types ¶
type OllamaModel ¶
type OllamaModel struct {
Name string `json:"name"`
ModTime string `json:"modified_at"`
Size int64 `json:"size"`
}
OllamaModel represents the structure of a model returned by the Ollama API
func GetOllamaModels ¶
func GetOllamaModels() ([]OllamaModel, error)
GetOllamaModels fetches the list of locally available models from the Ollama API.
type VLLMModel ¶ added in v0.0.71
type VLLMModel struct {
ID string `json:"id"`
Object string `json:"object"`
Created int64 `json:"created"`
OwnedBy string `json:"owned_by"`
}
VLLMModel represents a model available on the vLLM server
func GetVLLMModels ¶ added in v0.0.71
GetVLLMModels fetches the list of models available from the vLLM server.