Documentation
¶
Index ¶
- func AddBackendRoutes(mux *http.ServeMux, backendService backendservice.Service, ...)
- func AddModelRoutes(mux *http.ServeMux, stateService stateservice.Service)
- func AddStateRoutes(mux *http.ServeMux, stateService stateservice.Service)
- type ObservedModel
- type OpenAICompatibleModelList
- type OpenAIModel
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func AddBackendRoutes ¶
func AddBackendRoutes(mux *http.ServeMux, backendService backendservice.Service, stateService stateservice.Service)
func AddModelRoutes ¶
func AddModelRoutes(mux *http.ServeMux, stateService stateservice.Service)
func AddStateRoutes ¶
func AddStateRoutes(mux *http.ServeMux, stateService stateservice.Service)
Types ¶
type ObservedModel ¶
type ObservedModel struct {
ID string `json:"id" example:"mistral:instruct"`
Model string `json:"model" example:"mistral:instruct"`
ContextLength int `json:"contextLength" example:"8192"`
CanChat bool `json:"canChat" example:"true"`
CanEmbed bool `json:"canEmbed" example:"false"`
CanPrompt bool `json:"canPrompt" example:"true"`
CanStream bool `json:"canStream" example:"true"`
}
type OpenAICompatibleModelList ¶
type OpenAICompatibleModelList struct {
Object string `json:"object" example:"list"`
Data []OpenAIModel `json:"data"`
}
Click to show internal directories.
Click to hide internal directories.