Documentation
¶
Index ¶
- func RegisterChatHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, ...)
- func RegisterCompletionHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, ...)
- func RegisterEmbedHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, ...)
- func RegisterHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, ...)
- func RegisterModelHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, ...)
- func RegisterTokenizerHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, ...)
- type HTTPMiddlewareFuncs
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func RegisterChatHandlers ¶ added in v0.0.5
func RegisterChatHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, middleware HTTPMiddlewareFuncs)
RegisterChatHandlers registers HTTP handlers for Chat operations
func RegisterCompletionHandlers ¶
func RegisterCompletionHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, middleware HTTPMiddlewareFuncs)
RegisterCompletionHandlers registers HTTP handlers for Completion operations
func RegisterEmbedHandlers ¶
func RegisterEmbedHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, middleware HTTPMiddlewareFuncs)
RegisterEmbedHandlers registers HTTP handlers for Embed operations
func RegisterHandlers ¶
func RegisterHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, middleware HTTPMiddlewareFuncs)
RegisterHandlers registers all llama HTTP handlers on the provided router with the given path prefix. The Llama instance must be non-nil.
func RegisterModelHandlers ¶
func RegisterModelHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, middleware HTTPMiddlewareFuncs)
RegisterModelHandlers registers HTTP handlers for Model operations
func RegisterTokenizerHandlers ¶
func RegisterTokenizerHandlers(router *http.ServeMux, prefix string, llamaInstance *llamacpp.Llama, middleware HTTPMiddlewareFuncs)
RegisterTokenizerHandlers registers HTTP handlers for Tokenize/Detokenize operations
Types ¶
type HTTPMiddlewareFuncs ¶
type HTTPMiddlewareFuncs []func(http.HandlerFunc) http.HandlerFunc
func (HTTPMiddlewareFuncs) Wrap ¶
func (w HTTPMiddlewareFuncs) Wrap(handler http.HandlerFunc) http.HandlerFunc
Source Files
Click to show internal directories.
Click to hide internal directories.