Documentation
¶
Index ¶
- Constants
- func IsClientCanceled(err error) bool
- func ListLLMApiHandlerTypes() []string
- func RegisterLLMApiHandlerType(handlerType string)
- func RewriteRoutePath(r *http.Request, prefix string) *http.Request
- func WriteError(logger *zap.Logger, apiName, routeID, model string, w http.ResponseWriter, ...) error
- func WriteLoggedError(logger *zap.Logger, ctx ErrorContext, w http.ResponseWriter, r *http.Request, ...) error
- func WriteProviderError(logger *zap.Logger, ctx ErrorContext, w http.ResponseWriter, r *http.Request, ...) error
- type ErrorContext
- type Handler
- type LLMApiHandler
- type NextHandler
- type PreparedLLMApiRequest
Constants ¶
View Source
const StatusClientClosedRequest = 499
Variables ¶
This section is empty.
Functions ¶
func IsClientCanceled ¶
func ListLLMApiHandlerTypes ¶
func ListLLMApiHandlerTypes() []string
ListLLMApiHandlerTypes returns the types of all registered LLM API handlers.
func RegisterLLMApiHandlerType ¶
func RegisterLLMApiHandlerType(handlerType string)
RegisterLLMApiHandlerType registers an available LLM API handler type.
func RewriteRoutePath ¶
RewriteRoutePath returns a cloned request with the matched route prefix stripped.
func WriteError ¶
func WriteLoggedError ¶
func WriteProviderError ¶
func WriteProviderError(logger *zap.Logger, ctx ErrorContext, w http.ResponseWriter, r *http.Request, err error, phase string) error
Types ¶
type ErrorContext ¶
type Handler ¶
type Handler struct {
// contains filtered or unexported fields
}
Handler dispatches gateway requests to the route-selected LLM API handler.
func NewHandler ¶
func NewHandler(agentGateway *gateway.AgentGateway, apiHandlers map[string]LLMApiHandler, logger *zap.Logger) *Handler
NewHandler constructs a runtime dispatcher handler.
func (*Handler) Dispatch ¶
func (h *Handler) Dispatch(w http.ResponseWriter, r *http.Request, next NextHandler) error
Dispatch handles a request and optionally delegates unmatched requests to next.
type LLMApiHandler ¶
type LLMApiHandler interface {
Name() string
MatchLLMApi(*http.Request) bool
PrepareLLMApiRequest(*http.Request) (*PreparedLLMApiRequest, routepkg.RequestRequirements, error)
ServeLLMApi(http.ResponseWriter, *http.Request, provider.Provider, *PreparedLLMApiRequest) error
}
type NextHandler ¶
type NextHandler interface {
ServeHTTP(http.ResponseWriter, *http.Request) error
}
NextHandler is the small subset of a middleware next handler needed by the dispatcher.
type PreparedLLMApiRequest ¶
type PreparedLLMApiRequest struct {
Type provider.LLMApiRequestType
ChatRequest *provider.ChatRequest
EmbeddingRequest *provider.EmbeddingRequest
ResponsesRequest *provider.ResponsesRequest
StreamRequested bool
RawRequest any
}
func (*PreparedLLMApiRequest) IsValid ¶
func (r *PreparedLLMApiRequest) IsValid() bool
func (*PreparedLLMApiRequest) Model ¶
func (r *PreparedLLMApiRequest) Model() string
func (*PreparedLLMApiRequest) SetModel ¶
func (r *PreparedLLMApiRequest) SetModel(model string)
func (*PreparedLLMApiRequest) Stream ¶
func (r *PreparedLLMApiRequest) Stream() bool
Source Files
Directories
Click to show internal directories.
Click to hide internal directories.