Documentation
¶
Overview ¶
Package loadshed provides graceful load shedding middleware for the switchAILocal proxy. When in-flight requests exceed a configurable threshold, new requests are rejected with HTTP 503 and a Retry-After header, preventing system degradation under burst load.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func Middleware ¶
func Middleware(cfg config.LoadSheddingConfig) gin.HandlerFunc
Middleware returns a Gin middleware that tracks in-flight requests and sheds load when the threshold is exceeded.
The in-flight counter uses atomic operations for zero-contention tracking. This middleware should be positioned early in the chain, after basic recovery/logging but before auth and routing.
Types ¶
This section is empty.
Source Files
Click to show internal directories.
Click to hide internal directories.