scheduling

Package bylabel provides filter plugins for the epp.

Package prefixcacheaffinity provides a probabilistic filter that narrows candidates to "sticky" endpoints (those with high prefix cache scores).

Package sessionaffinity provides a session affinity filter plugin for the epp.

Package headroomtier provides a probabilistic filter that selects endpoints based on predicted latency headroom (SLO - predicted).

Package maxscore implements a scheduling picker that selects the endpoint(s) with the highest score calculated during the scoring phase.

Package random implements a scheduling picker that selects endpoints uniformly at random, ignoring any scores calculated by scorer plugins.

Package weightedrandom implements a scheduling picker that selects endpoints randomly, where the probability of an endpoint being selected is proportional to its score.

Package dataparallel provides a data-parallel profile handler plugin for the epp.

Package disagg provides profile handler plugins for the epp.

Package activerequest provides an active request scorer plugin for the epp.

Package contextlengthaware provides plugins that implement multiple extension points (e.g., both Filter and Scorer interfaces).

Package latency provides a scorer that scores endpoints based on predicted latency headroom.

Package loadaware provides a load-aware scorer plugin for the epp.

Package mmcacheaffinity scores endpoints from multimodal encoder-cache match info produced by the request-control multimodal data producer.

Package nohitlru provides a no-hit LRU scorer plugin for the epp.

Package preciseprefixcache provides a precise prefix cache scorer plugin for the epp.

Package sessionaffinity provides a session affinity scorer plugin for the epp.

Package sessionaffinity provides the session header helpers shared by the session-affinity scorer and filter plugins.