Documentation
¶
Overview ¶
Package tpshist 定义生成速度(TPS, tokens/s)直方图档位;插值复用 histutil。 档位偏 20-300 tokens/s 密集(TPS 主分布区)。改档必须配套 rebuild 回填。
Index ¶
Constants ¶
View Source
const NumSlots = 17
Variables ¶
View Source
var Edges = [NumSlots - 1]int64{
5, 10, 20, 30, 40, 50, 75, 100,
125, 150, 200, 250, 300, 400, 500, 750,
}
Functions ¶
func EstimatePercentile ¶
func TokensPerSecond ¶
TokensPerSecond computes tokens*1000/generationMs without overflowing.
Types ¶
This section is empty.
Click to show internal directories.
Click to hide internal directories.