Versions in this module Expand all Collapse all v0 v0.32.3 Jun 18, 2026 Changes in this version + type ColdPrefill struct + MS float64 + PromptTPS float64 + TTFTMS float64 + Tokens int + type Decode struct + OutputTokens int + TokensPerSec float64 + type EditedStable struct + ActualCacheMiss bool + ExpectedCacheMiss bool + OutputEqualsCold bool + type FailureCases struct + CancelDecode bool + OverContext bool + type Harness interface + OpenSession func(ctx context.Context) (transport.Session, error) + Turn func(stable, suffix string) (transport.PrefixInput, transport.SuffixInput) + type Report struct + Backend string + BackendVersion string + ColdFullPrefill ColdPrefill + Decode Decode + EditedStable EditedStable + FailureCases FailureCases + Mode string + Model string + Notes []string + Profile string + SuffixTTFTCurve []SuffixTTFT + WarmChangedSuffix WarmChanged + WarmSamePrefix WarmSame + func Run(ctx context.Context, h Harness, sc Scenario, meta Report) (Report, error) + type Scenario struct + ChangedSuffix string + EditedStable string + MaxDecode int + Stable string + Suffix string + SuffixCurve []string + type SuffixTTFT struct + SuffixTokens int + TTFTMS float64 + type WarmChanged struct + CachedTokens int + MS float64 + OutputEqualsCold bool + SuffixTokens int + TTFTMS float64 + type WarmSame struct + CachedTokens int + HitRate float64 + MS float64 + NewTokens int + TTFTMS float64
Go to main page