cmd

package
v0.0.0-...-70ed722 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 29, 2024 License: Apache-2.0 Imports: 14 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func Execute

func Execute()

Types

type BenchmarkResult

type BenchmarkResult struct {
	TTFT         time.Duration
	InputTokens  int
	OutputTokens int
	Throughput   float64
}

type BenchmarkSetup

type BenchmarkSetup struct {
	Model              string
	BaseURL            string
	NumIterations      int
	Concurrency        int
	MeanInputTokens    int
	StddevInputTokens  int
	MeanOutputTokens   int
	StddevOutputTokens int
}

type SystemTime

type SystemTime struct{}

func (*SystemTime) Now

func (s *SystemTime) Now() time.Time

func (*SystemTime) Since

func (s *SystemTime) Since(t time.Time) time.Duration

type TimeProvider

type TimeProvider interface {
	Now() time.Time
	Since(time.Time) time.Duration
}

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL