Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CreateAllocationsFromModelAnalyzeResponse ¶
func CreateAllocationsFromModelAnalyzeResponse(response *interfaces.ModelAnalyzeResponse) map[string]*inferno.Allocation
Adapter from a model analyzer response to inferno allocations
func CreateModelAnalyzeResponseFromAllocations ¶
func CreateModelAnalyzeResponseFromAllocations(allocations map[string]*inferno.Allocation) *interfaces.ModelAnalyzeResponse
Adapter from inferno allocations to a model analyzer response
Types ¶
type ModelAnalyzer ¶
type ModelAnalyzer struct {
// contains filtered or unexported fields
}
Performance analyzer of queueing models associated with variant servers
func NewModelAnalyzer ¶
func NewModelAnalyzer(system *inferno.System) *ModelAnalyzer
Create a new instance of a model analyzer
func (*ModelAnalyzer) AnalyzeModel ¶
func (ma *ModelAnalyzer) AnalyzeModel(ctx context.Context, va llmdOptv1alpha1.VariantAutoscaling) *interfaces.ModelAnalyzeResponse
Analyze a particular variant and generate corresponding allocations that achieve SLOs for all accelerators, used by the optimizer
Source Files
Click to show internal directories.
Click to hide internal directories.