Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type TokenAccountant ¶
type TokenAccountant struct {
sleipnir.BaseMiddleware
// contains filtered or unexported fields
}
TokenAccountant is an LLMObserver that tracks per-agent token usage. Failed LLM calls are not counted.
func (*TokenAccountant) OnLLMCall ¶
func (a *TokenAccountant) OnLLMCall(_ context.Context, req *sleipnir.LLMRequest, resp *sleipnir.LLMResponse, err error)
func (*TokenAccountant) Total ¶
func (a *TokenAccountant) Total() sleipnir.Usage
Click to show internal directories.
Click to hide internal directories.