Directories
¶
| Path | Synopsis |
|---|---|
|
Package capability provides a middleware that overrides a model's reported ai.Capabilities with a declarative, field-level ai.CapabilityOverride.
|
Package capability provides a middleware that overrides a model's reported ai.Capabilities with a declarative, field-level ai.CapabilityOverride. |
|
Package ratelimit provides a client-side rate-limiting ai.LanguageModel middleware with two token buckets: requests per minute (RPM) and estimated input tokens per minute (TPM), the two quota dimensions LLM providers enforce.
|
Package ratelimit provides a client-side rate-limiting ai.LanguageModel middleware with two token buckets: requests per minute (RPM) and estimated input tokens per minute (TPM), the two quota dimensions LLM providers enforce. |
|
Package retry provides a retrying ai.LanguageModel middleware with exponential backoff and full jitter.
|
Package retry provides a retrying ai.LanguageModel middleware with exponential backoff and full jitter. |
Click to show internal directories.
Click to hide internal directories.