README
¶
Anthropic Messages Adapter
Use this adapter when you need Anthropic Messages behavior or an Anthropic-compatible provider preset.
Preset-backed providers using this adapter:
- Anthropic
- Moonshot
- Ollama
Best fit
Choose this adapter when your application benefits from:
- Claude-style thinking and signed reasoning continuation
- Anthropic-native tool calling
- Strict tool-use and tool-result conversation handling
- Anthropic ephemeral cache controls
- PDF input
- Server-side web search
- Thinking streaming
High-level support
| Capability | Support |
|---|---|
| Text input and output | Supported |
| Image input | Supported |
| File input | Partial, PDF-focused |
| Text streaming | Supported |
| Thinking streaming | Supported where upstream thinking is emitted |
| Reasoning configuration | Supported |
| Reasoning history | Supported for Anthropic-compatible signed or redacted thinking |
| JSON Schema output | Supported |
| Output verbosity | Supported |
| Stop sequences | Supported |
| Function tools | Supported |
| Custom tools | Supported |
| Web search | Supported |
| Tool policy | Supported |
| Cache control | Supported at several Anthropic-compatible scopes |
| URL citations | Supported where returned by Anthropic-compatible content |
| Audio/video/image output | Not normalized |
Important guidance
Thinking and temperature
Some Anthropic models do not accept temperature while thinking is enabled.
Use the model preset resolver and inspect warnings. The normalizer removes temperature when the effective model capability profile requires that behavior.
Tool-result ordering
Anthropic tool history is stricter than many OpenAI-compatible APIs.
When a model emits a client tool call:
- Preserve the assistant tool call.
- Return matching tool output in the next user turn.
- Do not leave unresolved tool calls at the end of request history.
The Anthropic tool round-trip example demonstrates the required conversation shape.
Reasoning history
Reuse Anthropic signed or redacted reasoning only with compatible Anthropic-family continuations.
Do not expect ordinary reasoning text from another provider to work as Anthropic thinking history.
Files
PDF input is the supported file path.
Plain-text and other file formats are not currently portable through this adapter.
Cache control
Anthropic cache behavior is designed around ephemeral cache controls.
Use the effective model capability resolver because provider/model presets can narrow cache support.
Working examples
Documentation
¶
Index ¶
- type AnthropicMessagesAPI
- func (api *AnthropicMessagesAPI) DeInitLLM(ctx context.Context) error
- func (api *AnthropicMessagesAPI) FetchCompletion(ctx context.Context, inReq *spec.FetchCompletionRequest, ...) (*spec.FetchCompletionResponse, error)
- func (api *AnthropicMessagesAPI) GetProviderCapability(ctx context.Context) (spec.ModelCapabilities, error)
- func (api *AnthropicMessagesAPI) GetProviderInfo(ctx context.Context) *spec.ProviderParam
- func (api *AnthropicMessagesAPI) InitLLM(ctx context.Context) error
- func (api *AnthropicMessagesAPI) IsConfigured(ctx context.Context) bool
- func (api *AnthropicMessagesAPI) SetProviderAPIKey(ctx context.Context, apiKey string) error
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type AnthropicMessagesAPI ¶
type AnthropicMessagesAPI struct {
ProviderParam *spec.ProviderParam
// contains filtered or unexported fields
}
AnthropicMessagesAPI implements CompletionProvider for Anthropics' Messages API.
func NewAnthropicMessagesAPI ¶
func NewAnthropicMessagesAPI( pi spec.ProviderParam, debugger spec.CompletionDebugger, ) (*AnthropicMessagesAPI, error)
NewAnthropicMessagesAPI creates a new instance of Anthropics provider.
func (*AnthropicMessagesAPI) DeInitLLM ¶
func (api *AnthropicMessagesAPI) DeInitLLM(ctx context.Context) error
func (*AnthropicMessagesAPI) FetchCompletion ¶
func (api *AnthropicMessagesAPI) FetchCompletion( ctx context.Context, inReq *spec.FetchCompletionRequest, opts *spec.FetchCompletionOptions, ) (*spec.FetchCompletionResponse, error)
func (*AnthropicMessagesAPI) GetProviderCapability ¶ added in v0.9.1
func (api *AnthropicMessagesAPI) GetProviderCapability(ctx context.Context) (spec.ModelCapabilities, error)
func (*AnthropicMessagesAPI) GetProviderInfo ¶
func (api *AnthropicMessagesAPI) GetProviderInfo(ctx context.Context) *spec.ProviderParam
func (*AnthropicMessagesAPI) InitLLM ¶
func (api *AnthropicMessagesAPI) InitLLM(ctx context.Context) error
func (*AnthropicMessagesAPI) IsConfigured ¶
func (api *AnthropicMessagesAPI) IsConfigured(ctx context.Context) bool
func (*AnthropicMessagesAPI) SetProviderAPIKey ¶
func (api *AnthropicMessagesAPI) SetProviderAPIKey(ctx context.Context, apiKey string) error
Source Files