model

Overview ¶

Package model provides LLM provider configuration and client implementations.

Configuration Reference ¶

Model configuration can be specified via CLI flags, environment variables, config file, or native keystore (for API keys only).

## Resolution Order

For each field, the first source with a value wins:

1. CLI flags (highest priority)
2. Environment variables
3. Config file (~/.config/devlore/config.yaml)
4. Native keystore (API key only, lowest priority)

## Configuration Fields

| Field        | CLI Flag           | Environment Variable       | Config Key     | Keystore         |
|--------------|--------------------|-----------------------------|----------------|------------------|
| name         | --model            | DEVLORE_MODEL              | model.name     | —                |
| api_key      | --model-api-key    | DEVLORE_MODEL_API_KEY      | model.api_key  | Account=provider |
| endpoint     | --model-endpoint   | DEVLORE_MODEL_ENDPOINT     | model.endpoint | —                |
| provider     | --model-provider   | DEVLORE_MODEL_PROVIDER     | model.provider | —                |

## Provider Field

The provider field determines:

• API protocol: Anthropic API vs OpenAI-compatible API (different request/response formats)
• Authentication method: "Authorization: Bearer" header vs "api-key" header (Azure)
• Default endpoint: Each provider has a different default API URL
• Keystore account: API keys are stored under Service=com.noblefactor.DevLore, Account=<provider>
• Client implementation: Which Provider implementation to instantiate

Supported providers: anthropic, gemini, github, groq, ollama, openai

## Native Keystore

API keys are stored in the native OS keystore:

• macOS: Keychain (security command)
• Linux: libsecret (secret-tool command)
• Windows: Credential Manager (PowerShell)

Keystore entry format:

Service: com.noblefactor.DevLore
Account: <provider>  (e.g., "anthropic", "openai")
Key:     <api-key>

## Config File Example

# ~/.config/devlore/config.yaml
model:
  name: claude-sonnet-4-20250514
  provider: anthropic

API keys should be stored in the native keystore, not the config file.

## CLI Usage Examples

# Using environment variables
DEVLORE_MODEL_PROVIDER=github DEVLORE_MODEL_API_KEY=$(gh auth token) writ migrate --dry-run ~/dotfiles

# Using CLI flags
writ --model-provider=github --model-api-key=$(gh auth token) migrate --dry-run ~/dotfiles

Package model provides an opaque LLM provider interface and configuration.

Provider Interface ¶

The Provider interface is the single abstraction for all AI/LLM backends. Callers interact only through this interface—they don't need to know whether the underlying provider is Anthropic, OpenAI, Ollama, etc.

type Provider interface {
    Chat(ctx context.Context, req ChatRequest) (*ChatResponse, error)
    Name() string       // Provider name (also keystore account)
    Model() string      // Model identifier
    Endpoint() string   // API endpoint (empty = default)
    Available(ctx context.Context) bool
}

The interface exposes queryable attributes (provider, model, endpoint) but never exposes the API key for security.

Provider Field Uses ¶

The provider field in configuration determines:

1. API Protocol: Anthropic API vs OpenAI-compatible API (different request/response formats)
2. Authentication Method: "Authorization: Bearer" header vs "api-key" header (Azure)
3. Default Endpoint: Each provider has a different default API URL
4. Keystore Account: API keys stored under Service=com.noblefactor.DevLore, Account=<provider>
5. Client Implementation: Which Provider implementation to instantiate

Supported Providers ¶

| Provider     | Default Endpoint                                | Auth Header               |
|--------------|------------------------------------------------|---------------------------|
| anthropic    | https://api.anthropic.com/v1/messages          | x-api-key                 |
| gemini       | https://generativelanguage.googleapis.com/v1beta| ?key= query param        |
| github       | https://models.inference.ai.azure.com          | Authorization: Bearer     |
| groq         | https://api.groq.com/openai/v1                 | Authorization: Bearer     |
| ollama       | http://localhost:11434                         | (none)                    |
| openai       | https://api.openai.com/v1                      | Authorization: Bearer     |

See config.go for full configuration reference including CLI flags, environment variables, config file format, and resolution order.