openaicompat

package

v0.3.0 Latest Latest Go to latest Published: Jun 16, 2026 License: MIT Imports: 8 Imported by: 0

Details

Package openaicompat provides a lightweight client for any OpenAI-compatible chat completions API (llama.cpp, vLLM, LM Studio, Ollama /v1, etc.).

This section is empty.

This section is empty.

This section is empty.

type Client struct {
	// contains filtered or unexported fields
}

Client calls a single OpenAI-compatible /v1/chat/completions endpoint.

func NewClient(baseURL, model, apiKey string) *Client

NewClient creates a Client for the given base URL (e.g. "http://localhost:8080"). apiKey may be empty for unauthenticated local servers.

func (c *Client) Complete(ctx context.Context, systemPrompt, userPrompt string, temperature float64, maxTokens int) (string, error)

Complete sends a single user message to the model and returns the assistant reply. systemPrompt may be empty.