client

package

v0.3.0-alpha.1 Latest Latest Go to latest Published: May 16, 2026 License: MIT Imports: 10 Imported by: 0

Details

Package client implements an HTTP client for the LLM proxy server

This section is empty.

This section is empty.

This section is empty.

type Client struct {
	// contains filtered or unexported fields
}

Client is an HTTP client for the LLM proxy server

func NewClient(cfg Config) *Client

NewClient creates a new LLM proxy client

func (c *Client) Chat(ctx context.Context, req *llmproxy.ChatRequest) (*llmproxy.ChatResponse, error)

Chat sends a non-streaming chat completion request

func (c *Client) ChatWithRetry(ctx context.Context, req *llmproxy.ChatRequest, maxRetries int) (*llmproxy.ChatResponse, error)

ChatWithRetry sends a chat completion request with retry logic

func (c *Client) GetHealth(ctx context.Context) (map[string]interface{}, error)

GetHealth checks the health of the proxy server

func (c *Client) GetMetrics(ctx context.Context) (map[string]interface{}, error)

GetMetrics retrieves usage metrics from the proxy

func (c *Client) GetModels(ctx context.Context) ([]llmproxy.Model, error)

GetModels retrieves available models from the proxy

func (c *Client) StreamChat(ctx context.Context, req *llmproxy.ChatRequest) (<-chan llmproxy.ChatChunk, error)

StreamChat sends a streaming chat completion request

type Config struct {
	BaseURL string
	APIKey  string
	Timeout time.Duration
}

Config holds client configuration