gmicloud

package

v0.16.1 Latest Latest Go to latest Published: Oct 16, 2026 License: Apache-2.0 Imports: 6 Imported by: 0

Details

Package gmicloud provides GMI Cloud's documented OpenAI-compatible Chat Completions API.

View Source

const DefaultBaseURL = "https://api.gmi-serving.com/v1"

This section is empty.

func New(selected model.Model, key auth.APIKey, options ...Option) (inference.Client, error)

func NewCounter(_ auth.APIKey) (contextcount.ContextCounter, error)

type CounterSupportError = llm.CounterSupportError

type Option = simple.Option

func WithHeader(name, value string) Option

func WithOrganizationID(id string) Option

WithOrganizationID selects the GMI organization for multi-organization API keys, as documented by GMI Cloud.

func WithTopK(value int) Option

WithTopK forwards GMI Cloud's documented top-k sampling parameter. Support remains model-dependent on the upstream service.