lmstudio

package

v1.4.146 Latest Latest Go to latest Published: Feb 27, 2025 License: MIT Imports: 10 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type Client struct {
	*plugins.PluginBase
	ApiBaseURL *plugins.SetupQuestion
	HttpClient *http.Client
}

Client represents the LM Studio client.

func NewClient() (ret *Client)

NewClient creates a new LM Studio client with default configuration.

func NewClientCompatible(vendorName string, defaultBaseUrl string, configureCustom func() error) (ret *Client)

NewClientCompatible creates a new LM Studio client with custom configuration.

func (c *Client) Complete(ctx context.Context, prompt string, opts *common.ChatOptions) (string, error)

Complete sends a completion request and returns the response.

func (c *Client) Configure() error

Configure sets up the client configuration.

func (c *Client) GetEmbeddings(ctx context.Context, input string, opts *common.ChatOptions) ([]float64, error)

GetEmbeddings returns embeddings for the given input.

func (c *Client) GetName() string

GetName returns the name of the vendor.

func (c *Client) IsConfigured() bool

IsConfigured checks if the client is configured.

func (c *Client) ListModels() ([]string, error)

ListModels returns a list of available models.

func (c *Client) Send(ctx context.Context, msgs []*goopenai.ChatCompletionMessage, opts *common.ChatOptions) (string, error)

Send sends a single message and returns the response.

func (c *Client) SendStream(msgs []*goopenai.ChatCompletionMessage, opts *common.ChatOptions, channel chan string) error

func (c *Client) Setup() error

Setup performs any necessary setup for the client.

func (c *Client) SetupFillEnvFileContent(buffer *bytes.Buffer)

SetupFillEnvFileContent fills the environment file content.