llamacpp

package

v0.14.1 Latest Latest Go to latest Published: Aug 25, 2026 License: Apache-2.0 Imports: 6 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/looprig/llm

Links

Open Source Insights

Documentation ¶

Overview ¶

Package llamacpp provides the local llama.cpp llama-server OpenAI-compatible API.

The canonical model identity is llm.ProviderLlamaCPP ("llama.cpp"), matching OpenCode's documented custom local provider. The constructor still accepts the former llm.ProviderLlama identity for callers that explicitly selected this package before the hosted Meta Llama provider was added.

Index ¶

Constants
func New(selected model.Model, key auth.APIKey, options ...Option) (inference.Client, error)
func NewCounter(_ auth.APIKey) (contextcount.ContextCounter, error)
type CounterSupportError
type Option
- func WithHeader(name, value string) Option

Constants ¶

View Source

const DefaultBaseURL = "http://127.0.0.1:8080/v1"

Variables ¶

This section is empty.

Functions ¶

func New ¶

func New(selected model.Model, key auth.APIKey, options ...Option) (inference.Client, error)

func NewCounter ¶

func NewCounter(_ auth.APIKey) (contextcount.ContextCounter, error)

Types ¶

type CounterSupportError ¶

type CounterSupportError = llm.CounterSupportError

type Option ¶

type Option = simple.Option

func WithHeader ¶

func WithHeader(name, value string) Option

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL