Documentation
¶
Overview ¶
Package llama provides embedding via llama.cpp CGo bindings.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Embedder ¶
type Embedder struct {
// contains filtered or unexported fields
}
Embedder implements embedding.Embedder using llama.cpp via CGo.
func New ¶
New creates a new embedder backed by llama.cpp. modelPath: path to GGUF model file. nThreads: inference threads (0 = number of CPUs). nGPULayers: layers to offload (-1 = all).
func (*Embedder) Dimensions ¶
Source Files
Click to show internal directories.
Click to hide internal directories.