embedder

Embedders

Every provider implements the small embedder.Embedder interface:

type Embedder interface {
    Embed(context.Context, []string) ([][]float32, error)
}

Supported providers

Examples

import (
    "github.com/torrischen/goat/embedder/cohere"
    "github.com/torrischen/goat/embedder/gemini"
    "github.com/torrischen/goat/embedder/ollama"
    "github.com/torrischen/goat/embedder/voyage"
)

ge := gemini.New(gemini.Config{
    APIKey: os.Getenv("GEMINI_API_KEY"),
    TaskType: "RETRIEVAL_DOCUMENT",
    OutputDimensionality: 768,
})

ce := cohere.New(cohere.Config{
    APIKey: os.Getenv("COHERE_API_KEY"),
    InputType: "search_document",
})

ve := voyage.New(voyage.Config{
    APIKey: os.Getenv("VOYAGE_API_KEY"),
    InputType: "document",
})

oe := ollama.New(ollama.Config{
    Model: "nomic-embed-text",
})

vectors, err := ge.Embed(ctx, []string{"first document", "second document"})

Use the provider's document input/task type while indexing and its query input/task type while searching. The output dimension must match the vector field dimension in your retriever. BaseURL and Client are configurable for gateways, testing, and custom transports.