ragkit

ragkit: A Go package for document indexing and retrieval in RAG systems

ragkit is a Go package designed to simplify the implementation of Retrieval-Augmented Generation (RAG) systems. It includes the definition and implementation of a vectorizer interface that performs document indexing and retrieval, providing tools for vectorization and semantic search capabilities.

• Package documentation.

Installation

go get github.com/suapapa/go_ragkit

Quick Start

import (
    "context"
    "fmt"
    ragkit "github.com/suapapa/go_ragkit"
)

func main() {
    // Create documents from text
    docs := ragkit.MakeDocsFromTexts(
        []string{
            "고길동의 집에는 둘리, 도우너, 또치, 희동이, 철수, 영희가 살고 있다.",
            "희동이는 고길동의 조카이다.",
        },
        nil,
    )

    // Initialize vectorizer (example with Weaviate)
    vectorizer, err := ragkit.NewWeaviateVectorizer(...)
    if err != nil {
        panic(err)
    }

    // Index documents
    ctx := context.Background()
    for _, doc := range docs {
        _, err = vectorizer.Index(ctx, doc)
        if err != nil {
            panic(err)
        }
    }

    // Perform semantic search
    query := "희동이와 고길동의 관계?"
    results, err := vectorizer.RetrieveText(ctx, query, 1)
    if err != nil {
        panic(err)
    }
    fmt.Println(results[0].Text) // 희동이는 고길동의 조카이다.
}

Examples

Pre-requirement - launch Weaviate for local vector DB:

docker run -it --rm -p 8080:8080 -p 50051:50051 cr.weaviate.io/semitechnologies/weaviate:1.30.2

• Examples

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License - see the LICENSE file for details.