flat_simd

package

v0.3.0 Latest Latest Go to latest Published: Jun 11, 2026 License: Apache-2.0 Imports: 7 Imported by: 0

Details

View Source

const DefaultVectorDim = 64

The MRL pipeline truncates embeddings to the first 64 dimensions, providing high preservation of semantic layout while dropping index size by 95%.

This section is empty.

func Quantize(raw ports.Vector) ([]int8, error)

Quantize handles the Float32 -> INT8 conversion loop. To normalize correctly, it evaluates the min/max range of the *truncated* array.

type FlatSIMDStore struct {
	// contains filtered or unexported fields
}

FlatSIMDStore implements VectorStorePort using a flat, memory-mapped INT8 file designed for embedded scale workloads (100k - 1M vectors).

func NewStore(path string) (*FlatSIMDStore, error)

NewStore initializes or opens a flat vector store from disk.

func (s *FlatSIMDStore) Close() error

Close unmaps and closes the file gracefully.

func (s *FlatSIMDStore) Insert(vector ports.Vector, metadata string) error

Insert adds a quantized vector with its metadata ID into the mmap'd file.

func (s *FlatSIMDStore) Search(query ports.Vector, limit int, threshold float64) ([]string, error)

Search performs a brute-force INT8 dot-product scan over the mmap'd vectors, returning metadata IDs sorted by descending similarity.