sqlite

package
v1.1.1 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Aug 17, 2026 License: MIT Imports: 18 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func GetSchemaVersion 

func GetSchemaVersion(ctx context.Context, db *sql.DB) (int, error)

GetSchemaVersion returns the current schema version.

func IsFTS5Available 

func IsFTS5Available(ctx context.Context, db *sql.DB) bool

IsFTS5Available checks if FTS5 was successfully initialized.

Types

type Backend 

type Backend struct {
	// contains filtered or unexported fields
}

Backend implements storage.Backend using SQLite with the vec0 extension.

func New 

func New(cfg *config.Config) (*Backend, error)

New creates a new SQLite storage backend.

func NewWithDB 

func NewWithDB(db *sql.DB) *Backend

NewWithDB creates a Backend with an existing database connection. Useful for testing with in-memory databases.

func (*Backend) AppendMessage 

func (b *Backend) AppendMessage(ctx context.Context, msg *types.Message) error

AppendMessage adds a message to a thread, creating the thread if it doesn't exist.

func (*Backend) Backup 

func (b *Backend) Backup(ctx context.Context, destPath string) error

Backup creates a consistent backup of the database to the specified path. This uses SQLite's online backup API for hot backups without downtime.

func (*Backend) BackupWithProgress 

func (b *Backend) BackupWithProgress(ctx context.Context, destPath string, progress func(BackupProgress)) error

BackupWithProgress creates a backup with progress callback. The progress function is called periodically during the backup.

func (*Backend) CleanupContextHistory 

func (b *Backend) CleanupContextHistory(ctx context.Context, olderThan time.Duration) (int64, error)

CleanupContextHistory removes context version history entries older than the specified duration. Returns the number of history entries deleted.

func (*Backend) CleanupExpiredContext 

func (b *Backend) CleanupExpiredContext(ctx context.Context) (int64, error)

CleanupExpiredContext removes entries past their TTL expiration. Returns the number of entries deleted.

func (*Backend) CleanupOldRunContext 

func (b *Backend) CleanupOldRunContext(ctx context.Context, olderThan time.Duration) (int64, error)

CleanupOldRunContext removes run-scoped context entries older than the specified duration. Returns the number of entries deleted.

func (*Backend) CleanupRunContext 

func (b *Backend) CleanupRunContext(ctx context.Context, namespace, runID string) error

CleanupRunContext removes all context entries for a specific run.

func (*Backend) Close 

func (b *Backend) Close() error

Close closes the database connection.

func (*Backend) CollectionStats 

func (b *Backend) CollectionStats(ctx context.Context, namespace, collectionID string) (*types.CollectionStats, error)

CollectionStats returns statistics for a collection.

func (*Backend) CompleteExtraction 

func (b *Backend) CompleteExtraction(ctx context.Context, itemID int64, status string) error

CompleteExtraction marks an extraction queue item as completed or failed.

func (*Backend) CreateCollection 

func (b *Backend) CreateCollection(ctx context.Context, col *types.Collection) error

CreateCollection creates a new collection.

func (*Backend) DB 

func (b *Backend) DB() *sql.DB

DB returns the underlying database connection. Use with caution - prefer using Backend methods.

func (*Backend) DeleteCollection 

func (b *Backend) DeleteCollection(ctx context.Context, namespace, collectionID string) error

DeleteCollection removes a collection and all its documents.

func (*Backend) DeleteContext 

func (b *Backend) DeleteContext(ctx context.Context, namespace, key string, runID *string) error

DeleteContext removes a context entry.

func (*Backend) DeleteDocument 

func (b *Backend) DeleteDocument(ctx context.Context, namespace, docID string) error

DeleteDocument removes a document and all its chunks.

func (*Backend) DeleteEntity 

func (b *Backend) DeleteEntity(ctx context.Context, namespace, entityID string) error

DeleteEntity removes an entity and all its mentions/relationships.

func (*Backend) DeleteOldConversations 

func (b *Backend) DeleteOldConversations(ctx context.Context, olderThan time.Duration) (int64, error)

DeleteOldConversations removes threads and their messages older than the specified duration. Returns the number of threads deleted.

func (*Backend) DeleteOrphanedChunks 

func (b *Backend) DeleteOrphanedChunks(ctx context.Context) (int64, error)

DeleteOrphanedChunks removes chunks whose parent documents no longer exist. Returns the number of chunks deleted.

func (*Backend) DeleteThread 

func (b *Backend) DeleteThread(ctx context.Context, namespace, threadID string) error

DeleteThread removes a thread and all its messages.

func (*Backend) DequeueExtraction 

func (b *Backend) DequeueExtraction(ctx context.Context, batchSize int) ([]*types.ExtractionQueueItem, error)

DequeueExtraction retrieves pending items from the extraction queue.

func (*Backend) EnqueueExtraction 

func (b *Backend) EnqueueExtraction(ctx context.Context, item *types.ExtractionQueueItem) error

EnqueueExtraction adds an item to the entity extraction queue.

func (*Backend) Export 

func (b *Backend) Export(ctx context.Context, namespace string, opts storage.ExportOptions) (*storage.ExportData, error)

Export exports all data for a namespace.

func (*Backend) FTS5Available 

func (b *Backend) FTS5Available(ctx context.Context) bool

FTS5Available checks if FTS5 full-text search is available.

func (*Backend) GetAdjacentChunks 

func (b *Backend) GetAdjacentChunks(ctx context.Context, chunkID string, window int) ([]*types.Chunk, error)

GetAdjacentChunks retrieves chunks adjacent to a given chunk for context.

func (*Backend) GetCollection 

func (b *Backend) GetCollection(ctx context.Context, namespace, collectionID string) (*types.Collection, error)

GetCollection retrieves a collection by ID.

func (*Backend) GetContext 

func (b *Backend) GetContext(ctx context.Context, namespace, key string, runID *string) (*types.ContextEntry, error)

GetContext retrieves a context entry by key. runID is optional: nil means persistent (cross-run) context.

func (*Backend) GetContextHistory 

func (b *Backend) GetContextHistory(ctx context.Context, namespace, key string, runID *string, cursor string, limit int) ([]*types.ContextHistoryEntry, string, error)

GetContextHistory returns the version history for a context key.

func (*Backend) GetDocument 

func (b *Backend) GetDocument(ctx context.Context, namespace, docID string) (*types.Document, error)

GetDocument retrieves a document by ID.

func (*Backend) GetEntityByID 

func (b *Backend) GetEntityByID(ctx context.Context, namespace, entityID string) (*types.Entity, error)

GetEntityByID retrieves an entity by its ID.

func (*Backend) GetEntityByName 

func (b *Backend) GetEntityByName(ctx context.Context, namespace, name string) (*types.Entity, error)

GetEntityByName retrieves an entity by its canonical name (case-insensitive).

func (*Backend) GetExtractionQueueStats 

func (b *Backend) GetExtractionQueueStats(ctx context.Context) (*storage.ExtractionQueueStats, error)

GetExtractionQueueStats returns statistics about the extraction queue.

func (*Backend) GetMentions 

func (b *Backend) GetMentions(ctx context.Context, entityID string, limit int) ([]*types.EntityMention, error)

GetMentions retrieves recent mentions of an entity.

func (*Backend) GetMessages 

func (b *Backend) GetMessages(ctx context.Context, namespace, threadID string, limit int, cursor string) ([]*types.Message, string, error)

GetMessages retrieves messages from a thread, ordered by creation time.

func (*Backend) GetRelationships 

func (b *Backend) GetRelationships(ctx context.Context, namespace, entityID string, opts storage.RelationshipOpts) ([]*types.EntityRelationship, error)

GetRelationships retrieves relationships for an entity.

func (*Backend) GetThread 

func (b *Backend) GetThread(ctx context.Context, namespace, threadID string) (*types.Thread, error)

GetThread retrieves a single thread by ID.

func (*Backend) Health 

func (b *Backend) Health(ctx context.Context) error

Health checks the database connection.

func (*Backend) HybridSearchChunks 

func (b *Backend) HybridSearchChunks(ctx context.Context, namespace string, query string, embedding []float32, opts storage.HybridChunkSearchOpts) ([]*types.ChunkResult, error)

HybridSearchChunks performs combined vector and full-text search on chunks. Falls back to vector-only search if FTS5 is not available.

func (*Backend) HybridSearchEntities 

func (b *Backend) HybridSearchEntities(ctx context.Context, namespace string, query string, embedding []float32, opts storage.HybridEntitySearchOpts) ([]*types.EntityResult, error)

HybridSearchEntities performs combined vector and full-text search on entities. Falls back to vector-only search if FTS5 is not available.

func (*Backend) HybridSearchMessages 

func (b *Backend) HybridSearchMessages(ctx context.Context, namespace string, query string, embedding []float32, opts storage.HybridSearchOpts) ([]*types.MessageResult, error)

HybridSearchMessages performs combined vector and full-text search on messages. Uses Reciprocal Rank Fusion (RRF) to combine results. Falls back to vector-only search if FTS5 is not available.

func (*Backend) InsertChunks 

func (b *Backend) InsertChunks(ctx context.Context, chunks []*types.Chunk) error

InsertChunks adds chunks for a document. Embeddings should already be populated.

func (*Backend) InsertDocument 

func (b *Backend) InsertDocument(ctx context.Context, doc *types.Document) error

InsertDocument adds a new document to the store.

func (*Backend) InsertMention 

func (b *Backend) InsertMention(ctx context.Context, mention *types.EntityMention) error

InsertMention records a mention of an entity in source content.

func (*Backend) ListCollections 

func (b *Backend) ListCollections(ctx context.Context, namespace string, cursor string, limit int) ([]*types.Collection, string, error)

ListCollections returns all collections in a namespace.

func (*Backend) ListContextKeys 

func (b *Backend) ListContextKeys(ctx context.Context, namespace string, prefix *string, runID *string, cursor string, limit int) ([]string, string, error)

ListContextKeys returns all keys in a namespace, optionally filtered by prefix.

func (*Backend) ListEntities 

func (b *Backend) ListEntities(ctx context.Context, namespace string, opts storage.EntityListOpts) ([]*types.Entity, string, error)

ListEntities returns entities in a namespace with optional filtering.

func (*Backend) ListThreads 

func (b *Backend) ListThreads(ctx context.Context, namespace string, cursor string, limit int) ([]*types.Thread, string, error)

ListThreads returns all threads in a namespace.

func (*Backend) MarkMessagesSummarized 

func (b *Backend) MarkMessagesSummarized(ctx context.Context, namespace, threadID string, beforeTime int64) error

MarkMessagesSummarized marks messages as having been included in a summary.

func (*Backend) MergeEntities 

func (b *Backend) MergeEntities(ctx context.Context, namespace, sourceID, targetID string) error

MergeEntities combines two entities, moving all data from source to target.

func (*Backend) Migrate 

func (b *Backend) Migrate(ctx context.Context) error

Migrate runs database migrations.

func (*Backend) PruneStaleEntities 

func (b *Backend) PruneStaleEntities(ctx context.Context, staleDuration time.Duration, minMentions int) (int64, error)

PruneStaleEntities removes entities that haven't been mentioned recently and have fewer mentions than the threshold. Returns the number of entities deleted.

func (*Backend) RegisterAlias 

func (b *Backend) RegisterAlias(ctx context.Context, namespace, alias, entityID string) error

RegisterAlias adds an alias for an entity.

func (*Backend) RequeueExtraction added in v1.0.0 

func (b *Backend) RequeueExtraction(ctx context.Context, itemID int64, nextRetryAt time.Time, countFailure bool) error

RequeueExtraction returns a dequeued ("processing") item to the pending state, scheduling its next attempt no earlier than nextRetryAt (a zero time means immediately eligible). When countFailure is false the attempt increment applied at dequeue is undone.

func (*Backend) ResolveAlias 

func (b *Backend) ResolveAlias(ctx context.Context, namespace, alias string) (*types.Entity, error)

ResolveAlias looks up an entity by an alias.

func (*Backend) SearchChunks 

func (b *Backend) SearchChunks(ctx context.Context, namespace string, embedding []float32, opts storage.ChunkSearchOpts) ([]*types.ChunkResult, error)

SearchChunks performs semantic search across chunks in a namespace. Uses sqlite-vec's vec_distance_cosine for brute-force KNN search.

func (*Backend) SearchEntities 

func (b *Backend) SearchEntities(ctx context.Context, namespace string, embedding []float32, opts storage.EntitySearchOpts) ([]*types.EntityResult, error)

SearchEntities performs semantic search across entity summaries. Uses sqlite-vec's vec_distance_cosine for brute-force KNN search.

func (*Backend) SearchMessages 

func (b *Backend) SearchMessages(ctx context.Context, namespace string, embedding []float32, opts storage.MessageSearchOpts) ([]*types.MessageResult, error)

SearchMessages performs semantic search across messages in a namespace. Uses sqlite-vec's vec_distance_cosine for brute-force KNN search.

func (*Backend) SetContext 

func (b *Backend) SetContext(ctx context.Context, entry *types.ContextEntry, expectedVersion *int64) error

SetContext stores a context entry, incrementing the version. If expectedVersion is provided, the operation fails if the current version doesn't match.

func (*Backend) StoreEntityEmbedding 

func (b *Backend) StoreEntityEmbedding(ctx context.Context, entityID string, embedding []float32) error

StoreEntityEmbedding stores the embedding for an entity's summary. Embeddings are stored in binary format for use with sqlite-vec.

func (*Backend) StoreMessageEmbedding 

func (b *Backend) StoreMessageEmbedding(ctx context.Context, messageID string, embedding []float32) error

StoreMessageEmbedding stores the embedding for a message. Embeddings are stored in binary format for use with sqlite-vec.

func (*Backend) UpdateThread 

func (b *Backend) UpdateThread(ctx context.Context, thread *types.Thread) error

UpdateThread updates a thread's metadata (title, summary).

func (*Backend) UpsertEntity 

func (b *Backend) UpsertEntity(ctx context.Context, entity *types.Entity) error

UpsertEntity creates or updates an entity.

func (*Backend) UpsertRelationship 

func (b *Backend) UpsertRelationship(ctx context.Context, rel *types.EntityRelationship) error

UpsertRelationship creates or updates a relationship between entities.

type BackupProgress 

type BackupProgress struct {
	Remaining int // Pages remaining
	Total     int // Total pages
}

BackupProgress represents the progress of a backup operation.

type Migration 

type Migration struct {
	Version int
	Name    string
	Up      string
}

Migration represents a database migration.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.