store

package
v0.8.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: May 12, 2026 License: MIT Imports: 14 Imported by: 0

Documentation

Index

Constants

View Source 
const MetadataDBFile = "metadata.db"

MetadataDBFile is the filename of the SQLite database inside a CodeDB directory.

Variables

View Source 
var BleveSubIndexNames = []string{"code", "diff", "comment"}

BleveSubIndexNames lists the bleve sub-indexes managed by Store, in the same order they are opened. Used by self-heal callers (daemon, doctor) so they don't have to hardcode the names.

View Source 
var ErrCorrupt = fmt.Errorf("codedb index is corrupt")

ErrCorrupt indicates the index is corrupted and needs re-indexing.

View Source 
var ErrFullReindexRequired = errors.New("full reindex required")

ErrFullReindexRequired is returned by RebuildBleveSubIndex when the requested sub-index (code/diff) cannot be repopulated from existing SQL data alone. Callers that hit this should fall back to a full reindex (wipe dataDir + run IndexLocalRepo) — the rebuild path is currently only safe for "comment" because ParseComments is gated on a per-blob SQL flag we can reset, while code/diff are populated only during the per-commit walk in IndexRepo and have no rebleve-from-blobs path yet.

Functions

func CreateSchema 

func CreateSchema(db *sql.DB) error

CreateSchema initializes the SQLite tables and indexes, and runs all pending migrations. "Migrations" here include both schema migrations (idempotent ALTER/CREATE) and one-shot data repairs that recover from historical bugs (see migrateInvalidateGitHubMtimesForIssue474). New migrations should be appended at the end and gated by their own idempotency check (column existence, sentinel row, etc.).

func QueriesFromTx added in v0.6.0 

func QueriesFromTx(tx *sql.Tx) *codedbsqlc.Queries

QueriesFromTx returns sqlc-generated typed queries bound to a transaction.

func RebuildBleveSubIndex added in v0.8.0 

func RebuildBleveSubIndex(root, name string) error

RebuildBleveSubIndex performs a targeted rebuild of a single bleve sub-index. Currently supported only for "comment", which can be fully repopulated from existing SQL data via the comments_parsed flag.

For "code" and "diff", this function returns ErrFullReindexRequired without modifying state — those sub-indexes are populated during the per-commit walk in IndexRepo, gated on `commits` SQL rows, and there is no rebleve-from-blobs path that could refill them from SQL alone. A surgical rebuild would leave search permanently empty; callers must fall back to a full reindex (wipe dataDir + IndexLocalRepo).

On success for "comment": removes bleve/comment/, recreates empty, and resets blobs.comments_parsed=0 so ParseComments re-extracts every blob on the next indexing pass. SQL/Open failures during the flag reset are surfaced as errors — a rebuild that "succeeds" with comments_parsed still set would silently leave search empty forever.

This function works without an open Store — by design, since Open fails when the sub-index is in the corrupt state we are recovering from.

Types

type MaintenanceResult added in v0.6.0 

type MaintenanceResult struct {
	OrphanBlobsPruned int64
	OldDiffsPruned    int64
	StaleSymbolsCount int64
	Vacuumed          bool
	IntegrityOK       bool
	SizeBefore        int64
	SizeAfter         int64
	Duration          time.Duration
}

MaintenanceResult captures what happened during codedb maintenance.

func (MaintenanceResult) TotalPruned added in v0.6.0 

func (r MaintenanceResult) TotalPruned() int64

TotalPruned returns the total number of rows removed.

type MappingCorruptError added in v0.8.0 

type MappingCorruptError struct {
	Name string
	Path string
}

MappingCorruptError indicates that a Bleve sub-index is in a structurally broken state that bleve.Open cannot recover from on its own. The Name identifies which sub-index ("code", "diff", or "comment") so callers can perform a targeted rebuild via RebuildBleveSubIndex without nuking the whole dataDir.

Detected conditions (see isBleveIndexCorrupt):

  • persisted `_mapping` doc is empty/missing in the latest snapshot, or
  • the latest snapshot references segment IDs whose `.zap` files are missing on disk (the field-observed poison pill: bolt + mapping intact but a previous incomplete write left the snapshot pointing at segments that never landed)

Distinct from "real lock contention" (another goroutine/process actively writing): we only return this after a successful read-only bbolt open with 100ms timeout — a held exclusive lock blocks the read and we stay in the safe lock-contention path.

func (*MappingCorruptError) Error added in v0.8.0 

func (e *MappingCorruptError) Error() string

type Store 

type Store struct {
	CodeIndex    bleve.Index
	DiffIndex    bleve.Index
	CommentIndex bleve.Index
	Root         string

	CombinedCodeIndex bleve.Index // alias of CodeIndex + all dirty indexes, or just CodeIndex
	// contains filtered or unexported fields
}

Store wraps a SQLite database and Bleve full-text search indexes. All SQL access goes through the convenience methods below.

The store supports a two-tier architecture:

  • Shared indexes (on-disk): committed content, shared across worktrees
  • Dirty overlay (on-disk or in-memory): uncommitted worktree files, per-worktree

When a dirty overlay is attached, CombinedCodeIndex transparently merges results from both tiers via Bleve IndexAlias.

func Open 

func Open(root string) (*Store, error)

Open opens (or creates) a Store at the given root directory. It creates the directory structure, initializes SQLite and Bleve indexes. If SQLite corruption is detected, the database is removed and ErrCorrupt is returned so the caller can trigger a full re-index.

func (*Store) AttachDirtyIndex added in v0.5.0 

func (s *Store) AttachDirtyIndex(dirtyBlevePath string) error

AttachDirtyIndex opens an existing on-disk dirty overlay index (built by the daemon) and aliases it with the shared CodeIndex for transparent search. Uses a default key; for multi-worktree support use AttachDirtyIndexByID.

func (*Store) AttachDirtyIndexByID added in v0.6.1 

func (s *Store) AttachDirtyIndexByID(id, dirtyBlevePath string) error

AttachDirtyIndexByID opens an on-disk dirty overlay and adds it to the overlay map under the given ID. If the ID is already attached, the old overlay is detached first. Rebuilds the combined alias to include all active overlays.

func (*Store) AttachDirtyOverlay added in v0.5.0 

func (s *Store) AttachDirtyOverlay() error

AttachDirtyOverlay creates an in-memory Bleve index for dirty worktree files and combines it with the shared CodeIndex via IndexAlias. Search code using CombinedCodeIndex will transparently search both. Primarily used in tests; production uses AttachDirtyIndex for on-disk overlays.

func (*Store) Begin 

func (s *Store) Begin() (*sql.Tx, error)

Begin starts a new transaction.

func (*Store) BeginTx 

func (s *Store) BeginTx(ctx context.Context, opts *sql.TxOptions) (*sql.Tx, error)

BeginTx starts a new transaction with the given context and options.

func (*Store) CheckIntegrity 

func (s *Store) CheckIntegrity() error

CheckIntegrity validates that the SQLite database and all Bleve indexes are healthy. Returns nil if everything is fine, ErrCorrupt otherwise.

func (*Store) Close 

func (s *Store) Close() error

Close closes all resources. It is safe to call multiple times.

func (*Store) DBPath added in v0.6.0 

func (s *Store) DBPath() string

DBPath returns the path to the SQLite database file.

func (*Store) DetachDirtyIndexByID added in v0.6.1 

func (s *Store) DetachDirtyIndexByID(id string)

DetachDirtyIndexByID closes and removes a specific dirty overlay by ID. Rebuilds the combined alias with remaining overlays.

func (*Store) DetachDirtyOverlay added in v0.5.0 

func (s *Store) DetachDirtyOverlay()

DetachDirtyOverlay closes all attached dirty overlays and resets CombinedCodeIndex.

func (*Store) DirtyCodeIndex added in v0.6.1 

func (s *Store) DirtyCodeIndex() bleve.Index

DirtyCodeIndex returns the first dirty overlay index found, or nil. Used by callers that need direct access to a dirty index (e.g., for indexing docs).

func (*Store) DirtyOverlayCount added in v0.6.1 

func (s *Store) DirtyOverlayCount() int

DirtyOverlayCount returns the number of currently attached dirty overlays.

func (*Store) Exec 

func (s *Store) Exec(query string, args ...interface{}) (sql.Result, error)

Exec executes a SQL statement that doesn't return rows.

func (*Store) Maintain added in v0.6.0 

func (s *Store) Maintain(ctx context.Context) MaintenanceResult

Maintain runs cleanup: prunes orphaned blobs, old diffs, and vacuums. Safe to call while the store is in use — all operations use transactions.

func (*Store) Queries added in v0.6.0 

func (s *Store) Queries() *codedbsqlc.Queries

Queries returns the sqlc-generated typed queries bound to the store's DB.

func (*Store) Query 

func (s *Store) Query(query string, args ...interface{}) (*sql.Rows, error)

Query executes a SQL query and returns the rows.

func (*Store) QueryContext 

func (s *Store) QueryContext(ctx context.Context, query string, args ...interface{}) (*sql.Rows, error)

QueryContext executes a SQL query with context and returns the rows.

func (*Store) QueryRow 

func (s *Store) QueryRow(query string, args ...interface{}) *sql.Row

QueryRow executes a SQL query expected to return at most one row.

func (*Store) ReposDir 

func (s *Store) ReposDir() string

ReposDir returns the path to the bare git repos directory.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.