vcache

package
v1.11.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 9, 2023 License: BSD-3-Clause Imports: 12 Imported by: 0

Documentation

Index

Constants

View Source
const MaxTypesPerObject = 2500

Variables

This section is empty.

Functions

This section is empty.

Types

type Array

type Array struct {
	// contains filtered or unexported fields
}

func NewArray

func NewArray(array *vector.Array, r io.ReaderAt) (*Array, error)

func (*Array) NewIter

func (a *Array) NewIter(reader io.ReaderAt) (iterator, error)

type Cache

type Cache struct {
	// contains filtered or unexported fields
}

func NewCache

func NewCache(engine storage.Engine) *Cache

func (*Cache) Fetch

func (c *Cache) Fetch(ctx context.Context, uri *storage.URI, id ksuid.KSUID) (*Object, error)

type Const added in v1.9.0

type Const struct {
	// contains filtered or unexported fields
}

func NewConst added in v1.9.0

func NewConst(meta *vector.Const) *Const

func (*Const) NewIter added in v1.9.0

func (c *Const) NewIter(r io.ReaderAt) (iterator, error)

type Map

type Map struct {
	// contains filtered or unexported fields
}

func NewMap

func NewMap(m *vector.Map, r io.ReaderAt) (*Map, error)

func (*Map) NewIter

func (m *Map) NewIter(reader io.ReaderAt) (iterator, error)

type Nulls

type Nulls struct {
	// contains filtered or unexported fields
}

func NewNulls

func NewNulls(nulls *vector.Nulls, values Vector, r io.ReaderAt) (*Nulls, error)

func (*Nulls) NewIter

func (n *Nulls) NewIter(reader io.ReaderAt) (iterator, error)

type Object

type Object struct {
	// contains filtered or unexported fields
}

Object represents the collection of vectors that are loaded into memory for a given data object as referenced by its ID. An Object structure mirrors the metadata structures used in VNG but here we support dynamic loading of vectors as they are needed and data and metadata are all cached in memory.

func NewObject

func NewObject(ctx context.Context, engine storage.Engine, uri *storage.URI, id ksuid.KSUID) (*Object, error)

NewObject creates a new in-memory Object corresponding to a VNG object residing in storage. It loads the list of VNG root types (one per value in the file) and the VNG metadata for vector reassembly. This provides the metadata needed to load vector chunks on demand only as they are referenced.

func (*Object) Close

func (o *Object) Close() error

func (*Object) NewProjection

func (o *Object) NewProjection(fields []string) (*Projection, error)

func (*Object) NewReader

func (o *Object) NewReader() *Reader

type Primitive

type Primitive struct {
	// contains filtered or unexported fields
}

func NewPrimitive

func NewPrimitive(meta *vector.Primitive) (*Primitive, error)

func (*Primitive) NewIter

func (p *Primitive) NewIter(r io.ReaderAt) (iterator, error)

type Projection

type Projection struct {
	// contains filtered or unexported fields
}

func NewProjection

func NewProjection(o *Object, names []string) (*Projection, error)

func (*Projection) Read

func (p *Projection) Read() (*zed.Value, error)

type Reader

type Reader struct {
	// contains filtered or unexported fields
}

func (*Reader) Read

func (r *Reader) Read() (*zed.Value, error)

type Record

type Record []Vector

func NewRecord

func NewRecord(fields []vector.Field, r io.ReaderAt) (Record, error)

func (Record) NewIter

func (r Record) NewIter(reader io.ReaderAt) (iterator, error)

type Union

type Union struct {
	// contains filtered or unexported fields
}

func NewUnion

func NewUnion(union *vector.Union, r io.ReaderAt) (*Union, error)

func (*Union) NewIter

func (u *Union) NewIter(reader io.ReaderAt) (iterator, error)

type Vector

type Vector interface {
	NewIter(io.ReaderAt) (iterator, error)
}

Vector is the primary interface to in-memory sequences of Zed values representing the VNG vector format. As we implement additional optimizations and various forms of pushdown, we will enhance this interface with corresponding methods.

func NewVector

func NewVector(meta vector.Metadata, r io.ReaderAt) (Vector, error)

NewVector converts a VNG metadata reader to its equivalent vector cache metadata manager.

func Under

func Under(v Vector) Vector

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL