Documentation
¶
Index ¶
- func CoerceRecord(schema *arrow.Schema, rec arrow.Record) (arrow.Record, error)
- func DetectCSVSchema(path string, sample int) (*arrow.Schema, error)
- type Info
- type Lockbox
- func (lb *Lockbox) Close() error
- func (lb *Lockbox) GetBlob(field string, row int, opts ...Option) ([]byte, error)
- func (lb *Lockbox) Info() (*Info, error)
- func (lb *Lockbox) IngestParquet(ctx context.Context, path string, opts ...Option) error
- func (lb *Lockbox) IngestParquetAsync(ctx context.Context, path string, opts ...Option) <-chan error
- func (lb *Lockbox) Query(ctx context.Context, query string, opts ...Option) (arrow.Record, error)
- func (lb *Lockbox) Read(ctx context.Context, opts ...Option) (arrow.Record, error)
- func (lb *Lockbox) ReadAsync(ctx context.Context, opts ...Option) (<-chan arrow.Record, <-chan error)
- func (lb *Lockbox) Repair() error
- func (lb *Lockbox) Schema() *arrow.Schema
- func (lb *Lockbox) Validate() error
- func (lb *Lockbox) Write(ctx context.Context, record arrow.Record, opts ...Option) error
- func (lb *Lockbox) WriteAsync(ctx context.Context, record arrow.Record, opts ...Option) <-chan error
- type Option
- type Options
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CoerceRecord ¶ added in v0.4.0
CoerceRecord converts parquet record columns to lockbox schema order and types
Types ¶
type Info ¶
type Info struct {
Version uint32 `json:"version"`
Schema *arrow.Schema `json:"-"`
CreatedAt interface{} `json:"createdAt"`
CreatedBy string `json:"createdBy"`
ModifiedAt interface{} `json:"modifiedAt"`
ModifiedBy string `json:"modifiedBy"`
BlockCount int `json:"blockCount"`
AccessCount int `json:"accessCount"`
}
Info represents information about a lockbox file
type Lockbox ¶
type Lockbox struct {
// contains filtered or unexported fields
}
Lockbox represents a lockbox file with high-level operations
func (*Lockbox) GetBlob ¶ added in v0.3.0
GetBlob returns the blob data for the given field and row index.
func (*Lockbox) IngestParquet ¶ added in v0.3.0
IngestParquet ingests a Parquet file into the lockbox
func (*Lockbox) IngestParquetAsync ¶ added in v0.3.0
func (lb *Lockbox) IngestParquetAsync(ctx context.Context, path string, opts ...Option) <-chan error
IngestParquetAsync runs IngestParquet in a goroutine
func (*Lockbox) Query ¶
Query performs a simple query on the lockbox data This is a basic implementation that reads all data and applies simple filters query-engine
func (*Lockbox) ReadAsync ¶ added in v0.3.0
func (lb *Lockbox) ReadAsync(ctx context.Context, opts ...Option) (<-chan arrow.Record, <-chan error)
ReadAsync performs Read in a separate goroutine
func (*Lockbox) Repair ¶ added in v0.3.0
Repair attempts to remove corrupted blocks and update metadata
func (*Lockbox) Validate ¶ added in v0.3.0
Validate verifies the integrity of the lockbox data blocks
type Option ¶
type Option func(*Options)
Option is a functional option for lockbox operations
func WithColumns ¶
WithColumns sets the specific columns to operate on
func WithCreatedBy ¶
WithCreatedBy sets the creator name for lockbox operations
func WithCryptoModule ¶ added in v0.3.0
WithCryptoModule selects the cryptographic module by name.
func WithDryRun ¶ added in v0.3.0
WithDryRun enables or disables dry-run mode
func WithPassword ¶
WithPassword sets the password for lockbox operations
Source Files