Help us shape the future of Go! Take the 2026 Go Developer Survey

deltalog

package
v1.9.1 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Nov 1, 2026 License: MIT Imports: 12 Imported by: 0

Documentation

Overview

Package deltalog replays a Delta Lake transaction log (JSON commits and checkpoint Parquet files) into the table's active file list and schema (https://github.com/delta-io/delta/blob/master/PROTOCOL.md).

Index

Constants

This section is empty.

Variables

View Source 
var (
	// ErrNotDeltaTable is returned when the location has no transaction log.
	ErrNotDeltaTable = errors.New("not a Delta Lake table")
	// ErrBadLog is returned for a transaction log that cannot be replayed.
	ErrBadLog = errors.New("invalid Delta Lake transaction log")
	// ErrUnsupported is returned for protocol features this reader does not implement.
	ErrUnsupported = errors.New("unsupported Delta Lake feature")
)

Functions

This section is empty.

Types

type AddFile 

type AddFile struct {
	PartitionValues map[string]*string
	Path            string
	Size            int64
}

AddFile is an active data file.

type Column 

type Column struct {
	Name         string
	Type         string
	PhysicalName string
	ID           int
}

Column is one logical table column.

type Snapshot 

type Snapshot struct {
	ColumnMapping    string
	Columns          []Column
	PartitionColumns []string
	Files            []AddFile
	Version          int64
}

Snapshot is the table state at a log version.

func Load 

func Load(ctx context.Context, st Storage) (*Snapshot, error)

Load replays the log to its newest version.

type Storage 

type Storage interface {
	List(ctx context.Context, prefix string) ([]string, error)
	Get(ctx context.Context, key string) ([]byte, error)
}

Storage reads objects under the table location; keys are relative to it.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.