parquet

package
v1.21.0-rc.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Mar 13, 2026 License: Apache-2.0 Imports: 11 Imported by: 0

Documentation

Index

Constants

View Source 
const (
	ConverterMarkerPrefix   = "parquet-markers"
	ConverterMarkerFileName = "parquet-converter-mark.json"

	CurrentVersion               = ParquetConverterMarkVersion2
	ParquetConverterMarkVersion1 = 1
	// ParquetConverterMarkVersion2 has an additional series hash
	// column which is used for projection pushdown.
	ParquetConverterMarkVersion2 = 2
)

Variables

This section is empty.

Functions

func ShouldConvertBlockToParquet 

func ShouldConvertBlockToParquet(mint, maxt int64, timeRanges []int64) bool

func ValidConverterMarkVersion 

func ValidConverterMarkVersion(version int) bool

func WriteConverterMark 

func WriteConverterMark(ctx context.Context, id ulid.ULID, userBkt objstore.Bucket, shards int) error

Types

type ConverterMark 

type ConverterMark struct {
	Version int `json:"version"`
	// Shards is the number of parquet shards created for this block.
	// This field is optional for backward compatibility.
	Shards int `json:"shards,omitempty"`
}

func ReadConverterMark 

func ReadConverterMark(ctx context.Context, id ulid.ULID, userBkt objstore.InstrumentedBucket, logger log.Logger) (*ConverterMark, error)

type ConverterMarkMeta 

type ConverterMarkMeta struct {
	Version int `json:"version"`
	// Shards is the number of parquet shards created for this block.
	// This field is optional for backward compatibility.
	Shards int `json:"shards,omitempty"`
}

ConverterMarkMeta is used in Bucket Index. It might not be the same as ConverterMark.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.