loader

package
v0.0.0-...-0b6fdb1 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Mar 5, 2026 License: Apache-2.0 Imports: 11 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func Load 

func Load(ctx context.Context, params LoadParams) (int64, error)

Load reads a Parquet file and bulk-loads it into the target database. Data is streamed one row group at a time to keep memory usage steady. Returns the number of rows loaded.

Types

type LoadMode 

type LoadMode string

LoadMode controls how data is loaded into the target table. 

const (
	ModeAppend          LoadMode = "append"
	ModeTruncateAndLoad LoadMode = "truncate_and_load"
	ModeCreateOrReplace LoadMode = "create_or_replace"
)

type LoadParams 

type LoadParams struct {
	FilePath string   // path to the Parquet file
	Table    string   // target table name
	Schema   string   // target schema (default "dbo")
	Mode     LoadMode // append or truncate_and_load
	ConnStr  string   // database connection string
}

LoadParams configures a data load operation.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.