datalake

package
v1.0.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Mar 25, 2026 License: GPL-3.0 Imports: 2 Imported by: 0

Documentation

Overview

Package datalake provides protocol data lake integration.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func GenerateDuckDBQuery 

func GenerateDuckDBQuery(table, protocol string) string

GenerateDuckDBQuery generates a DuckDB query template.

Types

type Column 

type Column struct {
	Name     string `json:"name"`
	Type     string `json:"type"`
	Nullable bool   `json:"nullable"`
}

Column represents a data column derived from protocol fields.

type ExportFormat 

type ExportFormat string

ExportFormat represents a data export format. 

const (
	FormatParquet ExportFormat = "parquet"
	FormatArrow   ExportFormat = "arrow"
	FormatCSV     ExportFormat = "csv"
	FormatJSON    ExportFormat = "json"
)

type Schema 

type Schema struct {
	Protocol string   `json:"protocol"`
	Columns  []Column `json:"columns"`
}

Schema represents a data lake schema for a protocol.

func DeriveSchema 

func DeriveSchema(protocol string, fields map[string]string) *Schema

DeriveSchema derives a data lake schema from protocol fields.

func (*Schema) Describe 

func (s *Schema) Describe() string

Describe returns a schema description.

func (*Schema) GenerateSQL 

func (s *Schema) GenerateSQL(tableName string) string

GenerateSQL generates a CREATE TABLE SQL statement.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.