Directories
¶
| Path | Synopsis |
|---|---|
|
Package catalog manages table schema and partition metadata.
|
Package catalog manages table schema and partition metadata. |
|
Package compaction merges small Parquet files within a partition into larger files, reducing S3 list overhead and scan file-open costs.
|
Package compaction merges small Parquet files within a partition into larger files, reducing S3 list overhead and scan file-open costs. |
|
Package dbscan provides table-function sources for querying external SQL databases (PostgreSQL, MySQL) and producing columnar RecordBatches.
|
Package dbscan provides table-function sources for querying external SQL databases (PostgreSQL, MySQL) and producing columnar RecordBatches. |
|
Package ingest provides micro-batch accumulation and flushing to object storage.
|
Package ingest provides micro-batch accumulation and flushing to object storage. |
|
Package json reads JSON data (JSONL or JSON array format) and converts it to the columnar RecordBatch format used by Wadjet's execution engine.
|
Package json reads JSON data (JSONL or JSON array format) and converts it to the columnar RecordBatch format used by Wadjet's execution engine. |
|
Package objstore provides an abstraction over S3-compatible object storage.
|
Package objstore provides an abstraction over S3-compatible object storage. |
|
Package parquet provides Parquet file reading and writing on top of objstore.
|
Package parquet provides Parquet file reading and writing on top of objstore. |
|
Package partition implements Hive-style partitioning for table data.
|
Package partition implements Hive-style partitioning for table data. |
Click to show internal directories.
Click to hide internal directories.