Documentation
¶
Overview ¶
Package readers provides implementations of dataset readers for various data sources.
Index ¶
- Variables
- func NewArrowReader(config core.ReaderConfig) (core.DatasetReader, error)
- func NewCSVReader(config core.ReaderConfig) (core.DatasetReader, error)
- func NewParquetReader(config core.ReaderConfig) (core.DatasetReader, error)
- type ArrowReader
- type CSVReader
- type Creator
- type Factory
- type ParquetReader
Constants ¶
This section is empty.
Variables ¶
var DefaultFactory = NewFactory()
DefaultFactory is the default reader factory with built-in reader types.
Functions ¶
func NewArrowReader ¶
func NewArrowReader(config core.ReaderConfig) (core.DatasetReader, error)
NewArrowReader creates a new Arrow IPC reader.
func NewCSVReader ¶
func NewCSVReader(config core.ReaderConfig) (core.DatasetReader, error)
NewCSVReader creates a new CSV reader.
func NewParquetReader ¶
func NewParquetReader(config core.ReaderConfig) (core.DatasetReader, error)
NewParquetReader creates a new Parquet reader.
Types ¶
type ArrowReader ¶
type ArrowReader struct {
// contains filtered or unexported fields
}
ArrowReader implements a reader for Arrow IPC files.
func (*ArrowReader) Close ¶
func (r *ArrowReader) Close() error
Close closes the reader and releases resources.
func (*ArrowReader) Schema ¶
func (r *ArrowReader) Schema() *arrow.Schema
Schema returns the schema of the dataset.
type CSVReader ¶
type CSVReader struct {
// contains filtered or unexported fields
}
CSVReader implements a reader for CSV files, converting to Arrow.
type Creator ¶
type Creator func(config core.ReaderConfig) (core.DatasetReader, error)
Creator is a function that creates a reader from a configuration.
type Factory ¶
type Factory struct {
// contains filtered or unexported fields
}
Factory creates a reader based on the given configuration.
func (*Factory) Create ¶
func (f *Factory) Create(config core.ReaderConfig) (core.DatasetReader, error)
Create creates a reader based on the given configuration.
type ParquetReader ¶
type ParquetReader struct {
// contains filtered or unexported fields
}
ParquetReader implements a reader for Parquet files.
func (*ParquetReader) Close ¶
func (r *ParquetReader) Close() error
Close closes the reader and releases resources.
func (*ParquetReader) Schema ¶
func (r *ParquetReader) Schema() *arrow.Schema
Schema returns the schema of the dataset.
Source Files