Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func SliceRecord ¶
func SliceRecord(r arrow.RecordBatch, limit *Cap) (add *SlicedRecord, flush []arrow.RecordBatch, remaining *SlicedRecord)
SliceRecord will return the SlicedRecord you can add to the batch given the restrictions provided (if any). The meaning of the returned values: - `add` is good to be added to the current batch that the caller is assembling - `flush` represents sliced arrow.Record that needs own batch to be flushed - `remaining` represents the overflow of the batch after `add` & `flush` are processed Note that the `limit` provided will not be updated.
func SplitRecord ¶ added in v4.96.4
func SplitRecord(r arrow.RecordBatch, limit *Cap) []arrow.RecordBatch
Types ¶
type Cap ¶
type Cap struct {
// contains filtered or unexported fields
}
func (*Cap) AddSlice ¶
func (c *Cap) AddSlice(record *SlicedRecord)
func (*Cap) ReachedLimit ¶
type SlicedRecord ¶
type SlicedRecord struct {
arrow.RecordBatch
Bytes int64 // we need this as the util.TotalRecordSize will report the full size even for the sliced record
// contains filtered or unexported fields
}
Source Files
Click to show internal directories.
Click to hide internal directories.