slidechunk

package
v0.0.18 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 15, 2025 License: AGPL-3.0 Imports: 4 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type SlideChunker

type SlideChunker struct {
	// contains filtered or unexported fields
}

func New

func New(window uint32, slide uint32) *SlideChunker

Creates new chunker with maximum tokens in one chunk `window` and `slide` overlap between chunks.

func (*SlideChunker) GenerateChunks

func (c *SlideChunker) GenerateChunks(ctx context.Context, streamIterator parser.StreamResultIterator) chunker.ChunkIterator

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL