textsplitter

package
v0.0.3 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 28, 2023 License: MIT Imports: 3 Imported by: 1

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type LenFunction

type LenFunction func(string) int

type RecursiveCharacterTextSplitter

type RecursiveCharacterTextSplitter struct {
	// contains filtered or unexported fields
}

func NewRecursiveCharacterTextSplitter

func NewRecursiveCharacterTextSplitter(chunkSize int, chunkOverlap int, separators []string, lengthFunction LenFunction) *RecursiveCharacterTextSplitter

func (*RecursiveCharacterTextSplitter) SplitDocuments

func (r *RecursiveCharacterTextSplitter) SplitDocuments(documents []document.Document) []document.Document

func (*RecursiveCharacterTextSplitter) SplitText

func (r *RecursiveCharacterTextSplitter) SplitText(text string) []string

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL