Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func BuildEmbeddingContent ¶ added in v0.1.6
BuildEmbeddingContent constructs the text content used for vector embedding. It combines the title, body, and comments into a single string. Comments with empty bodies are skipped.
Types ¶
type RecursiveCharacterSplitter ¶
type RecursiveCharacterSplitter struct {
// contains filtered or unexported fields
}
RecursiveCharacterSplitter splits text recursively by separators.
func NewRecursiveCharacterSplitter ¶
func NewRecursiveCharacterSplitter() *RecursiveCharacterSplitter
NewRecursiveCharacterSplitter creates a new splitter with default config. Default ChunkSize: 2000, ChunkOverlap: 200.
func (*RecursiveCharacterSplitter) SplitText ¶
func (s *RecursiveCharacterSplitter) SplitText(text string) []string
SplitText splits a text into chunks.
type SplitterConfig ¶
SplitterConfig holds configuration for text splitting.
Click to show internal directories.
Click to hide internal directories.