Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type TextStreamParser ¶
type TextStreamParser struct {
// contains filtered or unexported fields
}
TextStreamParser is a true streaming parser that reads text/markdown files. It complies with the Single Responsibility Principle by only extracting content into Document entities and leaving chunking to the Chunker.
func NewTextStreamParser ¶
func NewTextStreamParser(maxReadBytes int) *TextStreamParser
NewTextStreamParser creates a new parser optimized for raw text.
func (*TextStreamParser) GetSupportedTypes ¶
func (p *TextStreamParser) GetSupportedTypes() []string
GetSupportedTypes returns the MIME types or extensions this parser can handle.
Source Files
Click to show internal directories.
Click to hide internal directories.