nltk

package
v0.0.21 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Jun 11, 2026 License: MIT Imports: 2 Imported by: 0

Documentation

Index

Constants

View Source 
const (
	PluginTitle   = "rtp-agent.plugins.nltk"
	PluginVersion = "1.5.15"
	PluginPackage = "rtp-agent.plugins.nltk"
)

Variables

This section is empty.

Functions

This section is empty.

Types

type Plugin added in v0.0.15 

type Plugin struct{}

func (Plugin) DownloadFiles added in v0.0.15 

func (Plugin) DownloadFiles() error

type SentenceTokenizer 

type SentenceTokenizer struct {
	Language         string
	MinSentenceLen   int
	StreamContextLen int
}

func NewSentenceTokenizer 

func NewSentenceTokenizer(language string, minSentenceLen, streamContextLen int) *SentenceTokenizer

func (*SentenceTokenizer) Stream 

func (t *SentenceTokenizer) Stream(language string) tokenize.SentenceStream

func (*SentenceTokenizer) Tokenize 

func (t *SentenceTokenizer) Tokenize(text string, language string) []string

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.