nlp

package
v0.2.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 29, 2022 License: GPL-3.0 Imports: 6 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

View Source
var EnglishStopWords = map[string]bool{
	"a":     true,
	"an":    true,
	"and":   true,
	"are":   true,
	"as":    true,
	"at":    true,
	"be":    true,
	"but":   true,
	"by":    true,
	"for":   true,
	"if":    true,
	"in":    true,
	"into":  true,
	"is":    true,
	"it":    true,
	"no":    true,
	"not":   true,
	"of":    true,
	"on":    true,
	"or":    true,
	"such":  true,
	"that":  true,
	"the":   true,
	"their": true,
	"then":  true,
	"there": true,
	"these": true,
	"they":  true,
	"this":  true,
	"to":    true,
	"was":   true,
	"will":  true,
	"with":  true,
	"i":     true,
}

Functions

func DoSectionize

func DoSectionize(s, t string) (gotextfsm.ParserOutput, error)

func IsLetter

func IsLetter(s string) bool

func Sectionize

func Sectionize(s, t string) (gotextfsm.ParserOutput, error)

Sectionize splits semi-structured text into sections according to the user-defined

Types

type TokenInfo

type TokenInfo struct {
	Text string
	Type string
	Info string
}

func TextToTokens

func TextToTokens(s string) ([]TokenInfo, error)

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL