Versions in this module Expand all Collapse all v1 v1.0.2 Jul 13, 2023 v1.0.1 Jul 13, 2023 Changes in this version + type Hash map[uint32]TokenRanges + type TokenRange struct + End int + Start int + func (t *TokenRange) String() string + type TokenRanges []*TokenRange + func (t TokenRanges) CombineUnique(other TokenRanges) TokenRanges + func (t TokenRanges) Len() int + func (t TokenRanges) Less(i, j int) bool + func (t TokenRanges) Swap(i, j int) + type Tokens []*token + func Tokenize(s string) (toks Tokens) + func (t Tokens) GenerateHashes(h Hash, size int) ([]uint32, TokenRanges)
Go to main page