Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func RegisterTokenizer ¶
func RegisterTokenizer(t Tokenizer)
RegisterTokenizer adds your tokenizer to our list.
func SetDefault ¶
SetDefault sets the default tokenizer for given typeID.
Types ¶
type DateTimeTokenizer ¶
type DateTimeTokenizer struct{}
func (DateTimeTokenizer) Name ¶
func (t DateTimeTokenizer) Name() string
func (DateTimeTokenizer) Type ¶
func (t DateTimeTokenizer) Type() types.TypeID
type DateTokenizer ¶
type DateTokenizer struct{}
func (DateTokenizer) Name ¶
func (t DateTokenizer) Name() string
func (DateTokenizer) Type ¶
func (t DateTokenizer) Type() types.TypeID
type ExactTokenizer ¶
type ExactTokenizer struct{}
func (ExactTokenizer) Name ¶
func (t ExactTokenizer) Name() string
func (ExactTokenizer) Type ¶
func (t ExactTokenizer) Type() types.TypeID
type FloatTokenizer ¶
type FloatTokenizer struct{}
func (FloatTokenizer) Name ¶
func (t FloatTokenizer) Name() string
func (FloatTokenizer) Type ¶
func (t FloatTokenizer) Type() types.TypeID
type GeoTokenizer ¶
type GeoTokenizer struct{}
func (GeoTokenizer) Name ¶
func (t GeoTokenizer) Name() string
func (GeoTokenizer) Type ¶
func (t GeoTokenizer) Type() types.TypeID
type Int32Tokenizer ¶
type Int32Tokenizer struct{}
func (Int32Tokenizer) Name ¶
func (t Int32Tokenizer) Name() string
func (Int32Tokenizer) Type ¶
func (t Int32Tokenizer) Type() types.TypeID
type TermTokenizer ¶
type TermTokenizer struct{}
func (TermTokenizer) Name ¶
func (t TermTokenizer) Name() string
func (TermTokenizer) Type ¶
func (t TermTokenizer) Type() types.TypeID
type Tokenizer ¶
type Tokenizer interface {
// Name is name of tokenizer. This should be unique.
Name() string
// Type returns typeID that we care about.
Type() types.TypeID
// Tokens return tokens for a given value.
Tokens(sv types.Val) ([]string, error)
}
Tokenizer defines what a tokenizer must provide.
func GetTokenizer ¶
GetTokenizer returns tokenizer given unique name.
Source Files
Click to show internal directories.
Click to hide internal directories.