Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Input ¶
type Input struct {
// Token is a single element of text.
Token int32
// Multimodal is opaque data representing a non-text
// element such as an image (or part of one if the image
// can be processed in pieces). It may be either together
// with Token or on its own.
Multimodal any
// MultimodalHash is a unique representation of the data
// stored in Multimodal, used for caching and comparing
// equality.
MultimodalHash uint64
}
Input represents one token in the input stream
type MultimodalIndex ¶
MultimodalIndex is a multimodal element (such as an image) together with an index into the slice of Inputs with the corresponding token. Note that the index is not the same as the position - to find that use the index with the Positions slice.
Click to show internal directories.
Click to hide internal directories.