token

package

v1.0.0 Latest Latest Go to latest Published: Aug 1, 2026 License: GPL-3.0 Imports: 1 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/slavkiy/witgo

Links

Open Source Insights

Documentation ¶

Index ¶

type Position
- func (p Position) String() string
type Token
- func (t Token) Slice(src string) string
- func (t Token) String() string
type TokenType
- func LookupKeyword(lit string) (TokenType, bool)
- func (t TokenType) String() string

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Position ¶

type Position struct {
	Offset int
	Line   int
	Column int
}

func (Position) String ¶

func (p Position) String() string

type Token ¶

type Token struct {
	Type  TokenType
	Start Position
	End   Position
}

func (Token) Slice ¶

func (t Token) Slice(src string) string

func (Token) String ¶

func (t Token) String() string

type TokenType ¶

type TokenType uint8

const (
	TokenInvalid TokenType = iota
	TokenEOF
	TokenIdentifier
	TokenInteger
	TokenString
	TokenExplicitID
	TokenUnderscore
	TokenDocComment

	TokenAt
	TokenColon
	TokenSemicolon
	TokenComma
	TokenDot
	TokenEquals
	TokenLParen
	TokenRParen
	TokenLBrace
	TokenRBrace
	TokenLBracket
	TokenRBracket
	TokenLAngle
	TokenRAngle
	TokenStar
	TokenSlash
	TokenArrow

	TokenKeywordAs
	TokenKeywordAsync
	TokenKeywordBool
	TokenKeywordBorrow
	TokenKeywordChar
	TokenKeywordConstructor
	TokenKeywordEnum
	TokenKeywordExport
	TokenKeywordF32
	TokenKeywordF64
	TokenKeywordFlags
	TokenKeywordFrom
	TokenKeywordFunc
	TokenKeywordFuture
	TokenKeywordImport
	TokenKeywordInclude
	TokenKeywordInterface
	TokenKeywordList
	TokenKeywordMap
	TokenKeywordOption
	TokenKeywordOwn
	TokenKeywordPackage
	TokenKeywordRecord
	TokenKeywordResource
	TokenKeywordResult
	TokenKeywordS8
	TokenKeywordS16
	TokenKeywordS32
	TokenKeywordS64
	TokenKeywordStatic
	TokenKeywordStream
	TokenKeywordString
	TokenKeywordTuple
	TokenKeywordType
	TokenKeywordU8
	TokenKeywordU16
	TokenKeywordU32
	TokenKeywordU64
	TokenKeywordUse
	TokenKeywordVariant
	TokenKeywordWith
	TokenKeywordWorld
)

func LookupKeyword ¶

func LookupKeyword(lit string) (TokenType, bool)

func (TokenType) String ¶

func (t TokenType) String() string

Source Files ¶

View all Source files

token.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL