The highest tagged major version is v2.

lexer

package

v0.0.14 Latest Latest Go to latest Published: Dec 30, 2022 License: MIT Imports: 4 Imported by: 0

Details

Package lexer contains the code to lex input-programs into a stream of tokens, such that they may be parsed.

This section is empty.

This section is empty.

This section is empty.

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer holds our object-state.

func New(input string) *Lexer

New returns a Lexer instance for a given string input.

func NewWithOptions(opts Opts) *Lexer

NewWithOptions returns a Lexer instance with the given options.

func (l *Lexer) CurrentPosition() token.Position

CurrentPosition returns a Position object for the current read position.

func (l *Lexer) File() string

The name of the file being read.

func (l *Lexer) GetTokenLineText(t token.Token) string

func (l *Lexer) NextToken() (token.Token, error)

NextToken to read next token, skipping the white space.

type Opts struct {
	Input string
	File  string
}

Opts contains Lexer initialization options