lexer

package

v0.5.8 Latest Latest Go to latest Published: Nov 17, 2023 License: Apache-2.0 Imports: 1 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer - represents a lexical analyzer for the input source code.

func NewLexer(input string) (l *Lexer)

NewLexer - creates a new Lexer instance with the given input source code.

func (l *Lexer) GetColumnPosition() int

GetColumnPosition - returns the current column position of the Lexer in the input source code.

func (l *Lexer) GetLinePosition() int

GetLinePosition - returns the current line position of the Lexer in the input source code.

func (l *Lexer) NextToken() (tok token.Token)

NextToken returns the next token from the input string