token

package

v0.4.0 Latest Latest Go to latest Published: Apr 6, 2018 License: MIT Imports: 1 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type Token struct {
	Value     string
	StartLine int
	EndLine   int
	StartPos  int
	EndPos    int
	// contains filtered or unexported fields
}

Token value returned by lexer

func NewToken(value []byte, startLine int, endLine int, startPos int, endPos int) Token

NewToken Token constructor TODO: return pointer

func (t Token) Comments() []comment.Comment

Comments returns attached comments

func (t Token) SetComments(comments []comment.Comment) Token

SetComments attach comments

func (t Token) String() string