goscanner

package

v0.0.1 Latest Latest Go to latest Published: Dec 1, 2019 License: MIT Imports: 3 Imported by: 0

Details

Package goscanner have a bundle of code for lexical analysis and syntaxical analysis using the core go/scanner

This section is empty.

This section is empty.

func NewGoScanner() tokenizer.Tokenizer

NewGoScanner generate a GoScanner object and force to check implementation the tokenizer.Tokenizer interface

type GoScanner struct {
	// contains filtered or unexported fields
}

GoScanner implement the tokenizer.Tokenizer interface with the 'go/scanner' pkg : https://godoc.org/go/scanner

func (s *GoScanner) Init(input string)

Init init a scanner.Scanner of the go/scanner package

func (s *GoScanner) Scan() (string, token.Token, error)

Scan forward in the token list and return the token literal, the token type and an error if it occur end of list is notify by token.EOF token type