net.sourceforge.czt.parser.z

Class UnicodeScanner

java.lang.Object

net.sourceforge.czt.parser.util.TokeniserDebugger

net.sourceforge.czt.parser.util.CztScannerImpl

net.sourceforge.czt.parser.z.UnicodeScanner

All Implemented Interfaces:

Scanner, CztScanner

public class UnicodeScanner
extends CztScannerImpl

A scanner for lexing specifications in unicode format.

This is a convenience class that assembles the ContextFreeScanner, KeywordScanner, and SmartScanner; providing an implementation of chapters 7.2 till 7.4.4 of the ISO Standard for Z.

Note that the token stream provided by this scanner does not yet have operator names resolved to operator tokens and still contains soft newlines. This is handled by the OperatorScanner, which is created by the parser.

Author:

Petra Malik

See Also:

net.sourceforge.czt.parser.z

Constructor Summary

Constructors

Constructor and Description
UnicodeScanner(CztReader in, Properties properties)
UnicodeScanner(Source source, Properties properties)

Method Summary

Modifier and Type	Method and Description
Dialect	getDialect()
protected Class<?>	getSymbolClass()
static void	main(String[] argv) Lexes a given file.
Symbol	next_token()
void	reset(Reader in)

Methods inherited from class net.sourceforge.czt.parser.util.CztScannerImpl

getSymbolMap, getSymbolMap2, logSymbol

Methods inherited from class net.sourceforge.czt.parser.util.TokeniserDebugger

doLog, getDebugLoggingLevel, logDebugInfo, logFormatted, setDebug

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.sourceforge.czt.parser.util.CztScanner

logDebugInfo, logFormatted

Constructor Detail

UnicodeScanner

public UnicodeScanner(Source source,
                      Properties properties)
               throws IOException

Throws:

IOException

UnicodeScanner

public UnicodeScanner(CztReader in,
                      Properties properties)

Method Detail

getDialect

public Dialect getDialect()

main

public static void main(String[] argv)

Lexes a given file.

getSymbolClass

protected Class<?> getSymbolClass()

Specified by:

getSymbolClass in class CztScannerImpl

next_token

public Symbol next_token()
                  throws Exception

Throws:

Exception

reset

public void reset(Reader in)