Uses of Class
com.g11ntoolkit.tokenizer.FileTokenizerError

Packages that use FileTokenizerError

com.g11ntoolkit.tokenizer

The set of classes that make up the Tokenizer support for the G11NToolKit.

Uses of FileTokenizerError in com.g11ntoolkit.tokenizer

Methods in com.g11ntoolkit.tokenizer that throw FileTokenizerError

static StrFile	TokXMLFile.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) This is the method that tokenizes the buffer and writes the two output files.
static StrFile	TokSQLFile.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) Tokenizes the buffer and writes the SQL file tok file and str file out.
static StrFile	TokRC.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) Tokenizes the buffer and writes the two output files.
static StrFile	TokPropertyResourceBundle.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) Tokenizes the buffer and writes the extracted string output file.
static StrFile	TokMC.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) Tokenizes the buffer and writes the two output files.
static StrFile	TokListResourceBundle.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale) Tokenizes the buffer and writes the extracted string output file.
static JSStrFile	TokJSFile.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) Tokenizes the buffer and writes the SQL file tok file and str file out.
static JSStrFile	TokCSSFile.tokenize(java.lang.String inFileName, java.lang.String contextFileName, java.util.Locale targetLocale, java.lang.String localeString) Tokenizes the buffer and writes the SQL file tok file and str file out.
protected void	FileTokenizer.setupTok(java.lang.String anEncoding, java.util.Locale aLocale) Used by the subclasses to set up the common part of the checking of any DSP file.
protected static void	FileTokenizer.setupTok(java.lang.String inFileName, java.lang.String contextFileName) Used by the subclasses to set up the common part of the tokenizing of any file and reads the file into the string buffer.
static void	FileTokenizer.readFile(java.lang.String inFileName) Reads in the specified file and stores it in the string buffer.
static void	FileTokenizer.readFilePlain(java.lang.String inFileName, java.lang.String encoding) Reads in the specified file and stores it in the string buffer.
protected static java.lang.String	FileTokenizer.cleanConcats(java.lang.String val) Removes any string concats from the specified string.

Constructors in com.g11ntoolkit.tokenizer that throw FileTokenizerError

TokXMLFile(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken, java.lang.String propFile)
This constructor is used to establish an instance of the class and save all the input information for use in processing the file.

TokSQLFile(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokSQLFile(java.lang.String anEncoding, java.util.Locale aLocale)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokSQLFile(java.lang.String anEncoding)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokRC()
Establishes an instance of the class with no input information.

TokRC(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokPropertyResourceBundle(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokMC()
Establishes an instance of the class with no input information.

TokMC(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokListResourceBundle(java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokJSFile(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokJSFile(java.lang.String anEncoding, java.util.Locale aLocale)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokJSFile(java.lang.String anEncoding)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokCSSFile(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokCSSFile(java.lang.String anEncoding, java.util.Locale aLocale)
Establishes an instance of the class and saves all the input information for use in processing the file.

TokCSSFile(java.lang.String anEncoding)
Establishes an instance of the class and saves all the input information for use in processing the file.

FileTokenizer(java.lang.String anEncoding, java.util.Locale aLocale, Token aToken)
Used by the subclasses to establish an instance of the class and save all the input information for use in processing the file.

FileTokenizer(java.lang.String anEncoding)
Used by the subclasses to establish an instance of the class and save the encoding information for use in processing the file.