| Interface | Description |
|---|---|
| CharSequenceTokenizerSource |
Extension of the
TokenizerSource interface and the CharSequence
interface that was introduced in J2SE 1.4. |
| Flags |
The interface defines flags that are used by various classes during tokenizing.
|
| Tokenizer |
The interface
Tokenizer contains setup methods, parse operations
and other getter and setter methods for a tokenizer. |
| TokenizerProperties |
The interface
TokenizerProperties declares constants and methods
to maintain the characteristics of a Tokenizer, e. |
| TokenizerPropertyListener |
The interface
TokenizerPropertyListener is implemented by classes
that are interested in changes in TokenizerProperties objects. |
| TokenizerSource |
This interface describes the data source for a
Tokenizer. |
| Class | Description |
|---|---|
| AbstractTokenizer |
Base class for
Tokenizer implementations. |
| AbstractTokenizerProperties |
The class
AbstractTokenizerProperties provides the skeleton for
implementations of the TokenizerProperties interface. |
| CharArraySource |
Implementation of the
TokenizerSource and its extension
CharSequenceTokenizerSource for character arrays. |
| ReaderSource |
This implementation of the
TokenizerSource interface uses the JDK
Reader class to realize the requested functionality. |
| StandardTokenizer |
This is the mainstream
Tokenizer. |
| StandardTokenizerProperties |
The class
StandardTokenizerProperties provides a simple implementation
of the TokenizerProperties interface for use in most situations. |
| StringSource |
Implementation of the
TokenizerSource and its extension
CharSequenceTokenizerSource for strings. |
| Token |
Instances of this class are created by the classes implementing the
Tokenizer interface. |
| TokenizerProperty |
This class is mainly used by
TokenizerProperties implementations to
return Iterator objects of their various properties (keywords,
special sequences etc.). |
| TokenizerPropertyEvent |
The class
TokenizerPropertyEvent describes changes in
TokenizerProperties objects. |
| Exception | Description |
|---|---|
| TokenizerException |
Wrapper exception for all the problems that may occur while parsing.
|