Main Page | Class Hierarchy | Alphabetical List | Class List | File List | Class Members | File Members | Related Pages

Tokenizers Struct Reference

List of all members.

Static Public Member Functions

 this ()

Static Public Attributes

LineScanner eol
LineTokenizer line
SpaceTokenizer space
PunctTokenizer punct
SimpleTokenizer comma

Detailed Description

It's convenient to have some simple tokenizers available without constructing them, so we provide a few to get going with.

Note that these Tokenizers do not maintain any state of their own. Thus they are all thread-safe.

Definition at line 481 of file Tokenizer.d.


Member Function Documentation

this  )  [inline, static]
 

Make a few common tokenizers available as singletons

Definition at line 495 of file Tokenizer.d.

References comma, eol, punct, and space.


Member Data Documentation

LineScanner eol [static]
 

Definition at line 483 of file Tokenizer.d.

Referenced by this().

LineTokenizer line [static]
 

Definition at line 484 of file Tokenizer.d.

SpaceTokenizer space [static]
 

Definition at line 485 of file Tokenizer.d.

Referenced by this().

PunctTokenizer punct [static]
 

Definition at line 486 of file Tokenizer.d.

Referenced by this().

SimpleTokenizer comma [static]
 

Definition at line 487 of file Tokenizer.d.

Referenced by this().


The documentation for this struct was generated from the following file:
Generated on Sun Nov 7 19:07:12 2004 for Mango by doxygen 1.3.6