Main Page | Class Hierarchy | Alphabetical List | Class List | File List | Class Members | File Members | Related Pages

Tokenizers Struct Reference

List of all members.

Static Public Member Functions

 this ()

Static Public Attributes

LineScanner eol
LineTokenizer line
SpaceTokenizer space
PunctTokenizer punct
SimpleTokenizer comma

Detailed Description

It's convenient to have some simple tokenizers available without constructing them, so we provide a few to get going with.

Note that these Tokenizers do not maintain any state of their own. Thus they are all thread-safe.

Definition at line 484 of file Tokenizer.d.


Member Function Documentation

this  )  [inline, static]
 

Make a few common tokenizers available as singletons

Definition at line 498 of file Tokenizer.d.

References comma, eol, and punct.


Member Data Documentation

LineScanner eol [static]
 

Definition at line 486 of file Tokenizer.d.

Referenced by this().

LineTokenizer line [static]
 

Definition at line 487 of file Tokenizer.d.

SpaceTokenizer space [static]
 

Definition at line 488 of file Tokenizer.d.

PunctTokenizer punct [static]
 

Definition at line 489 of file Tokenizer.d.

Referenced by this().

SimpleTokenizer comma [static]
 

Definition at line 490 of file Tokenizer.d.

Referenced by this().


The documentation for this struct was generated from the following file:
Generated on Sat Apr 9 20:11:44 2005 for Mango by doxygen 1.3.6