Main Page | Class Hierarchy | Alphabetical List | Class List | Directories | File List | Class Members | File Members | Related Pages

Tokenizers Struct Reference

List of all members.

Static Public Member Functions

static this ()
static this ()

Static Public Attributes

static LineScanner eol
static LineTokenizer line
static SpaceTokenizer space
static PunctTokenizer punct
static SimpleTokenizer comma

Detailed Description

It's convenient to have some simple tokenizers available without constructing them, so we provide a few to get going with.

Note that these Tokenizers do not maintain any state of their own. Thus they are all thread-safe.

Definition at line 489 of file Tokenizer.d.


Member Function Documentation

static this  )  [inline, static]
 

Make a few common tokenizers available as singletons

Definition at line 503 of file Tokenizer.d.

References comma, eol, line, punct, and space.

static this  )  [inline, static]
 

Make a few common tokenizers available as singletons

Definition at line 521 of file Copy of Tokenizer.d.

References comma, eol, line, punct, and space.


Member Data Documentation

static LineScanner eol [static]
 

Definition at line 509 of file Copy of Tokenizer.d.

Referenced by this().

static LineTokenizer line [static]
 

Definition at line 510 of file Copy of Tokenizer.d.

Referenced by this().

static SpaceTokenizer space [static]
 

Definition at line 511 of file Copy of Tokenizer.d.

Referenced by this().

static PunctTokenizer punct [static]
 

Definition at line 512 of file Copy of Tokenizer.d.

Referenced by this().

static SimpleTokenizer comma [static]
 

Definition at line 513 of file Copy of Tokenizer.d.

Referenced by this().


The documentation for this struct was generated from the following files:
Generated on Sat Dec 24 17:28:42 2005 for Mango by  doxygen 1.4.0