Static Public Member Functions | |
static | this () |
Static Public Attributes | |
static LineScanner | eol |
static LineTokenizer | line |
static SpaceTokenizer | space |
static PunctTokenizer | punct |
static SimpleTokenizer | comma |
Note that these Tokenizers do not maintain any state of their own. Thus they are all thread-safe.
Definition at line 489 of file Tokenizer.d.
|
Make a few common tokenizers available as singletons Definition at line 503 of file Tokenizer.d. |
|
Definition at line 491 of file Tokenizer.d. Referenced by this(). |
|
Definition at line 492 of file Tokenizer.d. Referenced by this(). |
|
Definition at line 493 of file Tokenizer.d. Referenced by this(). |
|
Definition at line 494 of file Tokenizer.d. Referenced by this(). |
|
Definition at line 495 of file Tokenizer.d. Referenced by this(). |