DotLucene 1.4 API Documentation |

# CharTokenizer.IsTokenChar Method

Returns true iff a character should be included in a token. This tokenizer generates as tokens adjacent sequences of characters which satisfy this predicate. Characters for which this is false are used to define token boundaries and are not included in tokens.

protected internal abstract bool IsTokenChar(
char c
);

#### See Also

CharTokenizer Class | Lucene.Net.Analysis Namespace