Uses of Class
com.gengoai.hermes.morphology.TokenType
-
Packages that use TokenType Package Description com.gengoai.hermes Hermes is a framework for Natural Language Processing.com.gengoai.hermes.morphology -
-
Uses of TokenType in com.gengoai.hermes
Fields in com.gengoai.hermes with type parameters of type TokenType Modifier and Type Field Description static AttributeType<TokenType>
Types. TOKEN_TYPE
TokenType attribute defining the type of token. -
Uses of TokenType in com.gengoai.hermes.morphology
Fields in com.gengoai.hermes.morphology declared as TokenType Modifier and Type Field Description static TokenType
TokenType. ACRONYM
The constant ACRONYM.static TokenType
TokenType. ALPHA_NUMERIC
The constant ALPHA_NUMERIC.static TokenType
TokenType. CHINESE_JAPANESE
The constant CHINESE_JAPANESE.static TokenType
TokenType. COMPANY
The constant COMPANY.static TokenType
TokenType. CONTRACTION
The constant CONTRACTION.static TokenType
TokenType. EMAIL
The constant EMAIL.static TokenType
TokenType. EMOTICON
The constant EMOTICON.static TokenType
TokenType. HASH_TAG
The constant HASH_TAG.static TokenType
TokenType. HYPHEN
The constant HYPHEN.static TokenType
TokenType. MONEY
The constant MONEY.static TokenType
TokenType. NUMBER
The constant NUMBER.static TokenType
TokenType. PERSON_TITLE
The constant PERSON_TITLE.static TokenType
TokenType. PROTOCOL
The constant PROTOCOL.static TokenType
TokenType. PUNCTUATION
The constant PUNCTUATION.static TokenType
TokenType. REPLY
The constant REPLY.static TokenType
TokenType. SGML
The constant SGML.static TokenType
TokenType. TIME
The constant TIME.TokenType
Tokenizer.Token. type
The Type.static TokenType
TokenType. UNKNOWN
The constant UNKNOWN.static TokenType
TokenType. URL
The constant URL.Methods in com.gengoai.hermes.morphology that return TokenType Modifier and Type Method Description static TokenType
TokenType. make(String name)
Makes a new or retrieves an existing TokenType with the given nameMethods in com.gengoai.hermes.morphology that return types with arguments of type TokenType Modifier and Type Method Description protected Registry<TokenType>
TokenType. registry()
static Collection<TokenType>
TokenType. values()
Returns a collection of all known TokenType in the enumeration.Constructors in com.gengoai.hermes.morphology with parameters of type TokenType Constructor Description Token(String text, TokenType type, int startChar, int endChar, int index)
Default constructor
-