Uses of Class
com.gengoai.hermes.preprocessing.TextNormalizer
-
Packages that use TextNormalizer Package Description com.gengoai.hermes Hermes is a framework for Natural Language Processing.com.gengoai.hermes.format com.gengoai.hermes.preprocessing -
-
Uses of TextNormalizer in com.gengoai.hermes
Methods in com.gengoai.hermes with parameters of type TextNormalizer Modifier and Type Method Description DocumentFactory.DocumentFactoryBuilder
DocumentFactory.DocumentFactoryBuilder. normalizer(TextNormalizer normalizer)
Normalizer document factory builder.Method parameters in com.gengoai.hermes with type arguments of type TextNormalizer Modifier and Type Method Description DocumentFactory.DocumentFactoryBuilder
DocumentFactory.DocumentFactoryBuilder. normalizers(Collection<? extends TextNormalizer> normalizers)
Normalizers document factory builder. -
Uses of TextNormalizer in com.gengoai.hermes.format
Fields in com.gengoai.hermes.format with type parameters of type TextNormalizer Modifier and Type Field Description ParamMap.Parameter<List<TextNormalizer>>
DocFormatParameters. normalizers
The class names of the text normalizes to use when constructing documents.static ParameterDef<List<TextNormalizer>>
DocFormatParameters. NORMALIZERS
Defines the text normalization to use when constructing documents -
Uses of TextNormalizer in com.gengoai.hermes.preprocessing
Subclasses of TextNormalizer in com.gengoai.hermes.preprocessing Modifier and Type Class Description class
DiacriticalMarkNormalizer
Removes diacriticsclass
HtmlEntityNormalizer
Normalizes xml and html entities, such as&
class
TraditionalToSimplified
Preprocessor that converts traditional characters into simplified characters.class
UnicodeNormalizer
Converts unicode to canonical form and removes smart quotes.class
WhitespaceNormalizer
Handles normalizing whitespace.Methods in com.gengoai.hermes.preprocessing that return types with arguments of type TextNormalizer Modifier and Type Method Description List<TextNormalizer>
TextNormalization. getNormalizers()
Method parameters in com.gengoai.hermes.preprocessing with type arguments of type TextNormalizer Modifier and Type Method Description static TextNormalization
TextNormalization. createInstance(Collection<? extends TextNormalizer> normalizers)
Create instance text normalization.
-