Class Tokenizers

    • Method Detail

      • getTokenizer

        public static Tokenizer getTokenizer​(@NonNull
                                             @NonNull Language language)
        Creates a tokenizer for the given language.
        Parameters:
        language - the language
        Returns:
        the tokenizer