Tutorial by Examples

Most analysis customization is in the createComponents class, where the Tokenizer and TokenFilters are defined. CharFilters can be added in the initReader method. Analyzer analyzer = new Analyzer() { @Override protected Reader initReader(String fieldName, Reader reader) { retu...

TokenStream stream = myAnalyzer.tokenStream("myField", textToAnalyze); stream.addAttribute(CharTermAttribute.class); stream.reset(); while(stream.incrementToken()) { CharTermAttribute token = stream.getAttribute(CharTermAttribute.class); System.out.println(token.toString()); ...