• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java NamedAnalyzer类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.elasticsearch.index.analysis.NamedAnalyzer的典型用法代码示例。如果您正苦于以下问题:Java NamedAnalyzer类的具体用法?Java NamedAnalyzer怎么用?Java NamedAnalyzer使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



NamedAnalyzer类属于org.elasticsearch.index.analysis包,在下文中一共展示了NamedAnalyzer类的20个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: parse

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
private List<TokenData> parse(String text) {
    NamedAnalyzer analyzer = getAnalysisService().indexAnalyzers.get("test");

    try {
        try (TokenStream ts = analyzer.tokenStream("test", new StringReader(text))) {
            List<TokenData> result = new ArrayList<>();
            CharTermAttribute charTerm = ts.addAttribute(CharTermAttribute.class);
            OffsetAttribute offset = ts.addAttribute(OffsetAttribute.class);
            PositionIncrementAttribute position = ts.addAttribute(PositionIncrementAttribute.class);
            ts.reset();
            while (ts.incrementToken()) {
                String original = text.substring(offset.startOffset(), offset.endOffset());
                result.add(token(original, charTerm.toString(), position.getPositionIncrement()));
            }
            ts.end();

            return result;
        }
    } catch (IOException e) {
        throw new RuntimeException(e);
    }
}
 
开发者ID:EvidentSolutions,项目名称:elasticsearch-analysis-voikko,代码行数:23,代码来源:VoikkoTokenFilterTests.java


示例2: getShingleFilterFactory

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
private static ShingleTokenFilterFactory.Factory getShingleFilterFactory(Analyzer analyzer) {
    if (analyzer instanceof NamedAnalyzer) {
        analyzer = ((NamedAnalyzer)analyzer).analyzer();
    }
    if (analyzer instanceof CustomAnalyzer) {
        final CustomAnalyzer a = (CustomAnalyzer) analyzer;
        final TokenFilterFactory[] tokenFilters = a.tokenFilters();
        for (TokenFilterFactory tokenFilterFactory : tokenFilters) {
            if (tokenFilterFactory instanceof ShingleTokenFilterFactory) {
                return ((ShingleTokenFilterFactory)tokenFilterFactory).getInnerFactory();
            } else if (tokenFilterFactory instanceof ShingleTokenFilterFactory.Factory) {
                return (ShingleTokenFilterFactory.Factory) tokenFilterFactory;
            }
        }
    }
    return null;
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:18,代码来源:PhraseSuggestionBuilder.java


示例3: containsBrokenAnalysis

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
private static boolean containsBrokenAnalysis(Analyzer analyzer) {
    // TODO maybe we need a getter on Namedanalyzer that tells if this uses broken Analysis
    if (analyzer instanceof NamedAnalyzer) {
        analyzer = ((NamedAnalyzer) analyzer).analyzer();
    }
    if (analyzer instanceof CustomAnalyzer) {
        final CustomAnalyzer a = (CustomAnalyzer) analyzer;
        TokenFilterFactory[] tokenFilters = a.tokenFilters();
        for (TokenFilterFactory tokenFilterFactory : tokenFilters) {
            if (tokenFilterFactory instanceof WordDelimiterTokenFilterFactory
                    || tokenFilterFactory instanceof EdgeNGramTokenFilterFactory) {
                return true;
            }
        }
    }
    return false;
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:18,代码来源:FragmentBuilderHelper.java


示例4: parse

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
@SuppressWarnings("unchecked")
public Mapper.Builder parse(String name, Map<String, Object> node, ParserContext parserContext) throws MapperParsingException {
    TokenCountFieldMapper.Builder builder = new TokenCountFieldMapper.Builder(name);
    for (Iterator<Map.Entry<String, Object>> iterator = node.entrySet().iterator(); iterator.hasNext();) {
        Map.Entry<String, Object> entry = iterator.next();
        String propName = entry.getKey();
        Object propNode = entry.getValue();
        if (propName.equals("null_value")) {
            builder.nullValue(nodeIntegerValue(propNode));
            iterator.remove();
        } else if (propName.equals("analyzer")) {
            NamedAnalyzer analyzer = parserContext.getIndexAnalyzers().get(propNode.toString());
            if (analyzer == null) {
                throw new MapperParsingException("Analyzer [" + propNode.toString() + "] not found for field [" + name + "]");
            }
            builder.analyzer(analyzer);
            iterator.remove();
        }
    }
    parseField(builder, name, node, parserContext);
    if (builder.analyzer() == null) {
        throw new MapperParsingException("Analyzer must be set for field [" + name + "] but wasn't.");
    }
    return builder;
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:27,代码来源:TokenCountFieldMapper.java


示例5: build

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
public AllFieldMapper build(BuilderContext context) {
    // In case the mapping overrides these
    // TODO: this should be an exception! it doesnt make sense to not index this field
    if (fieldType.indexOptions() == IndexOptions.NONE) {
        fieldType.setIndexOptions(Defaults.FIELD_TYPE.indexOptions());
    } else {
        fieldType.setIndexAnalyzer(new NamedAnalyzer(fieldType.indexAnalyzer(),
            Defaults.POSITION_INCREMENT_GAP));
        fieldType.setSearchAnalyzer(new NamedAnalyzer(fieldType.searchAnalyzer(),
            Defaults.POSITION_INCREMENT_GAP));
        fieldType.setSearchQuoteAnalyzer(new NamedAnalyzer(fieldType.searchQuoteAnalyzer(),
            Defaults.POSITION_INCREMENT_GAP));
    }
    fieldType.setTokenized(true);

    return new AllFieldMapper(fieldType, enabled, context.indexSettings());
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:19,代码来源:AllFieldMapper.java


示例6: build

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
public TextFieldMapper build(BuilderContext context) {
    if (positionIncrementGap != POSITION_INCREMENT_GAP_USE_ANALYZER) {
        if (fieldType.indexOptions().compareTo(IndexOptions.DOCS_AND_FREQS_AND_POSITIONS) < 0) {
            throw new IllegalArgumentException("Cannot set position_increment_gap on field ["
                + name + "] without positions enabled");
        }
        fieldType.setIndexAnalyzer(new NamedAnalyzer(fieldType.indexAnalyzer(), positionIncrementGap));
        fieldType.setSearchAnalyzer(new NamedAnalyzer(fieldType.searchAnalyzer(), positionIncrementGap));
        fieldType.setSearchQuoteAnalyzer(new NamedAnalyzer(fieldType.searchQuoteAnalyzer(), positionIncrementGap));
    }
    setupFieldType(context);
    return new TextFieldMapper(
            name, fieldType, defaultFieldType, positionIncrementGap, includeInAll,
            context.indexSettings(), multiFieldsBuilder.build(this, context), copyTo);
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:17,代码来源:TextFieldMapper.java


示例7: testVersionedAnalyzers

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
public void testVersionedAnalyzers() throws Exception {
    String yaml = "/org/elasticsearch/index/analysis/test1.yml";
    Settings settings2 = Settings.builder()
            .loadFromStream(yaml, getClass().getResourceAsStream(yaml))
            .put(Environment.PATH_HOME_SETTING.getKey(), createTempDir().toString())
            .put(IndexMetaData.SETTING_VERSION_CREATED, Version.V_2_0_0)
            .build();
    AnalysisRegistry newRegistry = getNewRegistry(settings2);
    IndexAnalyzers indexAnalyzers = getIndexAnalyzers(newRegistry, settings2);

    // registry always has the current version
    assertThat(newRegistry.getAnalyzer("default"), is(instanceOf(NamedAnalyzer.class)));
    NamedAnalyzer defaultNamedAnalyzer = (NamedAnalyzer) newRegistry.getAnalyzer("default");
    assertThat(defaultNamedAnalyzer.analyzer(), is(instanceOf(StandardAnalyzer.class)));
    assertEquals(Version.CURRENT.luceneVersion, defaultNamedAnalyzer.analyzer().getVersion());

    // analysis service has the expected version
    assertThat(indexAnalyzers.get("standard").analyzer(), is(instanceOf(StandardAnalyzer.class)));
    assertEquals(Version.V_2_0_0.luceneVersion, indexAnalyzers.get("standard").analyzer().getVersion());
    assertEquals(Version.V_2_0_0.luceneVersion, indexAnalyzers.get("thai").analyzer().getVersion());

    assertThat(indexAnalyzers.get("custom7").analyzer(), is(instanceOf(StandardAnalyzer.class)));
    assertEquals(org.apache.lucene.util.Version.fromBits(3,6,0), indexAnalyzers.get("custom7").analyzer().getVersion());
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:25,代码来源:AnalysisModuleTests.java


示例8: testAnalyzers

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
public void testAnalyzers() throws IOException {
    FakeFieldType fieldType1 = new FakeFieldType();
    fieldType1.setName("field1");
    fieldType1.setIndexAnalyzer(new NamedAnalyzer("foo", AnalyzerScope.INDEX, new FakeAnalyzer("index")));
    fieldType1.setSearchAnalyzer(new NamedAnalyzer("bar", AnalyzerScope.INDEX, new FakeAnalyzer("search")));
    fieldType1.setSearchQuoteAnalyzer(new NamedAnalyzer("baz", AnalyzerScope.INDEX, new FakeAnalyzer("search_quote")));
    FieldMapper fieldMapper1 = new FakeFieldMapper("field1", fieldType1);

    FakeFieldType fieldType2 = new FakeFieldType();
    fieldType2.setName("field2");
    FieldMapper fieldMapper2 = new FakeFieldMapper("field2", fieldType2);

    Analyzer defaultIndex = new FakeAnalyzer("default_index");
    Analyzer defaultSearch = new FakeAnalyzer("default_search");
    Analyzer defaultSearchQuote = new FakeAnalyzer("default_search_quote");

    DocumentFieldMappers documentFieldMappers = new DocumentFieldMappers(Arrays.asList(fieldMapper1, fieldMapper2), defaultIndex, defaultSearch, defaultSearchQuote);

    assertAnalyzes(documentFieldMappers.indexAnalyzer(), "field1", "index");
    assertAnalyzes(documentFieldMappers.searchAnalyzer(), "field1", "search");
    assertAnalyzes(documentFieldMappers.searchQuoteAnalyzer(), "field1", "search_quote");

    assertAnalyzes(documentFieldMappers.indexAnalyzer(), "field2", "default_index");
    assertAnalyzes(documentFieldMappers.searchAnalyzer(), "field2", "default_search");
    assertAnalyzes(documentFieldMappers.searchQuoteAnalyzer(), "field2", "default_search_quote");
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:27,代码来源:DocumentFieldMapperTests.java


示例9: testMergeSearchAnalyzer

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
public void testMergeSearchAnalyzer() throws Exception {
    DocumentMapperParser parser = createIndex("test").mapperService().documentMapperParser();
    String mapping1 = XContentFactory.jsonBuilder().startObject().startObject("type")
            .startObject("properties").startObject("field").field("type", "text").field("analyzer", "standard").field("search_analyzer", "whitespace").endObject().endObject()
            .endObject().endObject().string();
    String mapping2 = XContentFactory.jsonBuilder().startObject().startObject("type")
            .startObject("properties").startObject("field").field("type", "text").field("analyzer", "standard").field("search_analyzer", "keyword").endObject().endObject()
            .endObject().endObject().string();

    DocumentMapper existing = parser.parse("type", new CompressedXContent(mapping1));
    DocumentMapper changed = parser.parse("type", new CompressedXContent(mapping2));

    assertThat(((NamedAnalyzer) existing.mappers().getMapper("field").fieldType().searchAnalyzer()).name(), equalTo("whitespace"));
    DocumentMapper merged = existing.merge(changed.mapping(), false);

    assertThat(((NamedAnalyzer) merged.mappers().getMapper("field").fieldType().searchAnalyzer()).name(), equalTo("keyword"));
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:18,代码来源:DocumentMapperMergeTests.java


示例10: testChangeSearchAnalyzerToDefault

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
public void testChangeSearchAnalyzerToDefault() throws Exception {
    MapperService mapperService = createIndex("test").mapperService();
    String mapping1 = XContentFactory.jsonBuilder().startObject().startObject("type")
            .startObject("properties").startObject("field").field("type", "text").field("analyzer", "standard").field("search_analyzer", "whitespace").endObject().endObject()
            .endObject().endObject().string();
    String mapping2 = XContentFactory.jsonBuilder().startObject().startObject("type")
            .startObject("properties").startObject("field").field("type", "text").field("analyzer", "standard").endObject().endObject()
            .endObject().endObject().string();

    DocumentMapper existing = mapperService.merge("type", new CompressedXContent(mapping1), MapperService.MergeReason.MAPPING_UPDATE, false);
    DocumentMapper merged = mapperService.merge("type", new CompressedXContent(mapping2), MapperService.MergeReason.MAPPING_UPDATE, false);

    assertThat(((NamedAnalyzer) existing.mappers().getMapper("field").fieldType().searchAnalyzer()).name(), equalTo("whitespace"));

    assertThat(((NamedAnalyzer) merged.mappers().getMapper("field").fieldType().searchAnalyzer()).name(), equalTo("standard"));
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:17,代码来源:DocumentMapperMergeTests.java


示例11: testNoParentNullFieldCreatedIfNoParentSpecified

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
public void testNoParentNullFieldCreatedIfNoParentSpecified() throws Exception {
    Index index = new Index("_index", "testUUID");
    IndexSettings indexSettings = IndexSettingsModule.newIndexSettings(index, Settings.EMPTY);
    NamedAnalyzer namedAnalyzer = new NamedAnalyzer("default", AnalyzerScope.INDEX, new StandardAnalyzer());
    IndexAnalyzers indexAnalyzers = new IndexAnalyzers(indexSettings, namedAnalyzer, namedAnalyzer, namedAnalyzer,
        Collections.emptyMap(), Collections.emptyMap());
    SimilarityService similarityService = new SimilarityService(indexSettings, Collections.emptyMap());
    MapperService mapperService = new MapperService(indexSettings, indexAnalyzers, xContentRegistry(), similarityService,
        new IndicesModule(emptyList()).getMapperRegistry(), () -> null);
    XContentBuilder mappingSource = jsonBuilder().startObject().startObject("some_type")
        .startObject("properties")
        .endObject()
        .endObject().endObject();
    mapperService.merge("some_type", new CompressedXContent(mappingSource.string()), MergeReason.MAPPING_UPDATE, false);
    Set<String> allFields = new HashSet<>(mapperService.simpleMatchToIndexNames("*"));
    assertTrue(allFields.contains("_parent"));
    assertFalse(allFields.contains("_parent#null"));
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:19,代码来源:ParentFieldMapperTests.java


示例12: getShingleFilterFactory

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
public static ShingleTokenFilterFactory.Factory getShingleFilterFactory(Analyzer analyzer) {
    if (analyzer instanceof NamedAnalyzer) {
        analyzer = ((NamedAnalyzer)analyzer).analyzer();
    }
    if (analyzer instanceof CustomAnalyzer) {
        final CustomAnalyzer a = (CustomAnalyzer) analyzer;
        final TokenFilterFactory[] tokenFilters = a.tokenFilters();
        for (TokenFilterFactory tokenFilterFactory : tokenFilters) {
            if (tokenFilterFactory instanceof ShingleTokenFilterFactory) {
                return ((ShingleTokenFilterFactory)tokenFilterFactory).getInnerFactory();
            } else if (tokenFilterFactory instanceof ShingleTokenFilterFactory.Factory) {
                return (ShingleTokenFilterFactory.Factory) tokenFilterFactory;
            }
        }
    }
    return null;
}
 
开发者ID:baidu,项目名称:Elasticsearch,代码行数:18,代码来源:SuggestUtils.java


示例13: parse

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
@SuppressWarnings("unchecked")
public Mapper.Builder parse(String name, Map<String, Object> node, ParserContext parserContext) throws MapperParsingException {
    TokenCountFieldMapper.Builder builder = tokenCountField(name);
    for (Iterator<Map.Entry<String, Object>> iterator = node.entrySet().iterator(); iterator.hasNext();) {
        Map.Entry<String, Object> entry = iterator.next();
        String propName = Strings.toUnderscoreCase(entry.getKey());
        Object propNode = entry.getValue();
        if (propName.equals("null_value")) {
            builder.nullValue(nodeIntegerValue(propNode));
            iterator.remove();
        } else if (propName.equals("analyzer")) {
            NamedAnalyzer analyzer = parserContext.analysisService().analyzer(propNode.toString());
            if (analyzer == null) {
                throw new MapperParsingException("Analyzer [" + propNode.toString() + "] not found for field [" + name + "]");
            }
            builder.analyzer(analyzer);
            iterator.remove();
        }
    }
    parseNumberField(builder, name, node, parserContext);
    if (builder.analyzer() == null) {
        throw new MapperParsingException("Analyzer must be set for field [" + name + "] but wasn't.");
    }
    return builder;
}
 
开发者ID:baidu,项目名称:Elasticsearch,代码行数:27,代码来源:TokenCountFieldMapper.java


示例14: build

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
public LangStringFieldMapper build(final BuilderContext context) {
    if (positionIncrementGap != POSITION_INCREMENT_GAP_USE_ANALYZER) {
        if (fieldType.indexOptions().compareTo(IndexOptions.DOCS_AND_FREQS_AND_POSITIONS) < 0) {
            throw new IllegalArgumentException("Cannot set position_increment_gap on field ["
                + name + "] without positions enabled");
        }
        fieldType.setIndexAnalyzer(new NamedAnalyzer(fieldType.indexAnalyzer(), positionIncrementGap));
        fieldType.setSearchAnalyzer(new NamedAnalyzer(fieldType.searchAnalyzer(), positionIncrementGap));
        fieldType.setSearchQuoteAnalyzer(new NamedAnalyzer(fieldType.searchQuoteAnalyzer(), positionIncrementGap));
    }
    setupFieldType(context);
    return new LangStringFieldMapper(
            name, fieldType, defaultFieldType, positionIncrementGap, includeInAll,
            fieldSeparator, supportedLanguages, langField, langBaseName,
            context.indexSettings(), multiFieldsBuilder.build(this, context), copyTo);
}
 
开发者ID:codelibs,项目名称:elasticsearch-langfield,代码行数:18,代码来源:LangStringFieldMapper.java


示例15: SherlokFieldMapper

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
protected SherlokFieldMapper(final Names names, final FieldType fieldType,
        final Boolean docValues, final Boolean compress,
        final long compressThreshold,
        final PostingsFormatProvider postingsProvider,
        final DocValuesFormatProvider docValuesProvider,
        @Nullable final Settings fieldDataSettings,
        final MultiFields multiFields, final CopyTo copyTo,
        final NamedAnalyzer minhashAnalyzer, final String copyBitsTo) {
    super(names, 1.0f, fieldType, docValues, null, null, postingsProvider,
            docValuesProvider, null, null, fieldDataSettings, null,
            multiFields, copyTo);
    this.compress = compress;
    this.compressThreshold = compressThreshold;
    this.minhashAnalyzer = minhashAnalyzer;
    this.copyBitsTo = copyBitsTo;
}
 
开发者ID:sherlok,项目名称:sherlastic,代码行数:17,代码来源:SherlokFieldMapper.java


示例16: parse

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
public Mapper.Builder parse(final String name, final Map<String, Object> node,
        final ParserContext parserContext) throws MapperParsingException {
    final MinHashFieldMapper.Builder builder = new MinHashFieldMapper.Builder(
            name);
    parseField(builder, name, node, parserContext);
    for (final Iterator<Map.Entry<String, Object>> iterator = node.entrySet()
            .iterator(); iterator.hasNext();) {
        final Map.Entry<String, Object> entry = iterator.next();
        final String propName = entry.getKey();
        final Object propNode = entry.getValue();
        if (propName.equals("minhash_analyzer") && propNode != null) {
            final NamedAnalyzer analyzer = parserContext
                    .getIndexAnalyzers().get(propNode.toString());
            builder.minhashAnalyzer(analyzer);
            iterator.remove();
        } else if (propName.equals("copy_bits_to")
                && propNode != null) {
            parseCopyBitsFields(propNode, builder);
            iterator.remove();
        }
    }
    return builder;
}
 
开发者ID:codelibs,项目名称:elasticsearch-minhash,代码行数:25,代码来源:MinHashFieldMapper.java


示例17: doXContentBody

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Override
protected void doXContentBody(XContentBuilder builder, boolean includeDefaults, Params params) throws IOException {
    super.doXContentBody(builder, includeDefaults, params);
    if (includeDefaults || fieldType().nullValue() != null) {
        builder.field("null_value", fieldType().nullValue());
    }
    if (includeDefaults || positionIncrementGap != -1) {
        builder.field("position_increment_gap", positionIncrementGap);
    }
    NamedAnalyzer searchQuoteAnalyzer = fieldType().searchQuoteAnalyzer();
    if (searchQuoteAnalyzer != null && !searchQuoteAnalyzer.name().equals(fieldType().searchAnalyzer().name())) {
        builder.field("search_quote_analyzer", searchQuoteAnalyzer.name());
    } else if (includeDefaults) {
        if (searchQuoteAnalyzer == null) {
            builder.field("search_quote_analyzer", "default");
        } else {
            builder.field("search_quote_analyzer", searchQuoteAnalyzer.name());
        }
    }
    Map<String, Object> map = langdetectService.getSettings().getAsStructuredMap();
    for (Map.Entry<String, Object> entry : map.entrySet()) {
        builder.field(entry.getKey(), entry.getValue());
    }
    languageTo.toXContent(builder, params);
}
 
开发者ID:jprante,项目名称:elasticsearch-plugin-bundle,代码行数:26,代码来源:LangdetectMapper.java


示例18: testDefaultsIcuAnalysis

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Test
public void testDefaultsIcuAnalysis() throws IOException {

    CharFilterFactory charFilterFactory = charFilterFactory("icu_normalizer");
    assertThat(charFilterFactory, instanceOf(IcuNormalizerCharFilterFactory.class));

    TokenizerFactory tf = tokenizerFactory("icu_tokenizer");
    assertThat(tf, instanceOf(IcuTokenizerFactory.class));

    TokenFilterFactory filterFactory = tokenFilterFactory("icu_normalizer");
    assertThat(filterFactory, instanceOf(IcuNormalizerTokenFilterFactory.class));

    filterFactory = tokenFilterFactory("icu_folding");
    assertThat(filterFactory, instanceOf(IcuFoldingTokenFilterFactory.class));

    filterFactory = tokenFilterFactory("icu_transform");
    assertThat(filterFactory, instanceOf(IcuTransformTokenFilterFactory.class));

    Analyzer analyzer = MapperTestUtils.analyzer( "icu_collation");
    assertThat(analyzer, instanceOf(NamedAnalyzer.class));
}
 
开发者ID:jprante,项目名称:elasticsearch-plugin-bundle,代码行数:22,代码来源:IcuAnalysisTests.java


示例19: testStandardNumberAnalyzer

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
@Test
public void testStandardNumberAnalyzer() throws IOException {
    NamedAnalyzer namedAnalyzer = createAnalysisService().analyzer("standardnumber");
    String[] expected = new String[]{
            "Die",
            "ISBN",
            "von",
            "Elasticsearch",
            "in",
            "Action",
            "lautet",
            "9781617291623",
            "EAN 9781617291623",
            "GTIN 9781617291623",
            "978-1-61729-162-3"
    };
    assertSimpleTSOutput(namedAnalyzer.tokenStream("content", "Die ISBN von Elasticsearch in Action lautet 9781617291623"), expected);
}
 
开发者ID:jprante,项目名称:elasticsearch-analysis-standardnumber,代码行数:19,代码来源:StandardNumberAnalysisTests.java


示例20: testISBNWithEmbeddedZDB

import org.elasticsearch.index.analysis.NamedAnalyzer; //导入依赖的package包/类
/**
 * Avoid nested ZDB-ID in ISBN like this
 * 3826628225
 * 978-3-8266-2822-1
 * 9783826628221
 * ZDB 826-6
 * ZDB 8266
 * by boundary matching for ZDBID.
 *
 * @throws IOException
 */
@Test
public void testISBNWithEmbeddedZDB() throws IOException {
    NamedAnalyzer namedAnalyzer = createAnalysisService().analyzer("standardnumber");
    String[] expected = new String[]{
            "ISBN",
            "3-8266-2822-5",
            "GTIN 3826628225",
            "3826628225",
            "978-3-8266-2822-1",
            "9783826628221"

    };
    assertSimpleTSOutput(namedAnalyzer.tokenStream("content",
            "ISBN 3-8266-2822-5"), expected);
}
 
开发者ID:jprante,项目名称:elasticsearch-analysis-standardnumber,代码行数:27,代码来源:StandardNumberAnalysisTests.java



注:本文中的org.elasticsearch.index.analysis.NamedAnalyzer类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java AndroidNetworking类代码示例发布时间:2022-05-21
下一篇:
Java AxiomType类代码示例发布时间:2022-05-21
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap