Java Extractor类代码示例

OStack程序员社区-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中at.punkt.lodms.spi.extract.Extractor类的典型用法代码示例。如果您正苦于以下问题：Java Extractor类的具体用法？Java Extractor怎么用？Java Extractor使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

Extractor类属于at.punkt.lodms.spi.extract包，在下文中一共展示了Extractor类的19个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: testRunCompletedEventProperties

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testRunCompletedEventProperties() throws InterruptedException {
    MockApplicationEventPublisher eventPublisher = new MockApplicationEventPublisher();
    ETLPipelineImpl instance = new ETLPipelineImpl(id, eventPublisher, repository);

    Extractor delayingExtractor = new Extractor() {
        @Override
        public void extract(RDFHandler handler, ExtractContext context) throws ExtractException {
            try {
                Thread.sleep(10);
            } catch (InterruptedException ex) {
                throw new ExtractException(ex);
            }
        }
    };
    instance.setExtractors(Arrays.asList(delayingExtractor));

    instance.run();
    PipelineCompletedEvent completedEvent = eventPublisher.getPublishedEventsOfType(PipelineCompletedEvent.class).get(0);
    Assert.assertEquals(instance, completedEvent.getPipeline());
    Assert.assertNotNull(completedEvent.getId());
    Assert.assertTrue(completedEvent.getDuration() > 0);
}

开发者ID:lodms，项目名称:lodms-core，代码行数:24，代码来源:ETLPipelineImplTest.java

示例2: testRunExtractFailedEventFired

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testRunExtractFailedEventFired() {
    MockApplicationEventPublisher eventPublisher = new MockApplicationEventPublisher();
    ETLPipelineImpl instance = new ETLPipelineImpl(id, eventPublisher, repository);

    Extractor extractor = new MockExtractor() {
        @Override
        public void extract(RDFHandler handler, ExtractContext context) throws ExtractException {
            throw new ExtractException("Test");
        }
    };
    instance.setExtractors(Arrays.asList(extractor));
    instance.run();

    ExtractFailedEvent failedEvent = eventPublisher.getPublishedEventsOfType(ExtractFailedEvent.class).get(0);
    Assert.assertEquals(extractor, failedEvent.getExtractor());
    Assert.assertNotNull(failedEvent.getException());
}

开发者ID:lodms，项目名称:lodms-core，代码行数:19，代码来源:ETLPipelineImplTest.java

示例3: testRunExtractorAbortedEventFired

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testRunExtractorAbortedEventFired() {
    MockApplicationEventPublisher eventPublisher = new MockApplicationEventPublisher();
    ETLPipelineImpl instance = new ETLPipelineImpl(id, eventPublisher, repository);

    Extractor extractor = new MockExtractor() {
        @Override
        public void extract(RDFHandler handler, ExtractContext context) throws ExtractException {
            context.cancelPipeline("Test");
        }
    };
    instance.setExtractors(Arrays.asList(extractor));
    instance.run();

    PipelineAbortedEvent abortedEvent = eventPublisher.getPublishedEventsOfType(PipelineAbortedEvent.class).get(0);
    Assert.assertEquals(instance, abortedEvent.getPipeline());
    Assert.assertEquals("Test", abortedEvent.getMessage());
}

开发者ID:lodms，项目名称:lodms-core，代码行数:19，代码来源:ETLPipelineImplTest.java

示例4: testRunExtractorSkippedAfterAbortedEvent

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testRunExtractorSkippedAfterAbortedEvent() {
    MockApplicationEventPublisher eventPublisher = new MockApplicationEventPublisher();
    ETLPipelineImpl instance = new ETLPipelineImpl(id, eventPublisher, repository);

    Extractor extractor = new MockExtractor() {
        @Override
        public void extract(RDFHandler handler, ExtractContext context) throws ExtractException {
            context.cancelPipeline("Test");
        }
    };
    MockExtractor skippedExtractor = new MockExtractor();
    instance.setExtractors(Arrays.asList(extractor, skippedExtractor));
    instance.run();

    Assert.assertEquals(false, skippedExtractor.executed);
}

开发者ID:lodms，项目名称:lodms-core，代码行数:18，代码来源:ETLPipelineImplTest.java

示例5: init

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
public void init() {
    TabSheet tabsheet = new TabSheet();
    tabsheet.setWidth("100%");

    selectedExtractors = new BeanItemContainer<Extractor>(Extractor.class, job.getPipeline().getExtractors());
    selectedTransformers = new BeanItemContainer<Transformer>(Transformer.class, job.getPipeline().getTransformers());
    selectedLoaders = new BeanItemContainer<Loader>(Loader.class, job.getPipeline().getLoaders());
    initGenericDialog(Extractor.class, extractorDialog, provider.getAvailableExtractors(), job.getPipeline().getExtractors(), selectedExtractors);
    initGenericDialog(Loader.class, loaderDialog, provider.getAvailableLoaders(), job.getPipeline().getLoaders(), selectedLoaders);
    initGenericDialog(Transformer.class, transformerDialog, provider.getAvailableTransformers(), job.getPipeline().getTransformers(), selectedTransformers);

    initJobDialog(job);
    addComponent(jobDialog);
    tabsheet.addTab(extractorDialog, "Extractors", null, 0);
    tabsheet.addTab(transformerDialog, "Transformers", null, 1);
    tabsheet.addTab(loaderDialog, "Loaders", null, 2);
    tabsheet.setSizeFull();
    addComponent(tabsheet);
    setExpandRatio(tabsheet, 0.75f);
    setSizeFull();
}

开发者ID:lodms，项目名称:lodms-core，代码行数:22，代码来源:JobWizardBase.java

示例6: runExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
private void runExtractors(String runId, URI namedGraph, Map<String, Object> customData) throws RepositoryException, RDFHandlerException {
    RepositoryConnection con = repository.getConnection();
    con.setAutoCommit(false);
    RDFInserter inserter = new RDFInserter(con);
    inserter.enforceContext(namedGraph);
    NoStartEndWrapper wrapper = new NoStartEndWrapper(inserter);
    try {
        for (Extractor extractor : extractors) {
            if (extractor instanceof Disableable && ((Disableable) extractor).isDisabled()) {
                continue;
            }
            ExtractContext context = new ExtractContext(runId, customData);
            context.setPipeline(this);
            TripleCountingWrapper tripleCounter = new TripleCountingWrapper(wrapper);
            try {
                long start = System.currentTimeMillis();
                extractor.extract(tripleCounter, context);
                con.commit();
                context.setDuration(System.currentTimeMillis() - start);
                context.setTriplesExtracted(tripleCounter.getTriples());
                eventPublisher.publishEvent(new ExtractCompletedEvent(extractor, context, this));
            } catch (ExtractException ex) {
                con.rollback();
                eventPublisher.publishEvent(new ExtractFailedEvent(ex, extractor, context, this));
            }
            if (cancelAllowed && context.isCancelPipeline()) {
                eventPublisher.publishEvent(new PipelineAbortedEvent(context.getCancelMessage(), this, runId, extractor));
                return;
            }
        }
        inserter.endRDF();
    } finally {
        con.commit();
        con.close();
    }
}

开发者ID:lodms，项目名称:lodms-core，代码行数:37，代码来源:ETLPipelineImpl.java

示例7: testSetAndGetExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testSetAndGetExtractors() {
    List<Extractor> extractors = new ArrayList<Extractor>();
    extractors.add(new MockExtractor());
    ETLPipelineImpl instance = new ETLPipelineImpl();
    instance.setExtractors(extractors);

    assertEquals(extractors, instance.getExtractors());
}

开发者ID:lodms，项目名称:lodms-core，代码行数:10，代码来源:ETLPipelineImplTest.java

示例8: testRunExecuteExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testRunExecuteExtractors() {
    ETLPipelineImpl instance = new ETLPipelineImpl(id, new MockApplicationEventPublisher(), repository);

    instance.setExtractors(getMockExtractors(2));
    instance.run();
    for (Extractor extractor : instance.getExtractors()) {
        assertTrue(((MockExtractor) extractor).executed);
    }
}

开发者ID:lodms，项目名称:lodms-core，代码行数:11，代码来源:ETLPipelineImplTest.java

示例9: testRunExtractCompletedEventFired

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Test
public void testRunExtractCompletedEventFired() {
    MockApplicationEventPublisher eventPublisher = new MockApplicationEventPublisher();
    ETLPipelineImpl instance = new ETLPipelineImpl(id, eventPublisher, repository);

    Extractor extractor = new MockExtractor();
    instance.setExtractors(Arrays.asList(extractor));
    instance.run();

    ExtractCompletedEvent completedEvent = eventPublisher.getPublishedEventsOfType(ExtractCompletedEvent.class).get(0);
    Assert.assertEquals(extractor, completedEvent.getExtractor());
}

开发者ID:lodms，项目名称:lodms-core，代码行数:13，代码来源:ETLPipelineImplTest.java

示例10: getMockExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
private List<Extractor> getMockExtractors(int i) {
    List<Extractor> extractors = new ArrayList<Extractor>(i);
    for (int j = 0; j < i; j++) {
        extractors.add(new MockExtractor());
    }
    return extractors;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:8，代码来源:ETLPipelineImplTest.java

示例11: getExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Override
public List<Extractor> getExtractors() {
    return extractors;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:5，代码来源:ETLPipelineImpl.java

示例12: setExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
@Override
public void setExtractors(List<Extractor> extractors) {
    this.extractors = extractors;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:5，代码来源:ETLPipelineImpl.java

示例13: getExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
public List<ComponentBlueprint<Extractor>> getExtractors() {
  return extractors;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:4，代码来源:ETLJobBlueprint.java

示例14: setExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
public void setExtractors(List<ComponentBlueprint<Extractor>> extractors) {
  this.extractors = extractors;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:4，代码来源:ETLJobBlueprint.java

示例15: getExtractor

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
public Extractor getExtractor() {
    return extractor;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:4，代码来源:ExtractExecution.java

示例16: setExtractor

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
public void setExtractor(Extractor extractor) {
    this.extractor = extractor;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:4，代码来源:ExtractExecution.java

示例17: getAvailableExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
public List<Extractor> getAvailableExtractors() {
    return extractors;
}

开发者ID:lodms，项目名称:lodms-core，代码行数:4，代码来源:ServiceListProvider.java

示例18: getExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
/**
 * Returns the list of extractors defined for this pipeline
 *
 * @return
 */
public List<Extractor> getExtractors();

开发者ID:lodms，项目名称:lodms-core，代码行数:7，代码来源:ETLPipeline.java

示例19: setExtractors

import at.punkt.lodms.spi.extract.Extractor; //导入依赖的package包/类
/**
 * Sets the list of extractors defined for this pipeline
 *
 * @param extractors
 */
public void setExtractors(List<Extractor> extractors);

开发者ID:lodms，项目名称:lodms-core，代码行数:7，代码来源:ETLPipeline.java

注：本文中的at.punkt.lodms.spi.extract.Extractor类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。