Java TestWordSpout类代码示例

OStack程序员社区-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中backtype.storm.testing.TestWordSpout类的典型用法代码示例。如果您正苦于以下问题：Java TestWordSpout类的具体用法？Java TestWordSpout怎么用？Java TestWordSpout使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

TestWordSpout类属于backtype.storm.testing包，在下文中一共展示了TestWordSpout类的16个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: main

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void main(String[] args) throws Exception {
  TopologyBuilder builder = new TopologyBuilder();

  builder.setSpout("word", new TestWordSpout(), 10);
  builder.setBolt("exclaim1", new ExclamationBolt(), 3).shuffleGrouping("word");
  builder.setBolt("exclaim2", new ExclamationBolt(), 2).shuffleGrouping("exclaim1");

  Config conf = new Config();
  conf.setDebug(true);

  if (args != null && args.length > 0) {
    conf.setNumWorkers(3);

    StormSubmitter.submitTopologyWithProgressBar(args[0], conf, builder.createTopology());
  }
  else {

    LocalCluster cluster = new LocalCluster();
    cluster.submitTopology("test", conf, builder.createTopology());
    Utils.sleep(10000);
    cluster.killTopology("test");
    cluster.shutdown();
  }
}

开发者ID:luozhaoyu，项目名称:big-data-system，代码行数:25，代码来源:ExclamationTopology.java

示例2: run

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
void run(String[] args) {
TopologyBuilder builder = new TopologyBuilder();

builder.setSpout("word_spout", new TestWordSpout(), 2);
builder.setBolt("tuple_double", new Function(new Double(), new Fields("word1", "word2")), 2).shuffleGrouping("word_spout");
	
Map conf = new HashMap();
conf.put(Config.TOPOLOGY_WORKERS, 4);
conf.put(Config.TOPOLOGY_DEBUG, true);
	
if(args.length==0) {
           LocalCluster cluster = new LocalCluster();
           cluster.submitTopology("MockIngest", conf, builder.createTopology());
       } else {
    try {
	StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    } catch(Exception e) {
	e.printStackTrace();
    }
}
   }

开发者ID:brennonyork，项目名称:storm-lib，代码行数:22，代码来源:FunctionTopology.java

示例3: run

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
void run(String[] args) {
TopologyBuilder builder = new TopologyBuilder();

KVSchema names = new KVSchema("names", "word");
names.colFam.addStatic("NAME");
names.colQual.add("word").addStatic("\u0000").add("word");

builder.setSpout("word_spout", new TestWordSpout(), 2);
builder.setBolt("mutate", new BatchMutation(names, true), 2).shuffleGrouping("word_spout");
	
Map conf = new HashMap();
conf.put(Config.TOPOLOGY_WORKERS, 4);
conf.put(Config.TOPOLOGY_DEBUG, true);
	
if(args.length==0) {
           LocalCluster cluster = new LocalCluster();
           cluster.submitTopology("MockIngest", conf, builder.createTopology());
       } else {
    try {
	StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    } catch(Exception e) {
	e.printStackTrace();
    }
}
   }

开发者ID:brennonyork，项目名称:storm-lib，代码行数:26，代码来源:BatchMutationTopology.java

示例4: main

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void main(String[] args) throws Exception {
    TopologyBuilder builder = new TopologyBuilder();

    builder.setSpout("word", new TestWordSpout(), 10);
    builder.setBolt("exclaim1", new ExclamationBolt(), 3).shuffleGrouping("word");
    builder.setBolt("exclaim2", new ExclamationBolt(), 2).shuffleGrouping("exclaim1");

    Config conf = new Config();
    conf.setDebug(true);

    if (args != null && args.length > 0) {
        conf.setNumWorkers(3);

        StormSubmitter.submitTopologyWithProgressBar(args[0], conf, builder.createTopology());
    }
    else {

        LocalCluster cluster = new LocalCluster();
        cluster.submitTopology("www_nginx_accesslog_stat", conf, builder.createTopology());
        Utils.sleep(10000);
        cluster.killTopology("www_nginx_accesslog_stat");
        cluster.shutdown();
    }
}

开发者ID:coodoing，项目名称:LogRTA，代码行数:25，代码来源:ExclamationTopology.java

示例5: main

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void main(String[] args) throws Exception {
  TopologyBuilder builder = new TopologyBuilder();

  builder.setSpout("word", new TestWordSpout(), 10);
  builder.setBolt("exclaim1", new ExclamationBolt(), 3).shuffleGrouping("word");
  builder.setBolt("exclaim2", new ExclamationBolt(), 2).shuffleGrouping("exclaim1");

  Config conf = new Config();
  conf.setDebug(true);

  if (args != null && args.length > 0) {
    conf.setNumWorkers(3);

    StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
  }
  else {

    LocalCluster cluster = new LocalCluster();
    cluster.submitTopology("test", conf, builder.createTopology());
    Utils.sleep(10000);
    cluster.killTopology("test");
    cluster.shutdown();
  }
}

开发者ID:metamx，项目名称:incubator-storm，代码行数:25，代码来源:ExclamationTopology.java

示例6: main

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void main(String[] args) throws Exception {
    TopologyBuilder builder = new TopologyBuilder();
    
    builder.setSpout("word", new TestWordSpout(), 10);        
    builder.setBolt("exclaim1", new ExclamationBolt(), 3)
            .shuffleGrouping("word");
    builder.setBolt("exclaim2", new ExclamationBolt(), 2)
            .shuffleGrouping("exclaim1");
            
    Config conf = new Config();
    conf.setDebug(true);
    
    if(args!=null && args.length > 0) {
        conf.setNumWorkers(3);
        
        StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    } else {
    
        LocalCluster cluster = new LocalCluster();
        cluster.submitTopology("test", conf, builder.createTopology());
        Utils.sleep(10000);
        cluster.killTopology("test");
        cluster.shutdown();    
    }
}

开发者ID:adarshms，项目名称:sentweet，代码行数:26，代码来源:ExclamationTopology.java

示例7: main

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void main(String[] args) throws Exception {
    TopologyBuilder builder = new TopologyBuilder();
    
    builder.setSpout("word", new TestWordSpout(), 10);        
    builder.setBolt("exclaim1", new ExclamationBolt(), 3)
            .shuffleGrouping("word");
    builder.setBolt("exclaim2", new ExclamationBolt(), 2)
            .shuffleGrouping("exclaim1");
            
    Config conf = new Config();
    conf.setDebug(true);
    
    if(args!=null && args.length > 0) {
        conf.setNumWorkers(3);
        
        StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    } else {
    
        LocalCluster cluster = new LocalCluster();
        cluster.submitTopology("test", conf, builder.createTopology());
        Utils.sleep(100000);
        cluster.killTopology("test");
        cluster.shutdown();    
    }
}

开发者ID:YinYanfei，项目名称:CadalWorkspace，代码行数:26，代码来源:ExclamationTopology.java

示例8: wireTopology

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
private void wireTopology() throws InterruptedException {
  String spoutId = "wordGenerator";
  String counterId = "counter";
  String intermediateRankerId = "intermediateRanker";
  String totalRankerId = "finalRanker";
  builder.setSpout(spoutId, new TestWordSpout(), 5);
  builder.setBolt(counterId, new RollingCountBolt(9, 3), 4).fieldsGrouping(spoutId, new Fields("word"));
  builder.setBolt(intermediateRankerId, new IntermediateRankingsBolt(TOP_N), 4).fieldsGrouping(counterId, new Fields(
      "obj"));
  builder.setBolt(totalRankerId, new TotalRankingsBolt(TOP_N)).globalGrouping(intermediateRankerId);
}

开发者ID:luozhaoyu，项目名称:big-data-system，代码行数:12，代码来源:RollingTopWords.java

示例9: run

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
void run(String[] args) {
TopologyBuilder builder = new TopologyBuilder();

KVSchema names = new KVSchema("names", "word");
names.colFam.addStatic("NAME");
names.colQual.add("word").addStatic("\u0000").add("word");

KVSchema people = new KVSchema("people", "word");
people.colFam.addStatic("PEOPLE");
people.colQual.add("word").addStatic("\u0000").add("word");

builder.setSpout("word_spout", new TestWordSpout(), 2);
builder.setBolt("mutate", new BulkMutation(names), 2).shuffleGrouping("word_spout");
builder.setBolt("mutateII", new BulkMutation(people), 3).shuffleGrouping("word_spout");
builder.setBolt("ingest", new BulkIngest("/tmp/ingest"), 2)
    .shuffleGrouping("mutate")
    .shuffleGrouping("mutateII");

Map conf = new HashMap();
conf.put(Config.TOPOLOGY_WORKERS, 4);
conf.put(Config.TOPOLOGY_DEBUG, true);
conf.put("bulk.output.path", "/tmp/rf");
conf.put("bulk.write.timeout", 10);
conf.put("bulk.max.records", 1000);
conf.put("zookeeper.servers", "localhost");
conf.put("zookeeper.instance.name", "dev_instance");
conf.put("accumulo.user", "root");
conf.put("accumulo.passwd", "dev_instance");
	
if(args.length==0) {
           LocalCluster cluster = new LocalCluster();
           cluster.submitTopology("MockIngest", conf, builder.createTopology());
       } else {
    try {
	StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    } catch(Exception e) {
	e.printStackTrace();
    }
}
   }

开发者ID:brennonyork，项目名称:storm-lib，代码行数:41，代码来源:BulkIngestTopology.java

示例10: run

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
void run(String[] args) {
TopologyBuilder builder = new TopologyBuilder();

KVSchema names = new KVSchema("names", "word");
names.colFam.addStatic("NAME");
names.colQual.add("word").addStatic("\u0000").add("word");

builder.setSpout("word_spout", new TestWordSpout(), 2);
builder.setBolt("mutate", new BulkMutation(names), 2).shuffleGrouping("word_spout");
	
Map conf = new HashMap();
conf.put(Config.TOPOLOGY_WORKERS, 4);
conf.put(Config.TOPOLOGY_DEBUG, true);
conf.put("bulk.output.path", "/tmp/rf");
conf.put("bulk.write.timeout", 10);
conf.put("bulk.max.records", 1000);
	
if(args.length==0) {
           LocalCluster cluster = new LocalCluster();
           cluster.submitTopology("MockIngest", conf, builder.createTopology());
       } else {
    try {
	StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    } catch(Exception e) {
	e.printStackTrace();
    }
}
   }

开发者ID:brennonyork，项目名称:storm-lib，代码行数:29，代码来源:BulkMutationTopology.java

示例11: wireTopology

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
private void wireTopology() throws InterruptedException {
    String spoutId = "wordGenerator";
    String counterId = "counter";
    String intermediateRankerId = "intermediateRanker";
    String totalRankerId = "finalRanker";
    builder.setSpout(spoutId, new TestWordSpout(), 5);
    builder.setBolt(counterId, new RollingCountBolt(9, 3), 4).fieldsGrouping(spoutId, new Fields("word"));
    builder.setBolt(intermediateRankerId, new IntermediateRankingsBolt(TOP_N), 4).fieldsGrouping(counterId,
        new Fields("obj"));
    builder.setBolt(totalRankerId, new TotalRankingsBolt(TOP_N)).globalGrouping(intermediateRankerId);
}

开发者ID:adarshms，项目名称:sentweet，代码行数:12，代码来源:RollingTopWords.java

示例12: test

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void test() throws Exception {
    JStormHelper.cleanCluster();
    hosts = JStormHelper.getSupervisorHosts();
    
    TopologyBuilder builder = new TopologyBuilder();
    
    builder.setSpout("word", new TestWordSpout(), 1);
    /*********
     * 
     * This make sure the tasks will run on different nodes
     * 
     * 
     * 
     */
    Map<String, Object> componentMap = new HashMap<>();
    ConfigExtension.setTaskOnDifferentNode(componentMap, true);
    builder.setBolt(BOLT_NAME, new ExclamationLoggingBolt(), hosts.size()).localFirstGrouping("word")
            .addConfigurations(componentMap);
            
    if (isLocal == false) {
        
        if (spoutSingle == true) {
            conf.setNumWorkers(hosts.size() + 3);
        } else {
            conf.setNumWorkers(hosts.size());
        }
        
    }
    
    String[] className = Thread.currentThread().getStackTrace()[1].getClassName().split("\\.");
    String topologyName = className[className.length - 1];
    try {
        JStormHelper.runTopology(builder.createTopology(), topologyName, conf, 180,
                new Validator(conf), isLocal);
    } catch (Exception e) {
        // TODO Auto-generated catch block
        e.printStackTrace();
        Assert.fail("Failed");
    }
}

开发者ID:alibaba，项目名称:jstorm，代码行数:41，代码来源:TaskInDifferentNodeTopology.java

示例13: test

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void test() {
    TopologyBuilder builder = new TopologyBuilder();
    
    builder.setSpout("word", new TestWordSpout(), 10);
    builder.setBolt("exclaim1", new ExclamationLoggingBolt(), 3).noneGrouping("word");
    builder.setBolt("exclaim2", new ExclamationLoggingBolt(), 2).shuffleGrouping("exclaim1");
    
    String hostname = NetWorkUtils.hostname();
    List<String> hosts = new ArrayList<String>();
    hosts.add(hostname);
    
    /*********
     * 
     * This make sure all worker run on the user-defined hosts
     * 
     * 
     * 
     */
    conf.put(Config.ISOLATION_SCHEDULER_MACHINES, hosts);
    
    String[] className = Thread.currentThread().getStackTrace()[1].getClassName().split("\\.");
    String topologyName = className[className.length - 1];
    try {
        JStormHelper.runTopology(builder.createTopology(), topologyName, conf, 60,
                new Validator(conf), isLocal);
    } catch (Exception e) {
        // TODO Auto-generated catch block
        e.printStackTrace();
        Assert.fail("Failed");
    }
}

开发者ID:alibaba，项目名称:jstorm，代码行数:32，代码来源:UserDefinedHostsTopology.java

示例14: wireTopology

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
private void wireTopology() throws InterruptedException {
    String spoutId = "wordGenerator";
    String counterId = "counter";
    String intermediateRankerId = "intermediateRanker";
    String totalRankerId = "finalRanker";
    builder.setSpout(spoutId, new TestWordSpout(), 5);
    builder.setBolt(counterId, new RollingCountBolt(9, 3), 4).fieldsGrouping(spoutId, new Fields("word"));
    builder.setBolt(intermediateRankerId, new IntermediateRankingsBolt(TOP_N), 4).fieldsGrouping(counterId,
            new Fields("obj"));
    builder.setBolt(totalRankerId, new TotalRankingsBolt(TOP_N)).globalGrouping(intermediateRankerId);
}

开发者ID:alibaba，项目名称:jstorm，代码行数:12，代码来源:RollingTopWords.java

示例15: wireTopology

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
private void wireTopology() throws InterruptedException {
    String spoutId = "wordGenerator";
    String counterId = "counter";
    String aggId = "aggregator";
    String intermediateRankerId = "intermediateRanker";
    String totalRankerId = "finalRanker";
    builder.setSpout(spoutId, new TestWordSpout(), 5);
    builder.setBolt(counterId, new RollingCountBolt(9, 3), 4).partialKeyGrouping(spoutId, new Fields("word"));
    builder.setBolt(aggId, new RollingCountAggBolt(), 4).fieldsGrouping(counterId, new Fields("obj"));
    builder.setBolt(intermediateRankerId, new IntermediateRankingsBolt(TOP_N), 4).fieldsGrouping(aggId,
            new Fields("obj"));
    builder.setBolt(totalRankerId, new TotalRankingsBolt(TOP_N)).globalGrouping(intermediateRankerId);
}

开发者ID:alibaba，项目名称:jstorm，代码行数:14，代码来源:SkewedRollingTopWords.java

示例16: main

import backtype.storm.testing.TestWordSpout; //导入依赖的package包/类
public static void main(String[] args) throws Exception {
    
    final int TOP_N = 3;
    
    TopologyBuilder builder = new TopologyBuilder();
    
    builder.setSpout("word", new TestWordSpout(), 5);
    
    builder.setBolt("count", new RollingCountObjects(60, 10), 4)
             .fieldsGrouping("word", new Fields("word"));
    builder.setBolt("rank", new RankObjects(TOP_N), 4)
             .fieldsGrouping("count", new Fields("obj"));
    builder.setBolt("merge", new MergeObjects(TOP_N))
             .globalGrouping("rank");
    
    
    
    Config conf = new Config();
    conf.setDebug(true);
    
    LocalCluster cluster = new LocalCluster();
    cluster.submitTopology("rolling-demo", conf, builder.createTopology());
    Thread.sleep(10000);
    
    cluster.shutdown();
    
}

开发者ID:YinYanfei，项目名称:CadalWorkspace，代码行数:28，代码来源:RollingTopWords.java

注：本文中的backtype.storm.testing.TestWordSpout类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花

握手

雷人

路过

鸡蛋

该文章已有0人参与评论

请发表评论

全部评论

专题导读

More+

10-27 六六分期app的软件客服如何联系？(六六分期

11-06 可心卡盟:win10系统火狐flash插件崩溃怎么

11-06 亲亲特价:怎么删除回收站图标

11-06 济南大学虚拟社区:鲁大师节能降温的具体办

11-06 xlueops.exe:无线网络安装向导

11-06 女斗合众国:win7系统cf与主机连接不稳定怎

11-06 0xc000022-[cf烟雾头]cf怎么调烟雾头

11-06 qizideyouhuo:应用程序无法正常启动0xc0000

11-06 ipz-185:win7系统vcf文件怎么打开

11-06 傻哥蹦迪:win10系统s4怎么打开usb调试

11-06 八神浩树gtaste:回收站清空了怎么恢复

11-06 妖尾之黑色守护:win10系统电脑没有1440x900

11-06 校园至尊魔王小说:win7系统浏览网页时字体

11-06 女斗合众国:win10系统访问共享文件夹提示请

11-06 tokyo hot n0654:恢复win7系统默认字体一招

11-06 雨酷仙境:设置win7系统转移临时文件夹腾出

11-06 阿穆纳伊之杖:win7系统开始菜单在右边还原

11-06 tunespotting:win10系统火狐flash插件总是

11-06 甘尔葛分析师：计谋网站seo关键词暴涨有什

11-06 蔡贵霖: 计谋网站seo关键词暴涨有什么秘密

11-06 博益网首页:ao3网页版进入不了解决方法

11-06 漏斗子专栏: 网站数据分析小白易懂精华篇

11-06 见证双虹怎么做:win7系统开启telnet命令的

11-06 颾狐蝶蜋:系统资源不足无法完成请求的服务

11-06 国光中学校歌:提交网站到alexa查询详细步骤

11-06 西安有情天:静态网页和动态网页的区别

11-06 红木雅尚斋:外部链接构造对网站的好处

11-06 前官礼遇：防止域名劫持–增强域安全性的10

11-06 密传二转答案: 中文分词算法有哪些

11-06 金泉家园邮编:百度快照劫持的表现及应对方

Java BuiltinDatatypeLibraryFactory类代码示例发布时间：2022-05-23

Java PortAddressResolver类代码示例发布时间：2022-05-23

剪的笔顺,诠释剪的笔画,认识剪的部首

1 六六分期app的软件客服如何联系？(六六分期

六六分期app的软件客服如何联系？不知道吗？加qq群【895510560】即可！标题：六六分期

阅读：18833|2023-10-27

2 可心卡盟:win10系统火狐flash插件崩溃怎么

今天小编告诉大家如何处理win10系统火狐flash插件总是崩溃的问题，可能很多用户都不知

阅读：9878|2022-11-06

3 亲亲特价:怎么删除回收站图标

今天小编告诉大家如何对win10系统删除桌面回收站图标进行设置，可能很多用户都不知道

阅读：8285|2022-11-06

4 济南大学虚拟社区:鲁大师节能降温的具体办

今天小编告诉大家如何对win10系统电脑设置节能降温的设置方法，想必大家都遇到过需要

阅读：8641|2022-11-06

5 xlueops.exe:无线网络安装向导

我们在使用xp系统的过程中,经常需要对xp系统无线网络安装向导设置进行设置，可能很多

阅读：8572|2022-11-06

6 女斗合众国:win7系统cf与主机连接不稳定怎

今天小编告诉大家如何处理win7系统玩cf老是与主机连接不稳定的问题，可能很多用户都不

阅读：9577|2022-11-06

7 0xc000022-[cf烟雾头]cf怎么调烟雾头

电脑对日常生活的重要性小编就不多说了，可是一旦碰到win7系统设置cf烟雾头的问题，很

阅读：8569|2022-11-06

8 qizideyouhuo:应用程序无法正常启动0xc0000

我们在日常使用电脑的时候，有的小伙伴们可能在打开应用的时候会遇见提示应用程序无法

阅读：7959|2022-11-06

9 ipz-185:win7系统vcf文件怎么打开

今天小编告诉大家如何对win7系统打开vcf文件进行设置，可能很多用户都不知道怎么对win

阅读：8573|2022-11-06

10 傻哥蹦迪:win10系统s4怎么打开usb调试

今天小编告诉大家如何对win10系统s4开启USB调试模式进行设置，可能很多用户都不知道怎

阅读：7497|2022-11-06

客服电话

电子邮件

Java TestWordSpout类代码示例

示例1: main

示例2: run

示例3: run

示例4: main

示例5: main

示例6: main

示例7: main

示例8: wireTopology

示例9: run

示例10: run

示例11: wireTopology

示例12: test

示例13: test

示例14: wireTopology

示例15: wireTopology

示例16: main

请发表评论

全部评论

上一篇：

下一篇：

GitbookIO/gitbook:

juleswhite/mobile-cloud-asgn1

kyamagu/matlab-json: Use official API: h

墙壁眼睛膝盖

CVE-2022-34902

剪的笔顺,诠释剪的笔画,认识剪的部首

六六分期app的软件客服如何联系？(六六分期

florent37/ViewAnimator: A fluent Android

florent37/Shrine-MaterialDesign2: implem

CVE-2020-36276

SimpleSoftwareIO/simple-sms: Send and re

关于我们

产品与服务

解决方案

139-2527-9053