• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java TridentTuple类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.storm.trident.tuple.TridentTuple的典型用法代码示例。如果您正苦于以下问题:Java TridentTuple类的具体用法?Java TridentTuple怎么用?Java TridentTuple使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



TridentTuple类属于org.apache.storm.trident.tuple包,在下文中一共展示了TridentTuple类的20个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: buildTopology

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public static StormTopology buildTopology(WindowsStoreFactory windowStore, WindowConfig windowConfig) throws Exception {
    TridentKafkaConfig config = new TridentKafkaConfig(new ZkHosts("localhost:2181"), "test");
    config.scheme = new SchemeAsMultiScheme(new StringScheme());
    config.startOffsetTime = kafka.api.OffsetRequest.LatestTime();
    TransactionalTridentKafkaSpout spout = new TransactionalTridentKafkaSpout(config);
    TridentTopology topology = new TridentTopology();

    Stream stream = topology.newStream("spout1", spout).each(new Fields("str"),
            new Split(), new Fields("word"))
            .window(windowConfig, windowStore, new Fields("word"), new CountAsAggregator(), new Fields("count"))
            .peek(new Consumer() {
                @Override
                public void accept(TridentTuple tuple) {
		System.out.print("[");
		for (int index = 0; index < tuple.size(); index++) {
			System.out.print(tuple.get(index));
			if (index < (tuple.size() - 1))
				System.out.print(",");
		}
		System.out.println("]");
	}
            });

    return topology.build();
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:26,代码来源:TridentWindowingInmemoryStoreTopology.java


示例2: buildTopology

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public static StormTopology buildTopology(WindowsStoreFactory windowStore, WindowConfig windowConfig) throws Exception {
    FixedBatchSpout spout = new FixedBatchSpout(new Fields("sentence"), 3, new Values("the cow jumped over the moon"),
            new Values("the man went to the store and bought some candy"), new Values("four score and seven years ago"),
            new Values("how many apples can you eat"), new Values("to be or not to be the person"));
    spout.setCycle(true);

    TridentTopology topology = new TridentTopology();

    Stream stream = topology.newStream("spout1", spout).parallelismHint(16).each(new Fields("sentence"),
            new Split(), new Fields("word"))
            .window(windowConfig, windowStore, new Fields("word"), new CountAsAggregator(), new Fields("count"))
            .peek(new Consumer() {
                @Override
                public void accept(TridentTuple input) {
                    LOG.info("Received tuple: [{}]", input);
                }
            });

    return topology.build();
}
 
开发者ID:ziyunhx,项目名称:storm-net-adapter,代码行数:21,代码来源:TridentWindowingInmemoryStoreTopology.java


示例3: buildTopology

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public static StormTopology buildTopology(WindowsStoreFactory windowsStore) throws Exception {
    FixedBatchSpout spout = new FixedBatchSpout(new Fields("sentence"), 3, new Values("the cow jumped over the moon"),
            new Values("the man went to the store and bought some candy"), new Values("four score and seven years ago"),
            new Values("how many apples can you eat"), new Values("to be or not to be the person"));
    spout.setCycle(true);

    TridentTopology topology = new TridentTopology();

    Stream stream = topology.newStream("spout1", spout).parallelismHint(16).each(new Fields("sentence"),
            new Split(), new Fields("word"))
            .window(TumblingCountWindow.of(1000), windowsStore, new Fields("word"), new CountAsAggregator(), new Fields("count"))
            .peek(new Consumer() {
                @Override
                public void accept(TridentTuple input) {
                    LOG.info("Received tuple: [{}]", input);
                }
            });

    return topology.build();
}
 
开发者ID:ziyunhx,项目名称:storm-net-adapter,代码行数:21,代码来源:TridentHBaseWindowingStoreTopology.java


示例4: main

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public static void main(String args[]) {
	FixedBatchSpout spout = new FixedBatchSpout(new Fields("a", "b"), 3,
			new Values(1, 2), new Values(3, 4),
			new Values(7, 3));
	spout.setCycle(false);

	TridentTopology topology = new TridentTopology();
	topology.newStream("spout1", spout)
			.each(new Fields("a", "b"), new PerformDiffFunction(),
					new Fields("d")).peek(new Consumer() {
				@Override
				public void accept(TridentTuple tuple) {
					System.out.print("[");
					for (int index = 0; index < tuple.size(); index++) {
						System.out.print(tuple.get(index));
						if (index < (tuple.size() - 1))
							System.out.print(",");
					}
					System.out.println("]");
				}
			});

	Config config = new Config();
	config.setNumWorkers(3);
	LocalCluster cluster = new LocalCluster();
	cluster.submitTopology("storm-trident-example", config,
			topology.build());
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:29,代码来源:TridentOperations.java


示例5: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {

	int number1 = tuple.getInteger(0);
	int number2 = tuple.getInteger(1);

	if (number2 > number1) {
		collector.emit(new Values(number2 - number1));
	}
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:11,代码来源:TridentOperations.java


示例6: main

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public static void main(String args[]) {
	FixedBatchSpout spout = new FixedBatchSpout(new Fields("sentence"), 3,
			new Values("this is simple example of trident topology"),
			new Values("this example count same words"));
	spout.setCycle(false);

	TridentTopology topology = new TridentTopology();
	topology.newStream("spout1", spout).flatMap(new SplitMapFunction())
			.map(new UpperCase()).peek(new Consumer() {
				@Override
				public void accept(TridentTuple tuple) {
					System.out.print("[");
					for (int index = 0; index < tuple.size(); index++) {
						System.out.print(tuple.get(index));
						if (index < (tuple.size() - 1))
							System.out.print(",");
					}
					System.out.println("]");
				}
			});

	Config config = new Config();
	config.setNumWorkers(3);
	LocalCluster cluster = new LocalCluster();
	cluster.submitTopology("storm-trident-example", config,
			topology.build());
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:28,代码来源:TridentOperationsMap.java


示例7: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public Iterable<Values> execute(TridentTuple input) {
	List<Values> valuesList = new ArrayList<>();
	for (String word : input.getString(0).split(" ")) {
		valuesList.add(new Values(word));
	}
	return valuesList;
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:9,代码来源:TridentOperationsMap.java


示例8: isKeep

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public boolean isKeep(TridentTuple tuple) {
	System.out.print("[");
	for (int index = 0 ; index < tuple.size(); index ++){
		System.out.print(tuple.get(index));
		if(index < (tuple.size()-1))
		System.out.print(",");
	}
	System.out.println("]");
	return true;
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:12,代码来源:DisplayOutputFilter.java


示例9: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {
	String event = tuple.getString(0);
	System.out.println(event);
	String[] splittedEvent = event.split(",");
	if(splittedEvent.length>1){
		long phoneNumber = Long.parseLong(splittedEvent[0]);
		int bin = Integer.parseInt(splittedEvent[1]);
		int bout = Integer.parseInt(splittedEvent[2]);
		
		int totalBytesTransferred = bin + bout;
		System.out.println(phoneNumber+":"+bin+":"+bout);
		collector.emit(new Values(phoneNumber, totalBytesTransferred));
	}
}
 
开发者ID:PacktPublishing,项目名称:Practical-Real-time-Processing-and-Analytics,代码行数:16,代码来源:TridentDIY.java


示例10: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public void execute(TridentTuple tuple, TridentCollector collector) {
	String countries = tuple.getString(0);
	for (String word : countries.split(",")) {
		// System.out.println("word -"+word);
		collector.emit(new Values(word));
	}
}
 
开发者ID:PacktPublishing,项目名称:Mastering-Apache-Storm,代码行数:8,代码来源:TridentUtility.java


示例11: isKeep

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public boolean isKeep(TridentTuple tuple) {
	if (tuple.getString(0).contains("#FIFA")) {
		return true;
	} else {
		return false;
	}
}
 
开发者ID:PacktPublishing,项目名称:Mastering-Apache-Storm,代码行数:8,代码来源:TridentUtility.java


示例12: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {
  String sentence = tuple.getString(0);
  LOG.debug("receive sentence: '" + sentence + "'");
  if (sentence != null) {
    for (String word : splitSentence(sentence)) {
      collector.emit(new Values(word));
    }
  }
}
 
开发者ID:MBtech,项目名称:stormbenchmark,代码行数:11,代码来源:WordSplit.java


示例13: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {
  Iterable iterable = (Iterable) tuple.getValue(0);
  Iterator iterator = iterable.iterator();
  while (iterator.hasNext()) {
   collector.emit(new Values(iterator.next()));
  }
}
 
开发者ID:MBtech,项目名称:stormbenchmark,代码行数:9,代码来源:Expand.java


示例14: init

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public Set<Integer> init(TridentTuple tuple) {
  LOG.debug("get tuple: " + tuple);
  Set<Integer> singleton = new HashSet<Integer>();
  singleton.add(tuple.getInteger(1));
  return singleton;
}
 
开发者ID:MBtech,项目名称:stormbenchmark,代码行数:8,代码来源:Distinct.java


示例15: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {
  String pvString = tuple.getString(0);
  PageView pageView = PageView.fromString(pvString);
  if (null == pageView) {
    LOG.error("invalid pageview string '" + pvString + "'");
    return;
  }
  List<Object> values = new ArrayList<Object>();
  for (Item field : fields) {
    values.add(pageView.getValue(field));
  }
  collector.emit(values);
}
 
开发者ID:MBtech,项目名称:stormbenchmark,代码行数:15,代码来源:PageView.java


示例16: take

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public List<MRData> take(int num) {
    final List<MRData> data = new ArrayList<MRData>();
    stream.each(stream.getOutputFields(),new BaseFunction() {
        @Override
        public void execute(TridentTuple tuple, TridentCollector collector) {
           System.out.println("output: "+tuple);
           MRData value = (MRData)tuple.get(0);
           data.add(value);
       }
   },new Fields("finaloutput"));
    return data;
}
 
开发者ID:apache,项目名称:incubator-mrql,代码行数:14,代码来源:StreamDataSource.java


示例17: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {
  String sentence = tuple.getString(0);
  for (String word : sentence.split(" ")) {
    collector.emit(new Values(word));
  }
}
 
开发者ID:ziyunhx,项目名称:storm-net-adapter,代码行数:8,代码来源:TridentWordCount.java


示例18: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public Iterable<Values> execute(TridentTuple input) {
    List<Values> valuesList = new ArrayList<>();
    for (String word : input.getString(0).split(" ")) {
        valuesList.add(new Values(word));
    }
    return valuesList;
}
 
开发者ID:ziyunhx,项目名称:storm-net-adapter,代码行数:9,代码来源:TridentMapExample.java


示例19: buildTopology

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
public static StormTopology buildTopology(LocalDRPC drpc) {
    FixedBatchSpout spout = new FixedBatchSpout(
            new Fields("word"), 3, new Values("the cow jumped over the moon"),
            new Values("the man went to the store and bought some candy"), new Values("four score and seven years ago"),
            new Values("how many apples can you eat"), new Values("to be or not to be the person"));
    spout.setCycle(true);

    TridentTopology topology = new TridentTopology();
    TridentState wordCounts = topology.newStream("spout1", spout).parallelismHint(16)
            .flatMap(split)
            .map(toUpper)
            .filter(theFilter)
            .peek(new Consumer() {
                @Override
                public void accept(TridentTuple input) {
                    System.out.println(input.getString(0));
                }
            })
            .groupBy(new Fields("word"))
            .persistentAggregate(new MemoryMapState.Factory(), new Count(), new Fields("count"))
            .parallelismHint(16);

    topology.newDRPCStream("words", drpc)
            .flatMap(split)
            .groupBy(new Fields("args"))
            .stateQuery(wordCounts, new Fields("args"), new MapGet(), new Fields("count"))
            .filter(new FilterNull())
            .aggregate(new Fields("count"), new Sum(), new Fields("sum"));
    return topology.build();
}
 
开发者ID:ziyunhx,项目名称:storm-net-adapter,代码行数:31,代码来源:TridentMapExample.java


示例20: execute

import org.apache.storm.trident.tuple.TridentTuple; //导入依赖的package包/类
@Override
public void execute(TridentTuple tuple, TridentCollector collector) {
  List l = (List) tuple.getValue(0);
  if (l != null) {
    for (Object o : l) {
      collector.emit(new Values(o));
    }
  }
}
 
开发者ID:ziyunhx,项目名称:storm-net-adapter,代码行数:10,代码来源:TridentReach.java



注:本文中的org.apache.storm.trident.tuple.TridentTuple类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java FilterAggregateTransposeRule类代码示例发布时间:2022-05-22
下一篇:
Java SiteMapIndex类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap