• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java AbstractUdfStreamOperator类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator的典型用法代码示例。如果您正苦于以下问题:Java AbstractUdfStreamOperator类的具体用法?Java AbstractUdfStreamOperator怎么用?Java AbstractUdfStreamOperator使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



AbstractUdfStreamOperator类属于org.apache.flink.streaming.api.operators包,在下文中一共展示了AbstractUdfStreamOperator类的4个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: generateNodeLocalHash

import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator; //导入依赖的package包/类
private void generateNodeLocalHash(StreamNode node, Hasher hasher, int id) {
	hasher.putInt(id);

	hasher.putInt(node.getParallelism());

	if (node.getOperator() instanceof AbstractUdfStreamOperator) {
		String udfClassName = ((AbstractUdfStreamOperator<?, ?>) node.getOperator())
				.getUserFunction().getClass().getName();

		hasher.putString(udfClassName, Charset.forName("UTF-8"));
	}
}
 
开发者ID:axbaretto,项目名称:flink,代码行数:13,代码来源:StreamGraphHasherV1.java


示例2: getFunctionFromDataSource

import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator; //导入依赖的package包/类
@SuppressWarnings("unchecked")
private static <T> SourceFunction<T> getFunctionFromDataSource(DataStreamSource<T> dataStreamSource) {
	dataStreamSource.addSink(new DiscardingSink<T>());
	AbstractUdfStreamOperator<?, ?> operator =
			(AbstractUdfStreamOperator<?, ?>) getOperatorFromDataStream(dataStreamSource);
	return (SourceFunction<T>) operator.getUserFunction();
}
 
开发者ID:axbaretto,项目名称:flink,代码行数:8,代码来源:StreamExecutionEnvironmentTest.java


示例3: generateDeterministicHash

import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator; //导入依赖的package包/类
/**
 * Generates a deterministic hash from node-local properties and input and
 * output edges.
 */
private byte[] generateDeterministicHash(
		StreamNode node,
		Hasher hasher,
		Map<Integer, byte[]> hashes,
		boolean isChainingEnabled) {

	// Include stream node to hash. We use the current size of the computed
	// hashes as the ID. We cannot use the node's ID, because it is
	// assigned from a static counter. This will result in two identical
	// programs having different hashes.
	generateNodeLocalHash(node, hasher, hashes.size());

	// Include chained nodes to hash
	for (StreamEdge outEdge : node.getOutEdges()) {
		if (isChainable(outEdge, isChainingEnabled)) {
			StreamNode chainedNode = outEdge.getTargetVertex();

			// Use the hash size again, because the nodes are chained to
			// this node. This does not add a hash for the chained nodes.
			generateNodeLocalHash(chainedNode, hasher, hashes.size());
		}
	}

	byte[] hash = hasher.hash().asBytes();

	// Make sure that all input nodes have their hash set before entering
	// this loop (calling this method).
	for (StreamEdge inEdge : node.getInEdges()) {
		byte[] otherHash = hashes.get(inEdge.getSourceId());

		// Sanity check
		if (otherHash == null) {
			throw new IllegalStateException("Missing hash for input node "
					+ inEdge.getSourceVertex() + ". Cannot generate hash for "
					+ node + ".");
		}

		for (int j = 0; j < hash.length; j++) {
			hash[j] = (byte) (hash[j] * 37 ^ otherHash[j]);
		}
	}

	if (LOG.isDebugEnabled()) {
		String udfClassName = "";
		if (node.getOperator() instanceof AbstractUdfStreamOperator) {
			udfClassName = ((AbstractUdfStreamOperator<?, ?>) node.getOperator())
					.getUserFunction().getClass().getName();
		}

		LOG.debug("Generated hash '" + byteToHexString(hash) + "' for node " +
				"'" + node.toString() + "' {id: " + node.getId() + ", " +
				"parallelism: " + node.getParallelism() + ", " +
				"user function: " + udfClassName + "}");
	}

	return hash;
}
 
开发者ID:axbaretto,项目名称:flink,代码行数:62,代码来源:StreamGraphHasherV1.java


示例4: getFunctionForDataStream

import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator; //导入依赖的package包/类
private static Function getFunctionForDataStream(DataStream<?> dataStream) {
	AbstractUdfStreamOperator<?, ?> operator =
			(AbstractUdfStreamOperator<?, ?>) getOperatorForDataStream(dataStream);
	return operator.getUserFunction();
}
 
开发者ID:axbaretto,项目名称:flink,代码行数:6,代码来源:DataStreamTest.java



注:本文中的org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java BCECPrivateKey类代码示例发布时间:2022-05-22
下一篇:
Java StreamingMarshaller类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap