本文整理汇总了Java中backtype.storm.metric.api.ReducedMetric类的典型用法代码示例。如果您正苦于以下问题:Java ReducedMetric类的具体用法?Java ReducedMetric怎么用?Java ReducedMetric使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
ReducedMetric类属于backtype.storm.metric.api包,在下文中一共展示了ReducedMetric类的12个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。
示例1: open
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
@Override
public void open(Map conf, TopologyContext context, SpoutOutputCollector collector) {
_throttler = new WindowedTimeThrottler((Number) conf.get(Config.TOPOLOGY_TRIDENT_BATCH_EMIT_INTERVAL_MILLIS),
Integer.MAX_VALUE);
for (String spoutId : _managedSpoutIds) {
_states.add(TransactionalState.newCoordinatorState(conf, spoutId));
}
_currTransaction = getStoredCurrTransaction();
_collector = collector;
Number active = (Number) conf.get(Config.TOPOLOGY_MAX_SPOUT_PENDING);
if (active == null) {
_maxTransactionActive = 1;
} else {
_maxTransactionActive = active.intValue();
}
_attemptIds = getStoredCurrAttempts(_currTransaction, _maxTransactionActive);
avgWaittingTime = context.registerMetric("commit-wait-ms", new ReducedMetric(new MeanReducer()),
Utils.getInt(conf.get(Config.TOPOLOGY_BUILTIN_METRICS_BUCKET_SIZE_SECS)));
commitWaittingCount = context.registerMetric("commit-wait-cnt", new CountMetric(),
Utils.getInt(conf.get(Config.TOPOLOGY_BUILTIN_METRICS_BUCKET_SIZE_SECS)));
activeTxCount = context.registerMetric("active-tx-cnt", new ReducedMetric(new MeanReducer()),
Utils.getInt(conf.get(Config.TOPOLOGY_BUILTIN_METRICS_BUCKET_SIZE_SECS)));
for (int i = 0; i < _spouts.size(); i++) {
String txId = _managedSpoutIds.get(i);
_coordinators.add(_spouts.get(i).getCoordinator(txId, conf, context));
}
}
开发者ID:troyding,项目名称:storm-resa,代码行数:29,代码来源:MasterBatchCoordinator.java
示例2: PartitionManager
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
public PartitionManager(DynamicPartitionConnections connections, String topologyInstanceId, ZkState state, Map stormConf, SpoutConfig spoutConfig, Partition id) {
_partition = id;
_connections = connections;
_spoutConfig = spoutConfig;
_topologyInstanceId = topologyInstanceId;
_consumer = connections.register(id.host, id.partition);
_state = state;
_stormConf = stormConf;
numberAcked = numberFailed = 0;
String jsonTopologyId = null;
Long jsonOffset = null;
String path = committedPath();
try {
Map<Object, Object> json = _state.readJSON(path);
LOG.info("Read partition information from: " + path + " --> " + json );
if (json != null) {
jsonTopologyId = (String) ((Map<Object, Object>) json.get("topology")).get("id");
jsonOffset = (Long) json.get("offset");
}
} catch (Throwable e) {
LOG.warn("Error reading and/or parsing at ZkNode: " + path, e);
}
Long currentOffset = KafkaUtils.getOffset(_consumer, spoutConfig.topic, id.partition, spoutConfig);
if (jsonTopologyId == null || jsonOffset == null) { // failed to parse JSON?
_committedTo = currentOffset;
LOG.info("No partition information found, using configuration to determine offset");
} else if (!topologyInstanceId.equals(jsonTopologyId) && spoutConfig.forceFromStart) {
_committedTo = KafkaUtils.getOffset(_consumer, spoutConfig.topic, id.partition, spoutConfig.startOffsetTime);
LOG.info("Topology change detected and reset from start forced, using configuration to determine offset");
} else {
_committedTo = jsonOffset;
LOG.info("Read last commit offset from zookeeper: " + _committedTo + "; old topology_id: " + jsonTopologyId + " - new topology_id: " + topologyInstanceId );
}
if (currentOffset - _committedTo > spoutConfig.maxOffsetBehind || _committedTo <= 0) {
LOG.info("Last commit offset from zookeeper: " + _committedTo);
_committedTo = currentOffset;
LOG.info("Commit offset " + _committedTo + " is more than " +
spoutConfig.maxOffsetBehind + " behind, resetting to startOffsetTime=" + spoutConfig.startOffsetTime);
}
LOG.info("Starting Kafka " + _consumer.host() + ":" + id.partition + " from offset " + _committedTo);
_emittedToOffset = _committedTo;
_fetchAPILatencyMax = new CombinedMetric(new MaxMetric());
_fetchAPILatencyMean = new ReducedMetric(new MeanReducer());
_fetchAPICallCount = new CountMetric();
_fetchAPIMessageCount = new CountMetric();
}
开发者ID:redBorder,项目名称:rb-bi,代码行数:53,代码来源:PartitionManager.java
示例3: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
@Override
public ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs) {
return _topoContext.registerMetric(name, new ReducedMetric(reducer), timeBucketSizeInSecs);
}
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:5,代码来源:TridentOperationContext.java
示例4: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
@Override
public ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs) {
return registerMetric(name, new ReducedMetric(reducer), timeBucketSizeInSecs);
}
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:5,代码来源:TopologyContext.java
示例5: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
ReducedMetric registerMetric(String name, IReducer reducer,
int timeBucketSizeInSecs);
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:3,代码来源:IMetricsContext.java
示例6: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
public ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs) {
return _topoContext.registerMetric(name, new ReducedMetric(reducer), timeBucketSizeInSecs);
}
开发者ID:songtk,项目名称:learn_jstorm,代码行数:4,代码来源:TridentOperationContext.java
示例7: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
public ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs) {
return registerMetric(name, new ReducedMetric(reducer), timeBucketSizeInSecs);
}
开发者ID:songtk,项目名称:learn_jstorm,代码行数:4,代码来源:TopologyContext.java
示例8: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
public ReducedMetric registerMetric(String name, IReducer reducer,
int timeBucketSizeInSecs) {
return registerMetric(name, new ReducedMetric(reducer),
timeBucketSizeInSecs);
}
开发者ID:greeenSY,项目名称:Tstream,代码行数:6,代码来源:TopologyContext.java
示例9: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
@SuppressWarnings("rawtypes")
public ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs) {
return registerMetric(name, new ReducedMetric(reducer), timeBucketSizeInSecs);
}
开发者ID:twitter,项目名称:heron,代码行数:5,代码来源:TopologyContext.java
示例10: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
@SuppressWarnings("rawtypes")
ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs);
开发者ID:twitter,项目名称:heron,代码行数:3,代码来源:IMetricsContext.java
示例11: PartitionManager
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
public PartitionManager(DynamicPartitionConnections connections, String topologyInstanceId, ZkState state, Map stormConf, SpoutConfig spoutConfig, Partition id) {
_partition = id;
_connections = connections;
_spoutConfig = spoutConfig;
_topologyInstanceId = topologyInstanceId;
_consumer = connections.register(id.host, id.partition);
_state = state;
_stormConf = stormConf;
String jsonTopologyId = null;
Long jsonOffset = null;
String path = committedPath();
try {
Map<Object, Object> json = _state.readJSON(path);
LOG.info("Read partition information from: " + path + " --> " + json );
if (json != null) {
jsonTopologyId = (String) ((Map<Object, Object>) json.get("topology")).get("id");
jsonOffset = (Long) json.get("offset");
}
} catch (Throwable e) {
LOG.warn("Error reading and/or parsing at ZkNode: " + path, e);
}
if (jsonTopologyId == null || jsonOffset == null) { // failed to parse JSON?
_committedTo = KafkaUtils.getOffset(_consumer, spoutConfig.topic, id.partition, spoutConfig);
LOG.info("No partition information found, using configuration to determine offset");
} else if (!topologyInstanceId.equals(jsonTopologyId) && spoutConfig.forceFromStart) {
_committedTo = KafkaUtils.getOffset(_consumer, spoutConfig.topic, id.partition, spoutConfig.startOffsetTime);
LOG.info("Topology change detected and reset from start forced, using configuration to determine offset");
} else {
_committedTo = jsonOffset;
LOG.info("Read last commit offset from zookeeper: " + _committedTo + "; old topology_id: " + jsonTopologyId + " - new topology_id: " + topologyInstanceId );
}
LOG.info("Starting " + _partition + " from offset " + _committedTo);
_emittedToOffset = _committedTo;
_fetchAPILatencyMax = new CombinedMetric(new MaxMetric());
_fetchAPILatencyMean = new ReducedMetric(new MeanReducer());
_fetchAPICallCount = new CountMetric();
_fetchAPIMessageCount = new CountMetric();
}
开发者ID:metamx,项目名称:incubator-storm,代码行数:43,代码来源:PartitionManager.java
示例12: registerMetric
import backtype.storm.metric.api.ReducedMetric; //导入依赖的package包/类
ReducedMetric registerMetric(String name, IReducer reducer, int timeBucketSizeInSecs);
开发者ID:kkllwww007,项目名称:jstrom,代码行数:2,代码来源:IMetricsContext.java
注:本文中的backtype.storm.metric.api.ReducedMetric类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。 |
请发表评论