• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号
登陆 注册

Java TransactionalState类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中storm.trident.topology.state.TransactionalState类的典型用法代码示例。如果您正苦于以下问题：Java TransactionalState类的具体用法？Java TransactionalState怎么用？Java TransactionalState使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



TransactionalState类属于storm.trident.topology.state包，在下文中一共展示了TransactionalState类的18个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: open

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void open(Map conf, TopologyContext context, SpoutOutputCollector collector) {
    _throttler = new WindowedTimeThrottler((Number)conf.get(Config.TOPOLOGY_TRIDENT_BATCH_EMIT_INTERVAL_MILLIS), 1);
    for(String spoutId: _managedSpoutIds) {
        _states.add(TransactionalState.newCoordinatorState(conf, spoutId));
    }
    _currTransaction = getStoredCurrTransaction();

    _collector = collector;
    Number active = (Number) conf.get(Config.TOPOLOGY_MAX_SPOUT_PENDING);
    if(active==null) {
        _maxTransactionActive = 1;
    } else {
        _maxTransactionActive = active.intValue();
    }
    _attemptIds = getStoredCurrAttempts(_currTransaction, _maxTransactionActive);

    
    for(int i=0; i<_spouts.size(); i++) {
        String txId = _managedSpoutIds.get(i);
        _coordinators.add(_spouts.get(i).getCoordinator(txId, conf, context));
    }
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:24，代码来源:MasterBatchCoordinator.java


示例2: getStoredCurrAttempts

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
private TreeMap<Long, Integer> getStoredCurrAttempts(long currTransaction, int maxBatches) {
    TreeMap<Long, Integer> ret = new TreeMap<Long, Integer>();
    for(TransactionalState state: _states) {
        Map<Object, Number> attempts = (Map) state.getData(CURRENT_ATTEMPTS);
        if(attempts==null) attempts = new HashMap();
        for(Entry<Object, Number> e: attempts.entrySet()) {
            // this is because json doesn't allow numbers as keys...
            // : replace json with a better form of encoding
            Number txidObj;
            if(e.getKey() instanceof String) {
                txidObj = Long.parseLong((String) e.getKey());
            } else {
                txidObj = (Number) e.getKey();
            }
            long txid = txidObj.longValue();
            int attemptId = e.getValue().intValue();
            Integer curr = ret.get(txid);
            if(curr==null || attemptId > curr) {
                ret.put(txid, attemptId);
            }                
        }
    }
    ret.headMap(currTransaction).clear();
    ret.tailMap(currTransaction + maxBatches - 1).clear();
    return ret;
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:27，代码来源:MasterBatchCoordinator.java


示例3: getStoredCurrAttempts

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
private TreeMap<Long, Integer> getStoredCurrAttempts(long currTransaction, int maxBatches) {
    TreeMap<Long, Integer> ret = new TreeMap<Long, Integer>();
    for(TransactionalState state: _states) {
        Map<Object, Number> attempts = (Map) state.getData(CURRENT_ATTEMPTS);
        if(attempts==null) attempts = new HashMap();
        for(Entry<Object, Number> e: attempts.entrySet()) {
            // this is because json doesn't allow numbers as keys...
            // TODO: replace json with a better form of encoding
            Number txidObj;
            if(e.getKey() instanceof String) {
                txidObj = Long.parseLong((String) e.getKey());
            } else {
                txidObj = (Number) e.getKey();
            }
            long txid = ((Number) txidObj).longValue();
            int attemptId = ((Number) e.getValue()).intValue();
            Integer curr = ret.get(txid);
            if(curr==null || attemptId > curr) {
                ret.put(txid, attemptId);
            }                
        }
    }
    ret.headMap(currTransaction).clear();
    ret.tailMap(currTransaction + maxBatches - 1).clear();
    return ret;
}
开发者ID:songtk，项目名称:learn_jstorm，代码行数:27，代码来源:MasterBatchCoordinator.java


示例4: ack

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void ack(Object msgId) {
    TransactionAttempt tx = (TransactionAttempt) msgId;
    TransactionStatus status = _activeTx.get(tx.getTransactionId());
    if(status!=null && tx.equals(status.attempt)) {
        if(status.status==AttemptStatus.PROCESSING) {
            status.status = AttemptStatus.PROCESSED;
        } else if(status.status==AttemptStatus.COMMITTING) {
            _activeTx.remove(tx.getTransactionId());
            _attemptIds.remove(tx.getTransactionId());
            _collector.emit(SUCCESS_STREAM_ID, new Values(tx));
            _currTransaction = nextTransactionId(tx.getTransactionId());
            for(TransactionalState state: _states) {
                state.setData(CURRENT_TX, _currTransaction);                    
            }
        }
        sync();
    }
}
开发者ID:kkllwww007，项目名称:jstrom，代码行数:20，代码来源:MasterBatchCoordinator.java


示例5: ack

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void ack(Object msgId) {
    TransactionAttempt tx = (TransactionAttempt) msgId;
    TransactionStatus status = _activeTx.get(tx.getTransactionId());
    if (status != null && tx.equals(status.attempt)) {
        if (status.status == AttemptStatus.PROCESSING) {
            status.status = AttemptStatus.PROCESSED;
            if (tx.getTransactionId() != _currTransaction) {
                commitWaittingCount.incr();
                status.processedTime = System.currentTimeMillis();
            }
        } else if (status.status == AttemptStatus.COMMITTING) {
            _activeTx.remove(tx.getTransactionId());
            _attemptIds.remove(tx.getTransactionId());
            _collector.emit(SUCCESS_STREAM_ID, new Values(tx));
            _currTransaction = nextTransactionId(tx.getTransactionId());
            for (TransactionalState state : _states) {
                state.setData(CURRENT_TX, _currTransaction);
            }
        }
        sync();
    }
}
开发者ID:troyding，项目名称:storm-resa，代码行数:24，代码来源:MasterBatchCoordinator.java


示例6: getStoredCurrAttempts

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
private TreeMap<Long, Integer> getStoredCurrAttempts(long currTransaction, int maxBatches) {
    TreeMap<Long, Integer> ret = new TreeMap<Long, Integer>();
    for (TransactionalState state : _states) {
        Map<Object, Number> attempts = (Map) state.getData(CURRENT_ATTEMPTS);
        if (attempts == null) attempts = new HashMap();
        for (Entry<Object, Number> e : attempts.entrySet()) {
            // this is because json doesn't allow numbers as keys...
            // TODO: replace json with a better form of encoding
            Number txidObj;
            if (e.getKey() instanceof String) {
                txidObj = Long.parseLong((String) e.getKey());
            } else {
                txidObj = (Number) e.getKey();
            }
            long txid = ((Number) txidObj).longValue();
            int attemptId = ((Number) e.getValue()).intValue();
            Integer curr = ret.get(txid);
            if (curr == null || attemptId > curr) {
                ret.put(txid, attemptId);
            }
        }
    }
    ret.headMap(currTransaction).clear();
    ret.tailMap(currTransaction + maxBatches - 1).clear();
    return ret;
}
开发者ID:troyding，项目名称:storm-resa，代码行数:27，代码来源:MasterBatchCoordinator.java


示例7: open

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void open(Map conf, TopologyContext context, SpoutOutputCollector collector) {
    _throttler = new WindowedTimeThrottler((Number) conf.get(Config.TOPOLOGY_TRIDENT_BATCH_EMIT_INTERVAL_MILLIS), 1);
    for (String spoutId : _managedSpoutIds) {
        _states.add(TransactionalState.newCoordinatorState(conf, spoutId));
    }
    _currTransaction = getStoredCurrTransaction();

    _collector = collector;
    Number active = (Number) conf.get(Config.TOPOLOGY_MAX_SPOUT_PENDING);
    if (active == null) {
        _maxTransactionActive = 1;
    } else {
        _maxTransactionActive = active.intValue();
    }
    _attemptIds = getStoredCurrAttempts(_currTransaction, _maxTransactionActive);


    for (int i = 0; i < _spouts.size(); i++) {
        String txId = _managedSpoutIds.get(i);
        _coordinators.add(_spouts.get(i).getCoordinator(txId, conf, context));
    }
}
开发者ID:alibaba，项目名称:jstorm，代码行数:24，代码来源:MasterBatchCoordinator.java


示例8: ack

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public synchronized void ack(Object msgId) {
    TransactionAttempt tx = (TransactionAttempt) msgId;
    TransactionStatus status = _activeTx.get(tx.getTransactionId());
    if (status != null && tx.equals(status.attempt)) {
        if (status.status == AttemptStatus.PROCESSING) {
            LOG.debug("acker batch stream {}", tx);
            status.status = AttemptStatus.PROCESSED;
        } else if (status.status == AttemptStatus.COMMITTING) {
            _activeTx.remove(tx.getTransactionId());
            _attemptIds.remove(tx.getTransactionId());
            LOG.debug("acker commit stream {}", tx);
            _collector.emit(SUCCESS_STREAM_ID, new Values(tx));
            _currTransaction = nextTransactionId(tx.getTransactionId());
            for (TransactionalState state : _states) {
                state.setData(CURRENT_TX, _currTransaction);
            }
        }
        sync();
    }
}
开发者ID:alibaba，项目名称:jstorm，代码行数:22，代码来源:MasterBatchCoordinator.java


示例9: getStoredCurrTransaction

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
private Long getStoredCurrTransaction() {
    Long ret = INIT_TXID;
    for(TransactionalState state: _states) {
        Long curr = (Long) state.getData(CURRENT_TX);
        if(curr!=null && curr.compareTo(ret) > 0) {
            ret = curr;
        }
    }
    return ret;
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:11，代码来源:MasterBatchCoordinator.java


示例10: open

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void open(Map conf, TopologyContext context, SpoutOutputCollector collector) {
    _throttler = new WindowedTimeThrottler((Number) conf.get(Config.TOPOLOGY_TRIDENT_BATCH_EMIT_INTERVAL_MILLIS),
            Integer.MAX_VALUE);
    for (String spoutId : _managedSpoutIds) {
        _states.add(TransactionalState.newCoordinatorState(conf, spoutId));
    }
    _currTransaction = getStoredCurrTransaction();

    _collector = collector;
    Number active = (Number) conf.get(Config.TOPOLOGY_MAX_SPOUT_PENDING);
    if (active == null) {
        _maxTransactionActive = 1;
    } else {
        _maxTransactionActive = active.intValue();
    }
    _attemptIds = getStoredCurrAttempts(_currTransaction, _maxTransactionActive);
    avgWaittingTime = context.registerMetric("commit-wait-ms", new ReducedMetric(new MeanReducer()),
            Utils.getInt(conf.get(Config.TOPOLOGY_BUILTIN_METRICS_BUCKET_SIZE_SECS)));
    commitWaittingCount = context.registerMetric("commit-wait-cnt", new CountMetric(),
            Utils.getInt(conf.get(Config.TOPOLOGY_BUILTIN_METRICS_BUCKET_SIZE_SECS)));
    activeTxCount = context.registerMetric("active-tx-cnt", new ReducedMetric(new MeanReducer()),
            Utils.getInt(conf.get(Config.TOPOLOGY_BUILTIN_METRICS_BUCKET_SIZE_SECS)));
    for (int i = 0; i < _spouts.size(); i++) {
        String txId = _managedSpoutIds.get(i);
        _coordinators.add(_spouts.get(i).getCoordinator(txId, conf, context));
    }
}
开发者ID:troyding，项目名称:storm-resa，代码行数:29，代码来源:MasterBatchCoordinator.java


示例11: getStoredCurrTransaction

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
private Long getStoredCurrTransaction() {
    Long ret = INIT_TXID;
    for (TransactionalState state : _states) {
        Long curr = (Long) state.getData(CURRENT_TX);
        if (curr != null && curr.compareTo(ret) > 0) {
            ret = curr;
        }
    }
    return ret;
}
开发者ID:troyding，项目名称:storm-resa，代码行数:11，代码来源:MasterBatchCoordinator.java


示例12: getStoredCurrAttempts

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
private TreeMap<Long, Integer> getStoredCurrAttempts(long currTransaction, int maxBatches) {
    TreeMap<Long, Integer> ret = new TreeMap<>();
    for (TransactionalState state : _states) {
        Map<Object, Number> attempts = (Map) state.getData(CURRENT_ATTEMPTS);
        if (attempts == null)
            attempts = new HashMap<>();
        for (Entry<Object, Number> e : attempts.entrySet()) {
            // this is because json doesn't allow numbers as keys...
            // TODO: replace json with a better form of encoding
            Number txidObj;
            if (e.getKey() instanceof String) {
                txidObj = Long.parseLong((String) e.getKey());
            } else {
                txidObj = (Number) e.getKey();
            }
            long txid = txidObj.longValue();
            int attemptId = e.getValue().intValue();
            Integer curr = ret.get(txid);
            if (curr == null || attemptId > curr) {
                ret.put(txid, attemptId);
            }
        }
    }
    ret.headMap(currTransaction).clear();
    ret.tailMap(currTransaction + maxBatches - 1).clear();
    return ret;
}
开发者ID:alibaba，项目名称:jstorm，代码行数:28，代码来源:MasterBatchCoordinator.java


示例13: close

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void close() {
    for(TransactionalState state: _states) {
        state.close();
    }
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:7，代码来源:MasterBatchCoordinator.java


示例14: Emitter

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
public Emitter(String txStateId, Map conf, TopologyContext context) {
    _emitter = _spout.getEmitter(conf, context);
    _state = TransactionalState.newUserState(conf, txStateId); 
    _index = context.getThisTaskIndex();
    _numTasks = context.getComponentTasks(context.getThisComponentId()).size();
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:7，代码来源:PartitionedTridentSpoutExecutor.java


示例15: prepare

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
@Override
public void prepare(Map conf, TopologyContext context) {
    _coord = _spout.getCoordinator(_id, conf, context);
    _underlyingState = TransactionalState.newCoordinatorState(conf, _id);
    _state = new RotatingTransactionalState(_underlyingState, META_DIR);
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:7，代码来源:TridentSpoutCoordinator.java


示例16: Emitter

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
public Emitter(String txStateId, Map conf, TopologyContext context) {
    _emitter = _spout.getEmitter(conf, context);
    _index = context.getThisTaskIndex();
    _numTasks = context.getComponentTasks(context.getThisComponentId()).size();
    _state = TransactionalState.newUserState(conf, txStateId);             
}
开发者ID:zhangjunfang，项目名称:jstorm-0.9.6.3-，代码行数:7，代码来源:OpaquePartitionedTridentSpoutExecutor.java


示例17: Emitter

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
public Emitter(String txStateId, Map conf, TopologyContext context) {
    _emitter = _spout.getEmitter(conf, context);
    _state = TransactionalState.newUserState(conf, txStateId);
    _index = context.getThisTaskIndex();
    _numTasks = context.getComponentTasks(context.getThisComponentId()).size();
}
开发者ID:kkllwww007，项目名称:jstrom，代码行数:7，代码来源:PartitionedTridentSpoutExecutor.java


示例18: Emitter

import storm.trident.topology.state.TransactionalState; //导入依赖的package包/类
public Emitter(String txStateId, Map conf, TopologyContext context) {
    _emitter = _spout.getEmitter(conf, context);
    _index = context.getThisTaskIndex();
    _numTasks = context.getComponentTasks(context.getThisComponentId()).size();
    _state = TransactionalState.newUserState(conf, txStateId);
}
开发者ID:kkllwww007，项目名称:jstrom，代码行数:7，代码来源:OpaquePartitionedTridentSpoutExecutor.java



注：本文中的storm.trident.topology.state.TransactionalState类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花
握手
雷人
路过
鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
More+
上一篇：
Java LocalConfigurationProvider类代码示例发布时间：2022-05-23
下一篇：
Java AvailabilityType类代码示例发布时间：2022-05-23
热门推荐
More+
热门话题
More+
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服（服务时间 9:00～18:00）

在线QQ客服
地址：深圳市南山区西丽大学城创智工业园
电邮：jeky_zhao#qq.com
移动电话：139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap