• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java BlackListInfo类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.mapred.ClusterStatus.BlackListInfo的典型用法代码示例。如果您正苦于以下问题:Java BlackListInfo类的具体用法?Java BlackListInfo怎么用?Java BlackListInfo使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



BlackListInfo类属于org.apache.hadoop.mapred.ClusterStatus包,在下文中一共展示了BlackListInfo类的7个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: testBlackListInfo

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
/**
 * test BlackListInfo class
 * 
 * @throws IOException
 */
@Test (timeout=5000)
public void testBlackListInfo() throws IOException {
  BlackListInfo info = new BlackListInfo();
  info.setBlackListReport("blackListInfo");
  info.setReasonForBlackListing("reasonForBlackListing");
  info.setTrackerName("trackerName");
  ByteArrayOutputStream byteOut = new ByteArrayOutputStream();
  DataOutput out = new DataOutputStream(byteOut);
  info.write(out);
  BlackListInfo info2 = new BlackListInfo();
  info2.readFields(new DataInputStream(new ByteArrayInputStream(byteOut
      .toByteArray())));
  assertEquals(info, info);
  assertEquals(info.toString(), info.toString());
  assertEquals(info.getTrackerName(), "trackerName");
  assertEquals(info.getReasonForBlackListing(), "reasonForBlackListing");
  assertEquals(info.getBlackListReport(), "blackListInfo");

}
 
开发者ID:naver,项目名称:hadoop,代码行数:25,代码来源:TestNetworkedJob.java


示例2: testGetClusterStatusWithLocalJobRunner

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
@Test
public void testGetClusterStatusWithLocalJobRunner() throws Exception {
  Configuration conf = new Configuration();
  conf.set(JTConfig.JT_IPC_ADDRESS, MRConfig.LOCAL_FRAMEWORK_NAME);
  conf.set(MRConfig.FRAMEWORK_NAME, MRConfig.LOCAL_FRAMEWORK_NAME);
  JobClient client = new JobClient(conf);
  ClusterStatus clusterStatus = client.getClusterStatus(true);
  Collection<String> activeTrackerNames = clusterStatus
      .getActiveTrackerNames();
  Assert.assertEquals(0, activeTrackerNames.size());
  int blacklistedTrackers = clusterStatus.getBlacklistedTrackers();
  Assert.assertEquals(0, blacklistedTrackers);
  Collection<BlackListInfo> blackListedTrackersInfo = clusterStatus
      .getBlackListedTrackersInfo();
  Assert.assertEquals(0, blackListedTrackersInfo.size());
}
 
开发者ID:naver,项目名称:hadoop,代码行数:17,代码来源:TestJobClient.java


示例3: testBlackListInfo

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
/**
 * test BlackListInfo class
 * 
 * @throws IOException
 */
@Test (timeout=5000)
public void testBlackListInfo() throws IOException {
  BlackListInfo info = new BlackListInfo();
  info.setBlackListReport("blackListInfo");
  info.setReasonForBlackListing("reasonForBlackListing");
  info.setTrackerName("trackerName");
  ByteArrayOutputStream byteOut = new ByteArrayOutputStream();
  DataOutput out = new DataOutputStream(byteOut);
  info.write(out);
  BlackListInfo info2 = new BlackListInfo();
  info2.readFields(new DataInputStream(new ByteArrayInputStream(byteOut
      .toByteArray())));
  assertEquals(info, info2);
  assertEquals(info.toString(), info2.toString());
  assertEquals("trackerName", info2.getTrackerName());
  assertEquals("reasonForBlackListing", info2.getReasonForBlackListing());
  assertEquals("blackListInfo", info2.getBlackListReport());
}
 
开发者ID:hopshadoop,项目名称:hops,代码行数:24,代码来源:TestNetworkedJob.java


示例4: getBlackListedTrackers

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
synchronized Collection<BlackListInfo> getBlackListedTrackers() {
  Collection<BlackListInfo> blackListedTrackers = 
    new ArrayList<BlackListInfo>();
  for(TaskTrackerStatus tracker : blacklistedTaskTrackers()) {
    String hostName = tracker.getHost();
    BlackListInfo bi = new BlackListInfo();
    bi.setTrackerName(tracker.getTrackerName());
    Set<ReasonForBlackListing> rfbs = 
      getReasonForBlackList(hostName);
    StringBuffer sb = new StringBuffer();
    for(ReasonForBlackListing rfb : rfbs) {
      sb.append(rfb.toString());
      sb.append(",");
    }
    if (sb.length() > 0) {
      sb.replace(sb.length()-1, sb.length(), "");
    }
    bi.setReasonForBlackListing(sb.toString());
    bi.setBlackListReport(
        getFaultReport(hostName));
    blackListedTrackers.add(bi);
  }
  return blackListedTrackers;
}
 
开发者ID:rekhajoshm,项目名称:mapreduce-fork,代码行数:25,代码来源:JobTracker.java


示例5: arrayToBlackListInfo

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
private  Collection<BlackListInfo> arrayToBlackListInfo(TaskTrackerInfo[] objs) {
  Collection<BlackListInfo> list = new ArrayList<BlackListInfo>();
  for (TaskTrackerInfo info: objs) {
    BlackListInfo binfo = new BlackListInfo();
    binfo.setTrackerName(info.getTaskTrackerName());
    binfo.setReasonForBlackListing(info.getReasonForBlacklist());
    binfo.setBlackListReport(info.getBlacklistReport());
    list.add(binfo);
  }
  return list;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:12,代码来源:JobClient.java


示例6: getClusterStatus

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
public synchronized ClusterStatus getClusterStatus(boolean detailed) {
  synchronized (taskTrackers) {
    if (detailed) {
      List<List<String>> trackerNames = taskTrackerNames();
      Collection<BlackListInfo> blackListedTrackers = getBlackListedTrackers();
      return new ClusterStatus(trackerNames.get(0),
          blackListedTrackers,
          tasktrackerExpiryInterval,
          totalMaps,
          totalReduces,
          totalMapTaskCapacity,
          totalReduceTaskCapacity, 
          JobTrackerStatus.valueOf(state.name()), getExcludedNodes().size()
          );
    } else {
      return new ClusterStatus(taskTrackers.size() - 
          getBlacklistedTrackerCount(),
          getBlacklistedTrackerCount(),
          tasktrackerExpiryInterval,
          totalMaps,
          totalReduces,
          totalMapTaskCapacity,
          totalReduceTaskCapacity, 
          JobTrackerStatus.valueOf(state.name()), getExcludedNodes().size());
    }
  }
}
 
开发者ID:rekhajoshm,项目名称:mapreduce-fork,代码行数:28,代码来源:JobTracker.java


示例7: getBlacklistedTrackers

import org.apache.hadoop.mapred.ClusterStatus.BlackListInfo; //导入依赖的package包/类
/** 
 * Get all blacklisted trackers in cluster. 
 * @return array of TaskTrackerInfo
 */
public TaskTrackerInfo[] getBlacklistedTrackers() 
throws IOException, InterruptedException {
  Collection<BlackListInfo> blackListed = getBlackListedTrackers();
  TaskTrackerInfo[] info = new TaskTrackerInfo[blackListed.size()];
  int i = 0;
  for (BlackListInfo binfo : blackListed) {
    info[i++] = new TaskTrackerInfo(binfo.getTrackerName(),
      binfo.getReasonForBlackListing(), binfo.getBlackListReport());
  }
  return info;
}
 
开发者ID:rekhajoshm,项目名称:mapreduce-fork,代码行数:16,代码来源:JobTracker.java



注:本文中的org.apache.hadoop.mapred.ClusterStatus.BlackListInfo类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java AnnotationProxyMaker类代码示例发布时间:2022-05-21
下一篇:
Java InvalidMediaTypeException类代码示例发布时间:2022-05-21
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap