• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java LightWeightGSet类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.util.LightWeightGSet的典型用法代码示例。如果您正苦于以下问题:Java LightWeightGSet类的具体用法?Java LightWeightGSet怎么用?Java LightWeightGSet使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



LightWeightGSet类属于org.apache.hadoop.util包,在下文中一共展示了LightWeightGSet类的12个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: BlocksMap

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
BlocksMap(int capacity) {
  // Use 2% of total memory to size the GSet capacity
  this.capacity = capacity;
  this.blocks = new LightWeightGSet<Block, BlockInfoContiguous>(capacity) {
    @Override
    public Iterator<BlockInfoContiguous> iterator() {
      SetIterator iterator = new SetIterator();
      /*
       * Not tracking any modifications to set. As this set will be used
       * always under FSNameSystem lock, modifications will not cause any
       * ConcurrentModificationExceptions. But there is a chance of missing
       * newly added elements during iteration.
       */
      iterator.setTrackModification(false);
      return iterator;
    }
  };
}
 
开发者ID:naver,项目名称:hadoop,代码行数:19,代码来源:BlocksMap.java


示例2: BlocksMap

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
BlocksMap(int capacity) {
  // Use 2% of total memory to size the GSet capacity
  this.capacity = capacity;
  this.blocks = new LightWeightGSet<Block, BlockInfo>(capacity) {
    @Override
    public Iterator<BlockInfo> iterator() {
      SetIterator iterator = new SetIterator();
      /*
       * Not tracking any modifications to set. As this set will be used
       * always under FSNameSystem lock, modifications will not cause any
       * ConcurrentModificationExceptions. But there is a chance of missing
       * newly added elements during iteration.
       */
      iterator.setTrackModification(false);
      return iterator;
    }
  };
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:19,代码来源:BlocksMap.java


示例3: RetryCache

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
/**
 * Constructor
 * @param cacheName name to identify the cache by
 * @param percentage percentage of total java heap space used by this cache
 * @param expirationTime time for an entry to expire in nanoseconds
 */
public RetryCache(String cacheName, double percentage, long expirationTime) {
  int capacity = LightWeightGSet.computeCapacity(percentage, cacheName);
  capacity = capacity > MAX_CAPACITY ? capacity : MAX_CAPACITY;
  this.set = new LightWeightCache<CacheEntry, CacheEntry>(capacity, capacity,
      expirationTime, 0);
  this.expirationTime = expirationTime;
  this.cacheName = cacheName;
  this.retryCacheMetrics =  RetryCacheMetrics.create(this);
}
 
开发者ID:nucypher,项目名称:hadoop-oss,代码行数:16,代码来源:RetryCache.java


示例4: newInstance

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
static INodeMap newInstance(INodeDirectory rootDir) {
  // Compute the map capacity by allocating 1% of total memory
  int capacity = LightWeightGSet.computeCapacity(1, "INodeMap");
  GSet<INode, INodeWithAdditionalFields> map
      = new LightWeightGSet<INode, INodeWithAdditionalFields>(capacity);
  map.put(rootDir);
  return new INodeMap(map);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:9,代码来源:INodeMap.java


示例5: CacheManager

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
CacheManager(FSNamesystem namesystem, Configuration conf,
    BlockManager blockManager) {
  this.namesystem = namesystem;
  this.blockManager = blockManager;
  this.nextDirectiveId = 1;
  this.maxListCachePoolsResponses = conf.getInt(
      DFS_NAMENODE_LIST_CACHE_POOLS_NUM_RESPONSES,
      DFS_NAMENODE_LIST_CACHE_POOLS_NUM_RESPONSES_DEFAULT);
  this.maxListCacheDirectivesNumResponses = conf.getInt(
      DFS_NAMENODE_LIST_CACHE_DIRECTIVES_NUM_RESPONSES,
      DFS_NAMENODE_LIST_CACHE_DIRECTIVES_NUM_RESPONSES_DEFAULT);
  scanIntervalMs = conf.getLong(
      DFS_NAMENODE_PATH_BASED_CACHE_REFRESH_INTERVAL_MS,
      DFS_NAMENODE_PATH_BASED_CACHE_REFRESH_INTERVAL_MS_DEFAULT);
  float cachedBlocksPercent = conf.getFloat(
        DFS_NAMENODE_PATH_BASED_CACHE_BLOCK_MAP_ALLOCATION_PERCENT,
        DFS_NAMENODE_PATH_BASED_CACHE_BLOCK_MAP_ALLOCATION_PERCENT_DEFAULT);
  if (cachedBlocksPercent < MIN_CACHED_BLOCKS_PERCENT) {
    LOG.info("Using minimum value {} for {}", MIN_CACHED_BLOCKS_PERCENT,
      DFS_NAMENODE_PATH_BASED_CACHE_BLOCK_MAP_ALLOCATION_PERCENT);
    cachedBlocksPercent = MIN_CACHED_BLOCKS_PERCENT;
  }
  this.cachedBlocks = new LightWeightGSet<CachedBlock, CachedBlock>(
        LightWeightGSet.computeCapacity(cachedBlocksPercent,
            "cachedBlocks"));

}
 
开发者ID:naver,项目名称:hadoop,代码行数:28,代码来源:CacheManager.java


示例6: RetryCache

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
/**
 * Constructor
 * @param cacheName name to identify the cache by
 * @param percentage percentage of total java heap space used by this cache
 * @param expirationTime time for an entry to expire in nanoseconds
 */
public RetryCache(String cacheName, double percentage, long expirationTime) {
  int capacity = LightWeightGSet.computeCapacity(percentage, cacheName);
  capacity = capacity > 16 ? capacity : 16;
  this.set = new LightWeightCache<CacheEntry, CacheEntry>(capacity, capacity,
      expirationTime, 0);
  this.expirationTime = expirationTime;
  this.cacheName = cacheName;
  this.retryCacheMetrics =  RetryCacheMetrics.create(this);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:16,代码来源:RetryCache.java


示例7: newInstance

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
static INodeMap newInstance(INodeDirectory rootDir) {
  // Compute the map capacity by allocating 1% of total memory
  int capacity = LightWeightGSet.computeCapacity(1, "INodeMap");
  GSet<INode, INodeWithAdditionalFields> map =
      new LightWeightGSet<>(capacity);
  map.put(rootDir);
  return new INodeMap(map);
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:9,代码来源:INodeMap.java


示例8: RetryCache

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
/**
 * Constructor
 * @param cacheName name to identify the cache by
 * @param percentage percentage of total java heap space used by this cache
 * @param expirationTime time for an entry to expire in nanoseconds
 */
public RetryCache(String cacheName, double percentage, long expirationTime) {
  int capacity = LightWeightGSet.computeCapacity(percentage, cacheName);
  capacity = capacity > 16 ? capacity : 16;
  this.set = new LightWeightCache<CacheEntry, CacheEntry>(capacity, capacity,
      expirationTime, 0);
  this.expirationTime = expirationTime;
}
 
开发者ID:ict-carch,项目名称:hadoop-plus,代码行数:14,代码来源:RetryCache.java


示例9: CacheManager

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
CacheManager(FSNamesystem namesystem, Configuration conf,
    BlockManager blockManager) {
  this.namesystem = namesystem;
  this.blockManager = blockManager;
  this.nextDirectiveId = 1;
  this.maxListCachePoolsResponses = conf.getInt(
      DFS_NAMENODE_LIST_CACHE_POOLS_NUM_RESPONSES,
      DFS_NAMENODE_LIST_CACHE_POOLS_NUM_RESPONSES_DEFAULT);
  this.maxListCacheDirectivesNumResponses = conf.getInt(
      DFS_NAMENODE_LIST_CACHE_DIRECTIVES_NUM_RESPONSES,
      DFS_NAMENODE_LIST_CACHE_DIRECTIVES_NUM_RESPONSES_DEFAULT);
  scanIntervalMs = conf.getLong(
      DFS_NAMENODE_PATH_BASED_CACHE_REFRESH_INTERVAL_MS,
      DFS_NAMENODE_PATH_BASED_CACHE_REFRESH_INTERVAL_MS_DEFAULT);
  float cachedBlocksPercent = conf.getFloat(
        DFS_NAMENODE_PATH_BASED_CACHE_BLOCK_MAP_ALLOCATION_PERCENT,
        DFS_NAMENODE_PATH_BASED_CACHE_BLOCK_MAP_ALLOCATION_PERCENT_DEFAULT);
  if (cachedBlocksPercent < MIN_CACHED_BLOCKS_PERCENT) {
    LOG.info("Using minimum value " + MIN_CACHED_BLOCKS_PERCENT +
      " for " + DFS_NAMENODE_PATH_BASED_CACHE_BLOCK_MAP_ALLOCATION_PERCENT);
    cachedBlocksPercent = MIN_CACHED_BLOCKS_PERCENT;
  }
  this.cachedBlocks = new LightWeightGSet<CachedBlock, CachedBlock>(
        LightWeightGSet.computeCapacity(cachedBlocksPercent,
            "cachedBlocks"));

}
 
开发者ID:Seagate,项目名称:hadoop-on-lustre2,代码行数:28,代码来源:CacheManager.java


示例10: getCacheSet

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
@VisibleForTesting
public LightWeightGSet<CacheEntry, CacheEntry> getCacheSet() {
  return set;
}
 
开发者ID:nucypher,项目名称:hadoop-oss,代码行数:5,代码来源:RetryCache.java


示例11: getNext

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
@Override
public LightWeightGSet.LinkedElement getNext() {
  return nextLinkedElement;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:5,代码来源:BlockInfoContiguous.java


示例12: setNext

import org.apache.hadoop.util.LightWeightGSet; //导入依赖的package包/类
@Override
public void setNext(LightWeightGSet.LinkedElement next) {
  this.nextLinkedElement = next;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:5,代码来源:BlockInfoContiguous.java



注:本文中的org.apache.hadoop.util.LightWeightGSet类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java CassandraOperations类代码示例发布时间:2022-05-22
下一篇:
Java SlabCache类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap