• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java StoreConfigInformation类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.hbase.regionserver.StoreConfigInformation的典型用法代码示例。如果您正苦于以下问题:Java StoreConfigInformation类的具体用法?Java StoreConfigInformation怎么用?Java StoreConfigInformation使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



StoreConfigInformation类属于org.apache.hadoop.hbase.regionserver包,在下文中一共展示了StoreConfigInformation类的16个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: CompactionConfiguration

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
CompactionConfiguration(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.conf = conf;
  this.storeConfigInfo = storeConfigInfo;

  maxCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MAX_SIZE_KEY, Long.MAX_VALUE);
  offPeakMaxCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MAX_SIZE_OFFPEAK_KEY, 
    maxCompactSize);      
  minCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MIN_SIZE_KEY,
      storeConfigInfo.getMemstoreFlushSize());
  minFilesToCompact = Math.max(2, conf.getInt(HBASE_HSTORE_COMPACTION_MIN_KEY,
        /*old name*/ conf.getInt("hbase.hstore.compactionThreshold", 3)));
  maxFilesToCompact = conf.getInt(HBASE_HSTORE_COMPACTION_MAX_KEY, 10);
  compactionRatio = conf.getFloat(HBASE_HSTORE_COMPACTION_RATIO_KEY, 1.2F);
  offPeakCompactionRatio = conf.getFloat(HBASE_HSTORE_COMPACTION_RATIO_OFFPEAK_KEY, 5.0F);

  throttlePoint = conf.getLong("hbase.regionserver.thread.compaction.throttle",
        2 * maxFilesToCompact * storeConfigInfo.getMemstoreFlushSize());
  majorCompactionPeriod = conf.getLong(HConstants.MAJOR_COMPACTION_PERIOD, 1000*60*60*24*7);
  // Make it 0.5 so jitter has us fall evenly either side of when the compaction should run
  majorCompactionJitter = conf.getFloat("hbase.hregion.majorcompaction.jitter", 0.50F);
  minLocalityToForceCompact = conf.getFloat(HBASE_HSTORE_MIN_LOCALITY_TO_SKIP_MAJOR_COMPACT, 0f);
  LOG.info(this);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:24,代码来源:CompactionConfiguration.java


示例2: CompactionConfiguration

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
CompactionConfiguration(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.conf = conf;
  this.storeConfigInfo = storeConfigInfo;

  maxCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MAX_SIZE_KEY, Long.MAX_VALUE);
  minCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MIN_SIZE_KEY,
      storeConfigInfo.getMemstoreFlushSize());
  minFilesToCompact = Math.max(2, conf.getInt(HBASE_HSTORE_COMPACTION_MIN_KEY,
        /*old name*/ conf.getInt("hbase.hstore.compactionThreshold", 3)));
  maxFilesToCompact = conf.getInt(HBASE_HSTORE_COMPACTION_MAX_KEY, 10);
  compactionRatio = conf.getFloat(HBASE_HSTORE_COMPACTION_RATIO_KEY, 1.2F);
  offPeakCompactionRatio = conf.getFloat(HBASE_HSTORE_COMPACTION_RATIO_OFFPEAK_KEY, 5.0F);

  throttlePoint = conf.getLong("hbase.regionserver.thread.compaction.throttle",
        2 * maxFilesToCompact * storeConfigInfo.getMemstoreFlushSize());
  majorCompactionPeriod = conf.getLong(HConstants.MAJOR_COMPACTION_PERIOD, 1000*60*60*24*7);
  // Make it 0.5 so jitter has us fall evenly either side of when the compaction should run
  majorCompactionJitter = conf.getFloat("hbase.hregion.majorcompaction.jitter", 0.50F);
  minLocalityToForceCompact = conf.getFloat(HBASE_HSTORE_MIN_LOCALITY_TO_SKIP_MAJOR_COMPACT, 0f);
  LOG.info(this);
}
 
开发者ID:grokcoder,项目名称:pbase,代码行数:22,代码来源:CompactionConfiguration.java


示例3: CompactionConfiguration

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
CompactionConfiguration(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.conf = conf;
  this.storeConfigInfo = storeConfigInfo;

  maxCompactSize = conf.getLong(CONFIG_PREFIX + "max.size", Long.MAX_VALUE);
  minCompactSize = conf.getLong(CONFIG_PREFIX + "min.size",
      storeConfigInfo.getMemstoreFlushSize());
  minFilesToCompact = Math.max(2, conf.getInt(MIN_KEY,
        /*old name*/ conf.getInt("hbase.hstore.compactionThreshold", 3)));
  maxFilesToCompact = conf.getInt(MAX_KEY, 10);
  compactionRatio = conf.getFloat(RATIO_KEY, 1.2F);
  offPeekCompactionRatio = conf.getFloat(CONFIG_PREFIX + "ratio.offpeak", 5.0F);

  throttlePoint =  conf.getLong("hbase.regionserver.thread.compaction.throttle",
        2 * maxFilesToCompact * storeConfigInfo.getMemstoreFlushSize());
  shouldDeleteExpired = conf.getBoolean("hbase.store.delete.expired.storefile", true);
  majorCompactionPeriod = conf.getLong(HConstants.MAJOR_COMPACTION_PERIOD, 1000*60*60*24*7);
  // Make it 0.5 so jitter has us fall evenly either side of when the compaction should run
  majorCompactionJitter = conf.getFloat("hbase.hregion.majorcompaction.jitter", 0.50F);

  LOG.info(this);
}
 
开发者ID:tenggyut,项目名称:HIndex,代码行数:23,代码来源:CompactionConfiguration.java


示例4: CompactionConfiguration

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
CompactionConfiguration(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.conf = conf;
  this.storeConfigInfo = storeConfigInfo;

  maxCompactSize = conf.getLong(CONFIG_PREFIX + "max.size", Long.MAX_VALUE);
  minCompactSize = conf.getLong(CONFIG_PREFIX + "min.size",
      storeConfigInfo.getMemstoreFlushSize());
  minFilesToCompact = Math.max(2, conf.getInt(MIN_KEY,
        /*old name*/ conf.getInt("hbase.hstore.compactionThreshold", 3)));
  maxFilesToCompact = conf.getInt(MAX_KEY, 10);
  compactionRatio = conf.getFloat(RATIO_KEY, 1.2F);
  offPeekCompactionRatio = conf.getFloat(CONFIG_PREFIX + "ratio.offpeak", 5.0F);

  throttlePoint =  conf.getLong("hbase.regionserver.thread.compaction.throttle",
        2 * maxFilesToCompact * storeConfigInfo.getMemstoreFlushSize());
  majorCompactionPeriod = conf.getLong(HConstants.MAJOR_COMPACTION_PERIOD, 1000*60*60*24*7);
  // Make it 0.5 so jitter has us fall evenly either side of when the compaction should run
  majorCompactionJitter = conf.getFloat("hbase.hregion.majorcompaction.jitter", 0.50F);

  LOG.info(this);
}
 
开发者ID:shenli-uiuc,项目名称:PyroDB,代码行数:22,代码来源:CompactionConfiguration.java


示例5: CompactionConfiguration

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
CompactionConfiguration(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.conf = conf;
  this.storeConfigInfo = storeConfigInfo;

  maxCompactSize = conf.getLong(CONFIG_PREFIX + "max.size", Long.MAX_VALUE);
  minCompactSize = conf.getLong(CONFIG_PREFIX + "min.size",
      storeConfigInfo.getMemstoreFlushSize());
  minFilesToCompact = Math.max(2, conf.getInt(CONFIG_PREFIX + "min",
        /*old name*/ conf.getInt("hbase.hstore.compactionThreshold", 3)));
  maxFilesToCompact = conf.getInt(CONFIG_PREFIX + "max", 10);
  compactionRatio = conf.getFloat(CONFIG_PREFIX + "ratio", 1.2F);
  offPeekCompactionRatio = conf.getFloat(CONFIG_PREFIX + "ratio.offpeak", 5.0F);

  throttlePoint =  conf.getLong("hbase.regionserver.thread.compaction.throttle",
        2 * maxFilesToCompact * storeConfigInfo.getMemstoreFlushSize());
  shouldDeleteExpired = conf.getBoolean("hbase.store.delete.expired.storefile", true);
  majorCompactionPeriod = conf.getLong(HConstants.MAJOR_COMPACTION_PERIOD, 1000*60*60*24*7);
  // Make it 0.5 so jitter has us fall evenly either side of when the compaction should run
  majorCompactionJitter = conf.getFloat("hbase.hregion.majorcompaction.jitter", 0.50F);

  LOG.info(this);
}
 
开发者ID:cloud-software-foundation,项目名称:c5,代码行数:23,代码来源:CompactionConfiguration.java


示例6: createPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
private static StripeCompactionPolicy createPolicy(Configuration conf,
    long splitSize, float splitCount, int initialCount, boolean hasTtl) throws Exception {
  conf.setLong(StripeStoreConfig.SIZE_TO_SPLIT_KEY, splitSize);
  conf.setFloat(StripeStoreConfig.SPLIT_PARTS_KEY, splitCount);
  conf.setInt(StripeStoreConfig.INITIAL_STRIPE_COUNT_KEY, initialCount);
  StoreConfigInformation sci = mock(StoreConfigInformation.class);
  when(sci.getStoreFileTtl()).thenReturn(hasTtl ? defaultTtl : Long.MAX_VALUE);
  StripeStoreConfig ssc = new StripeStoreConfig(conf, sci);
  return new StripeCompactionPolicy(conf, sci, ssc);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:11,代码来源:TestStripeCompactionPolicy.java


示例7: PerfTestCompactionPolicies

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
/**
 * Test the perf of a CompactionPolicy with settings.
 * @param cpClass The compaction policy to test
 * @param inMmax The maximum number of file to compact
 * @param inMin The min number of files to compact
 * @param inRatio The ratio that files must be under to be compacted.
 */
public PerfTestCompactionPolicies(
    final Class<? extends CompactionPolicy> cpClass,
    final Class<? extends StoreFileListGenerator> fileGenClass,
    final int inMmax,
    final int inMin,
    final float inRatio) throws IllegalAccessException, InstantiationException {
  super(PerfTestCompactionPolicies.class);
  this.fileGenClass = fileGenClass;
  this.max = inMmax;
  this.min = inMin;
  this.ratio = inRatio;

  // Hide lots of logging so the system out is usable as a tab delimited file.
  org.apache.log4j.Logger.getLogger(CompactionConfiguration.class).
      setLevel(org.apache.log4j.Level.ERROR);
  org.apache.log4j.Logger.getLogger(RatioBasedCompactionPolicy.class).
      setLevel(org.apache.log4j.Level.ERROR);

  org.apache.log4j.Logger.getLogger(cpClass).setLevel(org.apache.log4j.Level.ERROR);


  Configuration configuration = HBaseConfiguration.create();

  // Make sure that this doesn't include every file.
  configuration.setInt("hbase.hstore.compaction.max", max);
  configuration.setInt("hbase.hstore.compaction.min", min);
  configuration.setFloat("hbase.hstore.compaction.ratio", ratio);

  store = createMockStore();
  this.cp = ReflectionUtils.instantiateWithCustomCtor(cpClass.getName(),
      new Class[] {Configuration.class, StoreConfigInformation.class },
      new Object[] {configuration, store });

  this.generator = fileGenClass.newInstance();
  // Used for making paths
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:44,代码来源:PerfTestCompactionPolicies.java


示例8: CompactionConfiguration

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
CompactionConfiguration(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.conf = conf;
  this.storeConfigInfo = storeConfigInfo;

  maxCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MAX_SIZE_KEY, Long.MAX_VALUE);
  offPeakMaxCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MAX_SIZE_OFFPEAK_KEY,
    maxCompactSize);
  minCompactSize = conf.getLong(HBASE_HSTORE_COMPACTION_MIN_SIZE_KEY,
      storeConfigInfo.getMemStoreFlushSize());
  minFilesToCompact = Math.max(2, conf.getInt(HBASE_HSTORE_COMPACTION_MIN_KEY,
        /*old name*/ conf.getInt("hbase.hstore.compactionThreshold", 3)));
  maxFilesToCompact = conf.getInt(HBASE_HSTORE_COMPACTION_MAX_KEY, 10);
  compactionRatio = conf.getFloat(HBASE_HSTORE_COMPACTION_RATIO_KEY, 1.2F);
  offPeakCompactionRatio = conf.getFloat(HBASE_HSTORE_COMPACTION_RATIO_OFFPEAK_KEY, 5.0F);

  throttlePoint = conf.getLong("hbase.regionserver.thread.compaction.throttle",
        2 * maxFilesToCompact * storeConfigInfo.getMemStoreFlushSize());
  majorCompactionPeriod = conf.getLong(HConstants.MAJOR_COMPACTION_PERIOD,
                                       HConstants.DEFAULT_MAJOR_COMPACTION_PERIOD);
  majorCompactionJitter = conf.getFloat(HConstants.MAJOR_COMPACTION_JITTER,
                                        HConstants.DEFAULT_MAJOR_COMPACTION_JITTER);
  minLocalityToForceCompact = conf.getFloat(HBASE_HSTORE_MIN_LOCALITY_TO_SKIP_MAJOR_COMPACT, 0f);

  dateTieredMaxStoreFileAgeMillis = conf.getLong(DATE_TIERED_MAX_AGE_MILLIS_KEY, Long.MAX_VALUE);
  dateTieredIncomingWindowMin = conf.getInt(DATE_TIERED_INCOMING_WINDOW_MIN_KEY, 6);
  compactionPolicyForDateTieredWindow = conf.get(
    COMPACTION_POLICY_CLASS_FOR_DATE_TIERED_WINDOWS_KEY,
    DEFAULT_COMPACTION_POLICY_CLASS_FOR_DATE_TIERED_WINDOWS.getName());
  dateTieredSingleOutputForMinorCompaction = conf
      .getBoolean(DATE_TIERED_SINGLE_OUTPUT_FOR_MINOR_COMPACTION_KEY, true);
  this.dateTieredCompactionWindowFactory = conf.get(
    DATE_TIERED_COMPACTION_WINDOW_FACTORY_CLASS_KEY,
    DEFAULT_DATE_TIERED_COMPACTION_WINDOW_FACTORY_CLASS.getName());
  LOG.info(toString());
}
 
开发者ID:apache,项目名称:hbase,代码行数:36,代码来源:CompactionConfiguration.java


示例9: PerfTestCompactionPolicies

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
/**
 * Test the perf of a CompactionPolicy with settings.
 * @param cpClass The compaction policy to test
 * @param inMmax The maximum number of file to compact
 * @param inMin The min number of files to compact
 * @param inRatio The ratio that files must be under to be compacted.
 */
public PerfTestCompactionPolicies(
    final Class<? extends CompactionPolicy> cpClass,
    final Class<? extends StoreFileListGenerator> fileGenClass,
    final int inMmax,
    final int inMin,
    final float inRatio) throws IllegalAccessException, InstantiationException,
    NoSuchMethodException, InvocationTargetException {
  super(PerfTestCompactionPolicies.class);
  this.fileGenClass = fileGenClass;
  this.max = inMmax;
  this.min = inMin;
  this.ratio = inRatio;

  // Hide lots of logging so the system out is usable as a tab delimited file.
  org.apache.log4j.Logger.getLogger(CompactionConfiguration.class).
      setLevel(org.apache.log4j.Level.ERROR);
  org.apache.log4j.Logger.getLogger(RatioBasedCompactionPolicy.class).
      setLevel(org.apache.log4j.Level.ERROR);

  org.apache.log4j.Logger.getLogger(cpClass).setLevel(org.apache.log4j.Level.ERROR);


  Configuration configuration = HBaseConfiguration.create();

  // Make sure that this doesn't include every file.
  configuration.setInt("hbase.hstore.compaction.max", max);
  configuration.setInt("hbase.hstore.compaction.min", min);
  configuration.setFloat("hbase.hstore.compaction.ratio", ratio);

  store = createMockStore();
  this.cp = ReflectionUtils.instantiateWithCustomCtor(cpClass.getName(),
      new Class[] {Configuration.class, StoreConfigInformation.class },
      new Object[] {configuration, store });

  this.generator = fileGenClass.getDeclaredConstructor().newInstance();
  // Used for making paths
}
 
开发者ID:apache,项目名称:hbase,代码行数:45,代码来源:PerfTestCompactionPolicies.java


示例10: CompactionPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
public CompactionPolicy(Configuration conf, StoreConfigInformation storeConfigInfo) {
  this.storeConfigInfo = storeConfigInfo;
  this.comConf = new CompactionConfiguration(conf, this.storeConfigInfo);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:5,代码来源:CompactionPolicy.java


示例11: FIFOCompactionPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
public FIFOCompactionPolicy(Configuration conf, StoreConfigInformation storeConfigInfo) {
  super(conf, storeConfigInfo);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:4,代码来源:FIFOCompactionPolicy.java


示例12: RatioBasedCompactionPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
public RatioBasedCompactionPolicy(Configuration conf,
                                  StoreConfigInformation storeConfigInfo) {
  super(conf, storeConfigInfo);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:5,代码来源:RatioBasedCompactionPolicy.java


示例13: StripeCompactionPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
public StripeCompactionPolicy(
    Configuration conf, StoreConfigInformation storeConfigInfo, StripeStoreConfig config) {
  super(conf, storeConfigInfo);
  this.config = config;
  stripePolicy = new ExploringCompactionPolicy(conf, storeConfigInfo);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:7,代码来源:StripeCompactionPolicy.java


示例14: SortedCompactionPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
public SortedCompactionPolicy(Configuration conf, StoreConfigInformation storeConfigInfo) {
  super(conf, storeConfigInfo);
}
 
开发者ID:apache,项目名称:hbase,代码行数:4,代码来源:SortedCompactionPolicy.java


示例15: ExploringCompactionPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
/**
 * Constructor for ExploringCompactionPolicy.
 * @param conf The configuration object
 * @param storeConfigInfo An object to provide info about the store.
 */
public ExploringCompactionPolicy(final Configuration conf,
                                 final StoreConfigInformation storeConfigInfo) {
  super(conf, storeConfigInfo);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:10,代码来源:ExploringCompactionPolicy.java


示例16: EverythingPolicy

import org.apache.hadoop.hbase.regionserver.StoreConfigInformation; //导入依赖的package包/类
/**
 * Constructor.
 *
 * @param conf            The Conf.
 * @param storeConfigInfo Info about the store.
 */
public EverythingPolicy(final Configuration conf,
                        final StoreConfigInformation storeConfigInfo) {
  super(conf, storeConfigInfo);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:11,代码来源:EverythingPolicy.java



注:本文中的org.apache.hadoop.hbase.regionserver.StoreConfigInformation类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java WSDLPortType类代码示例发布时间:2022-05-23
下一篇:
Java VfsFileChooserDialog类代码示例发布时间:2022-05-23
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap