Java InvalidHFileException类代码示例

OStack程序员社区-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中org.apache.hadoop.hbase.io.hfile.InvalidHFileException类的典型用法代码示例。如果您正苦于以下问题：Java InvalidHFileException类的具体用法？Java InvalidHFileException怎么用？Java InvalidHFileException使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

InvalidHFileException类属于org.apache.hadoop.hbase.io.hfile包，在下文中一共展示了InvalidHFileException类的9个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
@Override public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader = null;
  try {
    LOG.info(
        "Validating hfile at " + srcPath + " for inclusion in " + "store " + this + " region "
            + this.getRegionInfo().getRegionNameAsString());
    reader = HFile.createReader(srcPath.getFileSystem(conf), srcPath, cacheConf, conf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    Preconditions.checkState(firstKey != null, "First key can not be null");
    byte[] lk = reader.getLastKey();
    Preconditions.checkState(lk != null, "Last key can not be null");
    byte[] lastKey = KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) + " last=" + Bytes
        .toStringBinary(lastKey));
    LOG.debug(
        "Region bounds: first=" + Bytes.toStringBinary(getRegionInfo().getStartKey()) + " last="
            + Bytes.toStringBinary(getRegionInfo().getEndKey()));

    if (!this.getRegionInfo().containsRange(firstKey, lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region " + this
              .getRegionInfo().getRegionNameAsString());
    }

    if (reader.length() > conf
        .getLong(HConstants.HREGION_MAX_FILESIZE, HConstants.DEFAULT_MAX_FILE_SIZE)) {
      LOG.warn(
          "Trying to bulk load hfile " + srcPath.toString() + " with size: " + reader.length()
              + " bytes can be problematic as it may lead to oversplitting.");
    }

    if (verifyBulkLoads) {
      long verificationStartTime = EnvironmentEdgeManager.currentTime();
      LOG.info("Full verification started for bulk load hfile: " + srcPath.toString());
      Cell prevCell = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        Cell cell = scanner.getKeyValue();
        if (prevCell != null) {
          if (CellComparator.compareRows(prevCell, cell) > 0) {
            throw new InvalidHFileException(
                "Previous row is greater than" + " current row: path=" + srcPath + " previous="
                    + CellUtil.getCellKeyAsString(prevCell) + " current=" + CellUtil
                    .getCellKeyAsString(cell));
          }
          if (CellComparator.compareFamilies(prevCell, cell) != 0) {
            throw new InvalidHFileException(
                "Previous key had different" + " family compared to current key: path=" + srcPath
                    + " previous=" + Bytes
                    .toStringBinary(prevCell.getFamilyArray(), prevCell.getFamilyOffset(),
                        prevCell.getFamilyLength()) + " current=" + Bytes
                    .toStringBinary(cell.getFamilyArray(), cell.getFamilyOffset(),
                        cell.getFamilyLength()));
          }
        }
        prevCell = cell;
      } while (scanner.next());
      LOG.info(
          "Full verification complete for bulk load hfile: " + srcPath.toString() + " took " + (
              EnvironmentEdgeManager.currentTime() - verificationStartTime) + " ms");
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:fengchen8086，项目名称:ditb，代码行数:70，代码来源:HStore.java

示例2: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
/**
 * This throws a WrongRegionException if the HFile does not fit in this region, or an
 * InvalidHFileException if the HFile is not valid.
 */
void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in " + "store " + this
        + " region " + this.region);
    reader = HFile.createReader(srcPath.getFileSystem(conf), srcPath, cacheConf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    byte[] lk = reader.getLastKey();
    byte[] lastKey = (lk == null) ? null : KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) + " last="
        + Bytes.toStringBinary(lastKey));
    LOG.debug("Region bounds: first=" + Bytes.toStringBinary(region.getStartKey()) + " last="
        + Bytes.toStringBinary(region.getEndKey()));

    HRegionInfo hri = region.getRegionInfo();
    if (!hri.containsRange(firstKey, lastKey)) {
      throw new WrongRegionException("Bulk load file " + srcPath.toString()
          + " does not fit inside region " + this.region);
    }

    if (verifyBulkLoads) {
      KeyValue prevKV = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        KeyValue kv = scanner.getKeyValue();
        if (prevKV != null) {
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getRowOffset(), prevKV.getRowLength(),
            kv.getBuffer(), kv.getRowOffset(), kv.getRowLength()) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + Bytes.toStringBinary(prevKV.getKey()) + " current="
                + Bytes.toStringBinary(kv.getKey()));
          }
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getFamilyOffset(),
            prevKV.getFamilyLength(), kv.getBuffer(), kv.getFamilyOffset(), kv.getFamilyLength()) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath + " previous="
                + Bytes.toStringBinary(prevKV.getFamily()) + " current="
                + Bytes.toStringBinary(kv.getFamily()));
          }
        }
        prevKV = kv;
      } while (scanner.next());
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:fengchen8086，项目名称:LCIndex-HBase-0.94.16，代码行数:57，代码来源:Store.java

示例3: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
@Override
public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
    HFile.Reader reader = null;
    try {
        LOG.info("Validating hfile at " + srcPath + " for inclusion in "
                + "store " + this + " region " + this.getRegionInfo().getRegionNameAsString());
        reader = HFile.createReader(srcPath.getFileSystem(conf),
                srcPath, cacheConf, conf);
        reader.loadFileInfo();

        byte[] firstKey = reader.getFirstRowKey();
        Preconditions.checkState(firstKey != null, "First key can not be null");
        byte[] lk = reader.getLastKey();
        Preconditions.checkState(lk != null, "Last key can not be null");
        byte[] lastKey = KeyValue.createKeyValueFromKey(lk).getRow();

        LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) +
                " last=" + Bytes.toStringBinary(lastKey));
        LOG.debug("Region bounds: first=" +
                Bytes.toStringBinary(getRegionInfo().getStartKey()) +
                " last=" + Bytes.toStringBinary(getRegionInfo().getEndKey()));

        if (!this.getRegionInfo().containsRange(firstKey, lastKey)) {
            throw new WrongRegionException(
                    "Bulk load file " + srcPath.toString() + " does not fit inside region "
                            + this.getRegionInfo().getRegionNameAsString());
        }

        if (reader.length() > conf.getLong(HConstants.HREGION_MAX_FILESIZE,
                HConstants.DEFAULT_MAX_FILE_SIZE)) {
            LOG.warn("Trying to bulk load hfile " + srcPath.toString() + " with size: " +
                    reader.length() + " bytes can be problematic as it may lead to oversplitting.");
        }

        if (verifyBulkLoads) {
            long verificationStartTime = EnvironmentEdgeManager.currentTime();
            LOG.info("Full verification started for bulk load hfile: " + srcPath.toString());
            Cell prevCell = null;
            HFileScanner scanner = reader.getScanner(false, false, false);
            scanner.seekTo();
            do {
                Cell cell = scanner.getKeyValue();
                if (prevCell != null) {
                    if (CellComparator.compareRows(prevCell, cell) > 0) {
                        throw new InvalidHFileException("Previous row is greater than"
                                + " current row: path=" + srcPath + " previous="
                                + CellUtil.getCellKeyAsString(prevCell) + " current="
                                + CellUtil.getCellKeyAsString(cell));
                    }
                    if (CellComparator.compareFamilies(prevCell, cell) != 0) {
                        throw new InvalidHFileException("Previous key had different"
                                + " family compared to current key: path=" + srcPath
                                + " previous="
                                + Bytes.toStringBinary(prevCell.getFamilyArray(), prevCell.getFamilyOffset(),
                                prevCell.getFamilyLength())
                                + " current="
                                + Bytes.toStringBinary(cell.getFamilyArray(), cell.getFamilyOffset(),
                                cell.getFamilyLength()));
                    }
                }
                prevCell = cell;
            } while (scanner.next());
            LOG.info("Full verification complete for bulk load hfile: " + srcPath.toString()
                    + " took " + (EnvironmentEdgeManager.currentTime() - verificationStartTime)
                    + " ms");
        }
    } finally {
        if (reader != null) reader.close();
    }
}

开发者ID:grokcoder，项目名称:pbase，代码行数:71，代码来源:HStore.java

示例4: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
@Override
public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader  = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in "
        + "store " + this + " region " + this.getRegionInfo().getRegionNameAsString());
    reader = HFile.createReader(srcPath.getFileSystem(conf),
        srcPath, cacheConf, conf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    Preconditions.checkState(firstKey != null, "First key can not be null");
    byte[] lk = reader.getLastKey();
    Preconditions.checkState(lk != null, "Last key can not be null");
    byte[] lastKey =  KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) +
        " last=" + Bytes.toStringBinary(lastKey));
    LOG.debug("Region bounds: first=" +
        Bytes.toStringBinary(getRegionInfo().getStartKey()) +
        " last=" + Bytes.toStringBinary(getRegionInfo().getEndKey()));

    if (!this.getRegionInfo().containsRange(firstKey, lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region "
          + this.getRegionInfo().getRegionNameAsString());
    }

    if (verifyBulkLoads) {
      KeyValue prevKV = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        KeyValue kv = scanner.getKeyValue();
        if (prevKV != null) {
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getRowOffset(),
              prevKV.getRowLength(), kv.getBuffer(), kv.getRowOffset(),
              kv.getRowLength()) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + Bytes.toStringBinary(prevKV.getKey()) + " current="
                + Bytes.toStringBinary(kv.getKey()));
          }
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getFamilyOffset(),
              prevKV.getFamilyLength(), kv.getBuffer(), kv.getFamilyOffset(),
              kv.getFamilyLength()) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath
                + " previous=" + Bytes.toStringBinary(prevKV.getFamily())
                + " current=" + Bytes.toStringBinary(kv.getFamily()));
          }
        }
        prevKV = kv;
      } while (scanner.next());
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:tenggyut，项目名称:HIndex，代码行数:60，代码来源:HStore.java

示例5: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
/**
 * This throws a WrongRegionException if the HFile does not fit in this
 * region, or an InvalidHFileException if the HFile is not valid.
 */
void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader  = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in "
        + "store " + this + " region " + this.region);
    reader = HFile.createReader(srcPath.getFileSystem(conf),
        srcPath, cacheConf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    byte[] lk = reader.getLastKey();
    byte[] lastKey =
        (lk == null) ? null :
            KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) +
        " last=" + Bytes.toStringBinary(lastKey));
    LOG.debug("Region bounds: first=" +
        Bytes.toStringBinary(region.getStartKey()) +
        " last=" + Bytes.toStringBinary(region.getEndKey()));

    HRegionInfo hri = region.getRegionInfo();
    if (!hri.containsRange(firstKey, lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region "
          + this.region);
    }

    if (verifyBulkLoads) {
      KeyValue prevKV = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        KeyValue kv = scanner.getKeyValue();
        if (prevKV != null) {
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getRowOffset(),
              prevKV.getRowLength(), kv.getBuffer(), kv.getRowOffset(),
              kv.getRowLength()) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + Bytes.toStringBinary(prevKV.getKey()) + " current="
                + Bytes.toStringBinary(kv.getKey()));
          }
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getFamilyOffset(),
              prevKV.getFamilyLength(), kv.getBuffer(), kv.getFamilyOffset(),
              kv.getFamilyLength()) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath
                + " previous=" + Bytes.toStringBinary(prevKV.getFamily())
                + " current=" + Bytes.toStringBinary(kv.getFamily()));
          }
        }
        prevKV = kv;
      } while (scanner.next());
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:wanhao，项目名称:IRIndex，代码行数:64，代码来源:Store.java

示例6: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
/**
 * This throws a WrongRegionException if the HFile does not fit in this region, or an
 * InvalidHFileException if the HFile is not valid.
 */
public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader  = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in "
        + "store " + this + " region " + this.getRegionInfo().getRegionNameAsString());
    reader = HFile.createReader(srcPath.getFileSystem(conf), srcPath, cacheConf,
      isPrimaryReplicaStore(), conf);
    reader.loadFileInfo();

    Optional<byte[]> firstKey = reader.getFirstRowKey();
    Preconditions.checkState(firstKey.isPresent(), "First key can not be null");
    Optional<Cell> lk = reader.getLastKey();
    Preconditions.checkState(lk.isPresent(), "Last key can not be null");
    byte[] lastKey =  CellUtil.cloneRow(lk.get());

    if (LOG.isDebugEnabled()) {
      LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey.get()) +
          " last=" + Bytes.toStringBinary(lastKey));
      LOG.debug("Region bounds: first=" +
          Bytes.toStringBinary(getRegionInfo().getStartKey()) +
          " last=" + Bytes.toStringBinary(getRegionInfo().getEndKey()));
    }

    if (!this.getRegionInfo().containsRange(firstKey.get(), lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region "
          + this.getRegionInfo().getRegionNameAsString());
    }

    if(reader.length() > conf.getLong(HConstants.HREGION_MAX_FILESIZE,
        HConstants.DEFAULT_MAX_FILE_SIZE)) {
      LOG.warn("Trying to bulk load hfile " + srcPath + " with size: " +
          reader.length() + " bytes can be problematic as it may lead to oversplitting.");
    }

    if (verifyBulkLoads) {
      long verificationStartTime = EnvironmentEdgeManager.currentTime();
      LOG.info("Full verification started for bulk load hfile: {}", srcPath);
      Cell prevCell = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        Cell cell = scanner.getCell();
        if (prevCell != null) {
          if (comparator.compareRows(prevCell, cell) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + CellUtil.getCellKeyAsString(prevCell) + " current="
                + CellUtil.getCellKeyAsString(cell));
          }
          if (CellComparator.getInstance().compareFamilies(prevCell, cell) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath
                + " previous="
                + Bytes.toStringBinary(prevCell.getFamilyArray(), prevCell.getFamilyOffset(),
                    prevCell.getFamilyLength())
                + " current="
                + Bytes.toStringBinary(cell.getFamilyArray(), cell.getFamilyOffset(),
                    cell.getFamilyLength()));
          }
        }
        prevCell = cell;
      } while (scanner.next());
    LOG.info("Full verification complete for bulk load hfile: " + srcPath.toString()
       + " took " + (EnvironmentEdgeManager.currentTime() - verificationStartTime)
       + " ms");
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:apache，项目名称:hbase，代码行数:76，代码来源:HStore.java

示例7: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
@Override
public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader  = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in "
        + "store " + this + " region " + this.getRegionInfo().getRegionNameAsString());
    reader = HFile.createReader(srcPath.getFileSystem(conf),
        srcPath, cacheConf, conf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    Preconditions.checkState(firstKey != null, "First key can not be null");
    byte[] lk = reader.getLastKey();
    Preconditions.checkState(lk != null, "Last key can not be null");
    byte[] lastKey =  KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) +
        " last=" + Bytes.toStringBinary(lastKey));
    LOG.debug("Region bounds: first=" +
        Bytes.toStringBinary(getRegionInfo().getStartKey()) +
        " last=" + Bytes.toStringBinary(getRegionInfo().getEndKey()));

    if (!this.getRegionInfo().containsRange(firstKey, lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region "
          + this.getRegionInfo().getRegionNameAsString());
    }

    if (verifyBulkLoads) {
      Cell prevKV = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        Cell kv = scanner.getKeyValue();
        if (prevKV != null) {
          if (Bytes.compareTo(prevKV.getRowArray(), prevKV.getRowOffset(),
              prevKV.getRowLength(), kv.getRowArray(), kv.getRowOffset(),
              kv.getRowLength()) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + Bytes.toStringBinary(KeyValueUtil.ensureKeyValue(prevKV).getKey()) + " current="
                + Bytes.toStringBinary(KeyValueUtil.ensureKeyValue(kv).getKey()));
          }
          if (Bytes.compareTo(prevKV.getFamilyArray(), prevKV.getFamilyOffset(),
              prevKV.getFamilyLength(), kv.getFamilyArray(), kv.getFamilyOffset(),
              kv.getFamilyLength()) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath
                + " previous=" + Bytes.toStringBinary(prevKV.getFamily())
                + " current=" + Bytes.toStringBinary(kv.getFamily()));
          }
        }
        prevKV = kv;
      } while (scanner.next());
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:shenli-uiuc，项目名称:PyroDB，代码行数:60，代码来源:HStore.java

示例8: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
@Override
public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader  = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in "
        + "store " + this + " region " + this.getRegionInfo().getRegionNameAsString());
    reader = HFile.createReader(srcPath.getFileSystem(conf),
        srcPath, cacheConf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    Preconditions.checkState(firstKey != null, "First key can not be null");
    byte[] lk = reader.getLastKey();
    Preconditions.checkState(lk != null, "Last key can not be null");
    byte[] lastKey =  KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) +
        " last=" + Bytes.toStringBinary(lastKey));
    LOG.debug("Region bounds: first=" +
        Bytes.toStringBinary(getRegionInfo().getStartKey()) +
        " last=" + Bytes.toStringBinary(getRegionInfo().getEndKey()));

    if (!this.getRegionInfo().containsRange(firstKey, lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region "
          + this.getRegionInfo().getRegionNameAsString());
    }

    if (verifyBulkLoads) {
      KeyValue prevKV = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        KeyValue kv = scanner.getKeyValue();
        if (prevKV != null) {
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getRowOffset(),
              prevKV.getRowLength(), kv.getBuffer(), kv.getRowOffset(),
              kv.getRowLength()) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + Bytes.toStringBinary(prevKV.getKey()) + " current="
                + Bytes.toStringBinary(kv.getKey()));
          }
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getFamilyOffset(),
              prevKV.getFamilyLength(), kv.getBuffer(), kv.getFamilyOffset(),
              kv.getFamilyLength()) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath
                + " previous=" + Bytes.toStringBinary(prevKV.getFamily())
                + " current=" + Bytes.toStringBinary(kv.getFamily()));
          }
        }
        prevKV = kv;
      } while (scanner.next());
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:cloud-software-foundation，项目名称:c5，代码行数:60，代码来源:HStore.java

示例9: assertBulkLoadHFileOk

import org.apache.hadoop.hbase.io.hfile.InvalidHFileException; //导入依赖的package包/类
@Override
public void assertBulkLoadHFileOk(Path srcPath) throws IOException {
  HFile.Reader reader  = null;
  try {
    LOG.info("Validating hfile at " + srcPath + " for inclusion in "
        + "store " + this + " region " + this.region);
    reader = HFile.createReader(srcPath.getFileSystem(conf),
        srcPath, cacheConf);
    reader.loadFileInfo();

    byte[] firstKey = reader.getFirstRowKey();
    Preconditions.checkState(firstKey != null, "First key can not be null");
    byte[] lk = reader.getLastKey();
    Preconditions.checkState(lk != null, "Last key can not be null");
    byte[] lastKey =  KeyValue.createKeyValueFromKey(lk).getRow();

    LOG.debug("HFile bounds: first=" + Bytes.toStringBinary(firstKey) +
        " last=" + Bytes.toStringBinary(lastKey));
    LOG.debug("Region bounds: first=" +
        Bytes.toStringBinary(region.getStartKey()) +
        " last=" + Bytes.toStringBinary(region.getEndKey()));

    HRegionInfo hri = region.getRegionInfo();
    if (!hri.containsRange(firstKey, lastKey)) {
      throw new WrongRegionException(
          "Bulk load file " + srcPath.toString() + " does not fit inside region "
          + this.region);
    }

    if (verifyBulkLoads) {
      KeyValue prevKV = null;
      HFileScanner scanner = reader.getScanner(false, false, false);
      scanner.seekTo();
      do {
        KeyValue kv = scanner.getKeyValue();
        if (prevKV != null) {
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getRowOffset(),
              prevKV.getRowLength(), kv.getBuffer(), kv.getRowOffset(),
              kv.getRowLength()) > 0) {
            throw new InvalidHFileException("Previous row is greater than"
                + " current row: path=" + srcPath + " previous="
                + Bytes.toStringBinary(prevKV.getKey()) + " current="
                + Bytes.toStringBinary(kv.getKey()));
          }
          if (Bytes.compareTo(prevKV.getBuffer(), prevKV.getFamilyOffset(),
              prevKV.getFamilyLength(), kv.getBuffer(), kv.getFamilyOffset(),
              kv.getFamilyLength()) != 0) {
            throw new InvalidHFileException("Previous key had different"
                + " family compared to current key: path=" + srcPath
                + " previous=" + Bytes.toStringBinary(prevKV.getFamily())
                + " current=" + Bytes.toStringBinary(kv.getFamily()));
          }
        }
        prevKV = kv;
      } while (scanner.next());
    }
  } finally {
    if (reader != null) reader.close();
  }
}

开发者ID:daidong，项目名称:DominoHBase，代码行数:61，代码来源:HStore.java

注：本文中的org.apache.hadoop.hbase.io.hfile.InvalidHFileException类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花

握手

雷人

路过

鸡蛋

该文章已有0人参与评论

请发表评论

全部评论

专题导读

More+

10-27 六六分期app的软件客服如何联系？(六六分期

11-06 可心卡盟:win10系统火狐flash插件崩溃怎么

11-06 亲亲特价:怎么删除回收站图标

11-06 济南大学虚拟社区:鲁大师节能降温的具体办

11-06 xlueops.exe:无线网络安装向导

11-06 女斗合众国:win7系统cf与主机连接不稳定怎

11-06 0xc000022-[cf烟雾头]cf怎么调烟雾头

11-06 qizideyouhuo:应用程序无法正常启动0xc0000

11-06 ipz-185:win7系统vcf文件怎么打开

11-06 傻哥蹦迪:win10系统s4怎么打开usb调试

11-06 八神浩树gtaste:回收站清空了怎么恢复

11-06 妖尾之黑色守护:win10系统电脑没有1440x900

11-06 校园至尊魔王小说:win7系统浏览网页时字体

11-06 女斗合众国:win10系统访问共享文件夹提示请

11-06 tokyo hot n0654:恢复win7系统默认字体一招

11-06 雨酷仙境:设置win7系统转移临时文件夹腾出

11-06 阿穆纳伊之杖:win7系统开始菜单在右边还原

11-06 tunespotting:win10系统火狐flash插件总是

11-06 甘尔葛分析师：计谋网站seo关键词暴涨有什

11-06 蔡贵霖: 计谋网站seo关键词暴涨有什么秘密

11-06 博益网首页:ao3网页版进入不了解决方法

11-06 漏斗子专栏: 网站数据分析小白易懂精华篇

11-06 见证双虹怎么做:win7系统开启telnet命令的

11-06 颾狐蝶蜋:系统资源不足无法完成请求的服务

11-06 国光中学校歌:提交网站到alexa查询详细步骤

11-06 西安有情天:静态网页和动态网页的区别

11-06 红木雅尚斋:外部链接构造对网站的好处

11-06 前官礼遇：防止域名劫持–增强域安全性的10

11-06 密传二转答案: 中文分词算法有哪些

11-06 金泉家园邮编:百度快照劫持的表现及应对方

Java ApplicationNotFoundException类代码示例发布时间：2022-05-21

Java InstanceStatus类代码示例发布时间：2022-05-21

剪的笔顺,诠释剪的笔画,认识剪的部首

1 六六分期app的软件客服如何联系？(六六分期

六六分期app的软件客服如何联系？不知道吗？加qq群【895510560】即可！标题：六六分期

阅读：19135|2023-10-27

2 可心卡盟:win10系统火狐flash插件崩溃怎么

今天小编告诉大家如何处理win10系统火狐flash插件总是崩溃的问题，可能很多用户都不知

阅读：9973|2022-11-06

3 亲亲特价:怎么删除回收站图标

今天小编告诉大家如何对win10系统删除桌面回收站图标进行设置，可能很多用户都不知道

阅读：8317|2022-11-06

4 济南大学虚拟社区:鲁大师节能降温的具体办

今天小编告诉大家如何对win10系统电脑设置节能降温的设置方法，想必大家都遇到过需要

阅读：8686|2022-11-06

5 xlueops.exe:无线网络安装向导

我们在使用xp系统的过程中,经常需要对xp系统无线网络安装向导设置进行设置，可能很多

阅读：8627|2022-11-06

6 女斗合众国:win7系统cf与主机连接不稳定怎

今天小编告诉大家如何处理win7系统玩cf老是与主机连接不稳定的问题，可能很多用户都不

阅读：9643|2022-11-06

7 0xc000022-[cf烟雾头]cf怎么调烟雾头

电脑对日常生活的重要性小编就不多说了，可是一旦碰到win7系统设置cf烟雾头的问题，很

阅读：8611|2022-11-06

8 qizideyouhuo:应用程序无法正常启动0xc0000

我们在日常使用电脑的时候，有的小伙伴们可能在打开应用的时候会遇见提示应用程序无法

阅读：7991|2022-11-06

9 ipz-185:win7系统vcf文件怎么打开

今天小编告诉大家如何对win7系统打开vcf文件进行设置，可能很多用户都不知道怎么对win

阅读：8642|2022-11-06

10 傻哥蹦迪:win10系统s4怎么打开usb调试

今天小编告诉大家如何对win10系统s4开启USB调试模式进行设置，可能很多用户都不知道怎

阅读：7527|2022-11-06

客服电话

电子邮件

Java InvalidHFileException类代码示例

示例1: assertBulkLoadHFileOk

示例2: assertBulkLoadHFileOk

示例3: assertBulkLoadHFileOk

示例4: assertBulkLoadHFileOk

示例5: assertBulkLoadHFileOk

示例6: assertBulkLoadHFileOk

示例7: assertBulkLoadHFileOk

示例8: assertBulkLoadHFileOk

示例9: assertBulkLoadHFileOk

请发表评论

全部评论

上一篇：

下一篇：

Delphi中关于资源释放（Free/release/freeA

bradtraversy/iweather: Ionic 3 mobile we

CVE-2022-34918

joaomh/curso-de-matlab

断牙刷新位置时间（断牙属性及刷新位置介绍

剪的笔顺,诠释剪的笔画,认识剪的部首

六六分期app的软件客服如何联系？(六六分期

florent37/ViewAnimator: A fluent Android

florent37/Shrine-MaterialDesign2: implem

CVE-2020-36276

SimpleSoftwareIO/simple-sms: Send and re

关于我们

产品与服务

解决方案

139-2527-9053