• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

Java TestMetricsConfig类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.metrics2.impl.TestMetricsConfig的典型用法代码示例。如果您正苦于以下问题:Java TestMetricsConfig类的具体用法?Java TestMetricsConfig怎么用?Java TestMetricsConfig使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



TestMetricsConfig类属于org.apache.hadoop.metrics2.impl包,在下文中一共展示了TestMetricsConfig类的4个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: initMetricsSystem

import org.apache.hadoop.metrics2.impl.TestMetricsConfig; //导入依赖的package包/类
/**
 * Set up the metrics system, start it, and return it.
 * @param path the base path for the sink
 * @param ignoreErrors whether the sink should ignore errors
 * @param allowAppend whether the sink is allowed to append to existing files
 * @param useSecureParams whether to set the principal and keytab properties
 * @return the org.apache.hadoop.metrics2.MetricsSystem
 */
protected MetricsSystem initMetricsSystem(String path, boolean ignoreErrors,
    boolean allowAppend, boolean useSecureParams) {
  // If the prefix is not lower case, the metrics system won't be able to
  // read any of the properties.
  String prefix = methodName.getMethodName().toLowerCase();

  ConfigBuilder builder = new ConfigBuilder().add("*.period", 10000)
      .add(prefix + ".sink.mysink0.class", MockSink.class.getName())
      .add(prefix + ".sink.mysink0.basepath", path)
      .add(prefix + ".sink.mysink0.source", "testsrc")
      .add(prefix + ".sink.mysink0.context", "test1")
      .add(prefix + ".sink.mysink0.ignore-error", ignoreErrors)
      .add(prefix + ".sink.mysink0.allow-append", allowAppend);

  if (useSecureParams) {
      builder.add(prefix + ".sink.mysink0.keytab-key", SINK_KEYTAB_FILE_KEY)
      .add(prefix + ".sink.mysink0.principal-key", SINK_PRINCIPAL_KEY);
  }

  builder.save(TestMetricsConfig.getTestFilename("hadoop-metrics2-" + prefix));

  MetricsSystemImpl ms = new MetricsSystemImpl(prefix);

  ms.start();

  return ms;
}
 
开发者ID:nucypher,项目名称:hadoop-oss,代码行数:36,代码来源:RollingFileSystemSinkTestBase.java


示例2: saveMetricsConfigFile

import org.apache.hadoop.metrics2.impl.TestMetricsConfig; //导入依赖的package包/类
private static void saveMetricsConfigFile() {
  if (!metricsConfigSaved) {
    new org.apache.hadoop.metrics2.impl.ConfigBuilder()
    .add("azure-file-system.sink.azuretestcollector.class",
        StandardCollector.class.getName())
    .save(TestMetricsConfig.getTestFilename(
        "hadoop-metrics2-azure-file-system.properties"));
    metricsConfigSaved = true;
  }
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:11,代码来源:AzureBlobStorageTestAccount.java


示例3: testFileSink

import org.apache.hadoop.metrics2.impl.TestMetricsConfig; //导入依赖的package包/类
@Test(timeout=6000) 
public void testFileSink() throws IOException {
  outFile = getTestTempFile("test-file-sink-", ".out");
  final String outPath = outFile.getAbsolutePath();  
  
  // NB: specify large period to avoid multiple metrics snapshotting: 
  new ConfigBuilder().add("*.period", 10000)
      .add("test.sink.mysink0.class", FileSink.class.getName())
      .add("test.sink.mysink0.filename", outPath)
      // NB: we filter by context to exclude "metricssystem" context metrics:
      .add("test.sink.mysink0.context", "test1")
      .save(TestMetricsConfig.getTestFilename("hadoop-metrics2-test"));
  MetricsSystemImpl ms = new MetricsSystemImpl("test");
  ms.start();

  final MyMetrics1 mm1 
    = new MyMetrics1().registerWith(ms);
  new MyMetrics2().registerWith(ms);

  mm1.testMetric1.incr();
  mm1.testMetric2.incr(2);

  ms.publishMetricsNow(); // publish the metrics
  ms.stop();
  ms.shutdown();

  InputStream is = null;
  ByteArrayOutputStream baos = null;
  String outFileContent = null;
  try {
    is = new FileInputStream(outFile);
    baos = new ByteArrayOutputStream((int)outFile.length());
    IOUtils.copyBytes(is, baos, 1024, true);
    outFileContent = new String(baos.toByteArray(), "UTF-8");
  } finally {
    IOUtils.cleanup(null, baos, is);
  }

  // Check the out file content. Should be something like the following:
  //1360244820087 test1.testRecord1: Context=test1, testTag1=testTagValue1, testTag2=testTagValue2, Hostname=myhost, testMetric1=1, testMetric2=2
  //1360244820089 test1.testRecord2: Context=test1, testTag22=testTagValue22, Hostname=myhost
  
  // Note that in the below expression we allow tags and metrics to go in arbitrary order.  
  Pattern expectedContentPattern = Pattern.compile(
      // line #1:
      "^\\d+\\s+test1.testRecord1:\\s+Context=test1,\\s+" +
      "(testTag1=testTagValue1,\\s+testTag2=testTagValue2|testTag2=testTagValue2,\\s+testTag1=testTagValue1)," +
      "\\s+Hostname=.*,\\s+(testMetric1=1,\\s+testMetric2=2|testMetric2=2,\\s+testMetric1=1)" +
      // line #2:
      "$[\\n\\r]*^\\d+\\s+test1.testRecord2:\\s+Context=test1," +
      "\\s+testTag22=testTagValue22,\\s+Hostname=.*$[\\n\\r]*", 
       Pattern.MULTILINE);
   assertTrue(expectedContentPattern.matcher(outFileContent).matches());
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:55,代码来源:TestFileSink.java


示例4: testFileSink

import org.apache.hadoop.metrics2.impl.TestMetricsConfig; //导入依赖的package包/类
@Test(timeout=6000) 
public void testFileSink() throws IOException {
  outFile = getTestTempFile("test-file-sink-", ".out");
  final String outPath = outFile.getAbsolutePath();  
  
  // NB: specify large period to avoid multiple metrics snapshotting: 
  new ConfigBuilder().add("*.period", 10000)
      .add("test.sink.mysink0.class", FileSink.class.getName())
      .add("test.sink.mysink0.filename", outPath)
      // NB: we filter by context to exclude "metricssystem" context metrics:
      .add("test.sink.mysink0.context", "test1")
      .save(TestMetricsConfig.getTestFilename("hadoop-metrics2-test"));
  MetricsSystemImpl ms = new MetricsSystemImpl("test");
  ms.start();

  final MyMetrics1 mm1 
    = new MyMetrics1().registerWith(ms);
  new MyMetrics2().registerWith(ms);

  mm1.testMetric1.incr();
  mm1.testMetric2.incr(2);

  ms.publishMetricsNow(); // publish the metrics
  ms.stop();
  ms.shutdown();
  
  InputStream is = new FileInputStream(outFile);
  ByteArrayOutputStream baos = new ByteArrayOutputStream((int)outFile.length());
  IOUtils.copyBytes(is, baos, 1024, true);
  String outFileContent = new String(baos.toByteArray(), "UTF-8");

  // Check the out file content. Should be something like the following:
  //1360244820087 test1.testRecord1: Context=test1, testTag1=testTagValue1, testTag2=testTagValue2, Hostname=myhost, testMetric1=1, testMetric2=2
  //1360244820089 test1.testRecord2: Context=test1, testTag22=testTagValue22, Hostname=myhost
  
  // Note that in the below expression we allow tags and metrics to go in arbitrary order.  
  Pattern expectedContentPattern = Pattern.compile(
      // line #1:
      "^\\d+\\s+test1.testRecord1:\\s+Context=test1,\\s+" +
      "(testTag1=testTagValue1,\\s+testTag2=testTagValue2|testTag2=testTagValue2,\\s+testTag1=testTagValue1)," +
      "\\s+Hostname=.*,\\s+(testMetric1=1,\\s+testMetric2=2|testMetric2=2,\\s+testMetric1=1)" +
      // line #2:
      "$[\\n\\r]*^\\d+\\s+test1.testRecord2:\\s+Context=test1," +
      "\\s+testTag22=testTagValue22,\\s+Hostname=.*$[\\n\\r]*", 
       Pattern.MULTILINE);
   assertTrue(expectedContentPattern.matcher(outFileContent).matches());
}
 
开发者ID:Seagate,项目名称:hadoop-on-lustre2,代码行数:48,代码来源:TestFileSink.java



注:本文中的org.apache.hadoop.metrics2.impl.TestMetricsConfig类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java DOMParseException类代码示例发布时间:2022-05-23
下一篇:
Java BlockReaderTestUtil类代码示例发布时间:2022-05-23
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap