本文整理汇总了Java中org.apache.pig.LoadPushDown类的典型用法代码示例。如果您正苦于以下问题:Java LoadPushDown类的具体用法?Java LoadPushDown怎么用?Java LoadPushDown使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
LoadPushDown类属于org.apache.pig包,在下文中一共展示了LoadPushDown类的9个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。
示例1: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
开发者ID:xushjie1987,项目名称:es-hadoop-v2.2.0,代码行数:5,代码来源:EsStorage.java
示例2: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
return Lists.newArrayList(LoadPushDown.OperatorSet.PROJECTION);
}
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:5,代码来源:AvroStorage.java
示例3: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
List<OperatorSet> features = new ArrayList<OperatorSet>(1);
features.add( LoadPushDown.OperatorSet.PROJECTION );
return features;
}
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:7,代码来源:TableLoader.java
示例4: prepareToRead
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public void prepareToRead(
@SuppressWarnings("rawtypes") RecordReader reader, PigSplit split)
throws IOException {
AllReader allReader = (AllReader) reader;
if (currentPath == null || !(currentPath.equals(allReader.path))) {
currentPathPartitionKeyMap = (partitionColumns == null) ? null
: pathPartitionerHelper
.getPathPartitionKeyValues(allReader.path
.toString());
currentPath = allReader.path;
}
childLoadFunc = allReader.prepareLoadFuncForReading(split);
String projectProperty = getUDFContext().getProperty(PROJECTION_ID);
if (projectProperty != null) {
// load the required field list from the current UDF context
ByteArrayInputStream input = new ByteArrayInputStream(
Base64.decodeBase64(projectProperty.getBytes("UTF-8")));
ObjectInputStream objInput = new ObjectInputStream(input);
try {
requiredFieldList = (RequiredFieldList) objInput.readObject();
} catch (ClassNotFoundException e) {
throw new FrontendException(e.toString(), e);
} finally {
IOUtils.closeStream(objInput);
}
if (childLoadFunc.getClass().isAssignableFrom(LoadPushDown.class)) {
supportPushDownProjection = true;
((LoadPushDown) childLoadFunc)
.pushProjection(requiredFieldList);
} else {
if (requiredFieldList != null) {
requiredFieldHashSet = new TreeSet<Integer>();
for (RequiredField requiredField : requiredFieldList
.getFields()) {
requiredFieldHashSet.add(requiredField.getIndex());
}
}
}
}
}
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:53,代码来源:AllLoader.java
示例5: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:5,代码来源:HiveColumnarLoader.java
示例6: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
return asList(LoadPushDown.OperatorSet.PROJECTION);
}
开发者ID:apache,项目名称:parquet-mr,代码行数:5,代码来源:ParquetLoader.java
示例7: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
return ((LoadPushDown)super.loadFunc()).getFeatures();
}
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:5,代码来源:ParquetLoader.java
示例8: pushProjection
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public RequiredFieldResponse pushProjection(RequiredFieldList requiredFieldList)
throws FrontendException {
return ((LoadPushDown)super.loadFunc()).pushProjection(requiredFieldList);
}
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:6,代码来源:ParquetLoader.java
示例9: getFeatures
import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
开发者ID:data-tsunami,项目名称:cobol-dump-parser,代码行数:5,代码来源:FixedWidthLoader.java
注:本文中的org.apache.pig.LoadPushDown类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。 |
请发表评论