Recent questions tagged HDFS

0 votes

364 views

1 answer

hdfs - Hadoop pseudo distributed mode - Datanode and tasktracker not starting

I am running a Red Hat Enterprise Linux Server release 6.4 (Santiago) distribution with Hadoop ... localhost6 localhost6.localdomain6 See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

246 views

1 answer

hdfs - Spark Streaming textFileStream not supporting wildcards

I setup a simple test to stream text files from S3 and got it to work when I tried something like val input = ... few minutes into the new day. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

318 views

1 answer

hdfs - Spark Streaming textFileStream not supporting wildcards

I setup a simple test to stream text files from S3 and got it to work when I tried something like val input = ... few minutes into the new day. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

273 views

1 answer

hdfs - Spark Streaming textFileStream not supporting wildcards

I setup a simple test to stream text files from S3 and got it to work when I tried something like val input = ... few minutes into the new day. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

275 views

1 answer

hdfs - Spark Streaming textFileStream not supporting wildcards

I setup a simple test to stream text files from S3 and got it to work when I tried something like val input = ... few minutes into the new day. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

637 views

1 answer

hdfs - Checksum verification in Hadoop

Do we need to verify checksum after we move files to Hadoop (HDFS) from a Linux server through a Webhdfs ? ... file on Hdfs using webhdfs. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

397 views

1 answer

hdfs - Viewing the number of blocks for a file in hadoop

How can I view how many blocks has a file been broken into, in a Hadoop file system? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

568 views

1 answer

hdfs - Python: save pandas data frame to parquet file

Is it possible to save a pandas data frame directly to a parquet file? If not, what would be the suggested process ... to read/open it. Thanks! See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

300 views

1 answer

hdfs - Writing data to Hadoop

I need to write data in to Hadoop (HDFS) from external sources like a windows box. Right now I have ... to code external clients against HDFS. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

626 views

1 answer

hdfs - Why is there no 'hadoop fs -head' shell command?

A fast method for inspecting files on HDFS is to use tail: ~$ hadoop fs -tail /path/to/file This displays ... head. Does anyone have an answer? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

361 views

1 answer

hdfs - Hadoop 2.2 Installation `.' no such file or directory

I have installed Hadoop and HDFS using this tutorial http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220 ... than the training video? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

341 views

1 answer

hdfs - Difference between hadoop fs -put and hadoop fs -copyFromLocal

-put and -copyFromLocal are documented as identical, while most examples use the verbose variant -copyFromLocal. Why? ... -get and -copyToLocal See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

780 views

1 answer

hdfs - Hadoop java.io.IOException: Mkdirs failed to create /some/path

When I try to run my Job I am getting the following exception: Exception in thread "main" java.io.IOException: ... I am using hadoop 0.21. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags