Hadoop create file in java throws exception: Mkdirs failed to create

Question

I'm trying to create a file in Hadoop using Java client (just a test case). The exception below was thrown:

Exception in thread "main" java.io.IOException: Mkdirs failed to create /app2/speed (exists=false, cwd=file:/home/cpu-local/NetBeansProjects/hdoops) 
    at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:450) 
    at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435) 
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:909) 
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:890) 
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:787) 
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:776) 
    at com.abc.hadoop.Test.main(Test.java:35)

Possible duplicate of Hadoop java.io.IOException: Mkdirs failed to create /some/path — Vadim Beskrovnov
– Vadim Beskrovnov, Commented Jul 18, 2017 at 12:17
If local, you try to run mkdir /app2/speed in your regular Terminal, and it'll likely fail with permission denied because you're making a root directory — OneCricketeer
– OneCricketeer, Commented Jul 18, 2017 at 12:26

VanThaoNguyen · Accepted Answer · 2017-07-18 15:02:26Z

1

Becase of failing in create FileSystem through java client, all you need is setting your java client appropriate the hadoop configuration (in file config).

Configuration hadoopConfig = new Configuration();
hadoopConfig.set("fs.defaultFS", "hdfs://localhost:9000/");
hadoopConfig.set("fs.hdfs.impl", org.apache.hadoop.hdfs.DistributedFileSystem.class.getName());
hadoopConfig.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName());

answered Jul 18, 2017 at 15:02

VanThaoNguyen

81211 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Hadoop create file in java throws exception: Mkdirs failed to create

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related