1

When I run my MR job on mac osx, I face on the following exception:

Exception in thread "main" java.io.IOException: Mkdirs failed to create /var/folders/9m/w_vzzmtx0rq0tt9whf_r4yhr0000gn/T/hadoop-unjar7688811202881231043/META-INF/license
	at org.apache.hadoop.util.RunJar.ensureDirectory(RunJar.java:128)
	at org.apache.hadoop.util.RunJar.unJar(RunJar.java:104)
	at org.apache.hadoop.util.RunJar.unJar(RunJar.java:81)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:209)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

According other post, people gave alternative way to remove META-INF/LICENSE from jar file. I feel it seems temporary solution.

I think it will resolve if path trying to store tmp files below:

/var/folders/9m/.../META-INF/license

I checked permission and tried to change "hadoop.tmp.dir" value in core-site.xml, but it doesn't work for me.

PS. I know the issue is caused case-insensitive property for osx. Then, I am working with directory mounted disk image, which is case sensitive.

Thanks in advance!

Improve this question
3
  • which MR job are you running? Commented May 31, 2017 at 11:36
  • My job is to write files in HDFS after parsing. Commented Jun 6, 2017 at 5:25
  • Check below answer. stackoverflow.com/a/32698951 That will fix your problem. Commented Apr 19, 2019 at 2:35
Related questions
1
Hadoop : java.io.IOException: No valid local directories in property: mapred.local.dir
45
Hadoop java.io.IOException: Mkdirs failed to create /some/path
2
Mapreduce Hadoop job exception Output directory already exists
Load 6 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.