Issue with hdfs with java API

Question

I used following code to delete a file on hdfs filesystem

    conf = new org.apache.hadoop.conf.Configuration();
    // TODO: Change IP
    conf.set("fs.defaultFS", "hdfs://aaa.bbb.com:1234/user/hdfs");
    conf.set("hadoop.job.ugi", "hdfs");
    conf.set("fs.hdfs.impl", 
        org.apache.hadoop.hdfs.DistributedFileSystem.class.getName()
    );
    conf.set("fs.file.impl",
        org.apache.hadoop.fs.LocalFileSystem.class.getName()
    );
fs = FileSystem.get(conf);
fs.delete(new Path("/user/hdfs/file.copy"), true);

I created a user called "xyz" in my local machine, and to my amazement I was able to delete the file(file.copy) in hdfs filesystem with the given namenode whose owner was xyz. That means someone with the access to namenode url could delete anyfile by creating hdfs or root user?

I understand that Java API has a way to authenticate user using Kerberos, I believe solething is wrong with our configuration of the hadoop system. Could somebody help me to setup the security properly? I believe remote user should provide some key or key file to authenticate itself. Just same username won't do!

PS: I am using Cloudera 5.3.1

Jeremy Beard · Accepted Answer · 2015-03-03 16:34:05Z

1

Yes, if you don't have Kerberos authentication enabled on your cluster then you really have no authentication at all. If you care about your data you absolutely should enable Kerberos authentication.

answered Mar 3, 2015 at 16:34

Jeremy Beard

2,7251 gold badge21 silver badges25 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Issue with hdfs with java API

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related