How to read file stored in hdfs using python Open() method?

Question

I would like read a file from HDFS using Python open() method . However it is not working. Can someone give me a method to read hdfs file using Open() method in python.

for line in open("hdfs://namenode:54311/user/hadoop/filename.txt"):

However it gives me an error

"IOError: [Errno 2] No such file or directory: 'hdfs://namenode:54311/user/hadoop/filename.txt'"

possible duplicate of Python read file as stream from HDFS

rchang
– rchang

2015-01-22 19:10:18 +00:00
Commented Jan 22, 2015 at 19:10 — rchang
– rchang, Commented Jan 22, 2015 at 19:10

serverhorror · Accepted Answer · 2015-01-23 13:29:21Z

1

The built in open doesn't work with URIs. E.g. It would also error out on open("http://example.com/index.html").

Your question is well answered in the suggested duplicate.

answered Jan 23, 2015 at 13:29

serverhorror

8366 silver badges23 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to read file stored in hdfs using python Open() method?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related