AttributeError: 'SQLContext' object has no attribute 'jsonFile'

Question

When I perform the following actions.I met this problem in centos 7.0 and spark 2.1.0. I am a freshman in spark. How to fix it？

>>> from pyspark.sql import SQLContext
>>> ssc = SQLContext(sc)
>>> df = ssc.jsonFile('file:///root/work/person.json')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'SQLContext' object has no attribute 'jsonFile'

SQLContext.jsonFile() is deprecated, you should try SQLContext.read.json() — mtoto
– mtoto, Commented May 24, 2017 at 9:32
yeah.but i met another quesiton.... >>> df = sqlContext.read.json('file:///root/work/person.json') pyspark.sql.utils.AnalysisException: u'Path does not exist: file:/root/work/person.json;' — smile
– smile, Commented May 24, 2017 at 9:42
my path is wrong? [root@localhost word]# ls person.json person.txt [root@localhost word]# pwd /root/word — smile
– smile, Commented May 24, 2017 at 9:43

koiralo · Accepted Answer · 2017-05-24 09:41:50Z

2

Use SparkSession with the newer version of Spark and read using df = spark.read.json('path to json).

answered May 24, 2017 at 9:41

koiralo

23.2k6 gold badges57 silver badges77 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Avishkar Meshram · Accepted Answer · 2019-05-13 13:26:48Z

0

jsonFile has been deprecated, please use sqlContext.read.json

answered May 13, 2019 at 13:26

Avishkar Meshram

511 silver badge6 bronze badges

Collectives™ on Stack Overflow

AttributeError: 'SQLContext' object has no attribute 'jsonFile'

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related