TypeError: 'DataFrameReader' object is not callable

Question

I am using PySpark to read a csv file. Below is my simple code.

from pyspark.sql.session import SparkSession

def predict_metrics():
    session = SparkSession.builder.master('local').appName("PredictFacebookMetrics").getOrCreate()
    dataframe = session.read().format('com.databricks.spark.csv') \
        .option('header', True) \
        .option('delimiter', ';') \
        .option('inferSchema', True) \
        .load(r'D:\M\Facebook_metrics_data\dataset_Facebook.csv')
    dataframe.printSchema()
    dataframe.show(False)

if __name__=='__main__':
    predict_metrics()

Upon executing above code I get the following error:

TypeError: 'DataFrameReader' object is not callable

What is the solution to this error?

It is session.read.format.... instead of session.read().format.. :) — mkaran
– mkaran, Commented Nov 27, 2017 at 13:57

MSS · Accepted Answer · 2017-11-27 14:05:47Z

8

As suggested in comment, It should be session.read.format instead of session.read().format

Silly Me!

answered Nov 27, 2017 at 14:05

MSS

3,6932 gold badges28 silver badges57 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

TypeError: 'DataFrameReader' object is not callable

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related