pyspark 'Index' object is not callable

Question

This is a copy and paste line from a data science experiment I am trying to run.

for col,num in zip(df.toPandas().describe().columns(),range(1,11)):

It shows output but not on Databricks.

Error is:

TypeError: 'Index' object is not callable

Any ideas?

mck · Accepted Answer · 2021-01-06 18:08:23Z

2

As the error says, you can't call an index object, which is df.toPandas().describe().columns. Try removing the brackets:

for (col, num) in zip(df.toPandas().describe().columns, range(1,11)):

perhaps a better way is to use enumerate instead of zip, which avoids the need to hard code the number of columns:

for (num, col) in enumerate(df.toPandas().describe().columns):

answered Jan 6, 2021 at 18:08

mck

42.7k13 gold badges44 silver badges62 bronze badges

Sign up to request clarification or add additional context in comments.

8 Comments

It was copied from something that shows output. Crappy

Maybe some versioning problems?

Although I don't remember any recent pandas versions which calls columns

enumerate did not work, the other did. You beaut.

ah, enumerate starts from 0, so you need to add 1 to num inside the for loop.

|