python - pyspark 'Index' object is not callable

Question

This is a copy and paste line from a data science experiment I am trying to run.

for col,num in zip(df.toPandas().describe().columns(),range(1,11)):

It shows output but not on Databricks.

Error is:

TypeError: 'Index' object is not callable

Any ideas?

question from:https://stackoverflow.com/questions/65600924/pyspark-index-object-is-not-callable

Answer 1

As the error says, you can't call an index object, which is df.toPandas().describe().columns. Try removing the brackets:

for (col, num) in zip(df.toPandas().describe().columns, range(1,11)):

perhaps a better way is to use enumerate instead of zip, which avoids the need to hard code the number of columns:

for (num, col) in enumerate(df.toPandas().describe().columns):