AnalysisException: cannot resolve '`item1`' given input columns: [];

Question

I used AWS Glue Transform-custom code, and wrote the following code.

def MyTransform (glueContext, dfc) -> DynamicFrameCollection:

    from pyspark.sql.functions import col, lit
    selected = dfc.select(list(dfc.keys())[0]).toDF()
    selected = selected.withColumn('item2',lit(col('item1')))
    results = DynamicFrame.fromDF(selected, glueContext, "results")
    return DynamicFrameCollection({"results": results}, glueContext)

I got the following error.

AnalysisException: cannot resolve '`item1`' given input columns: [];

pltc · Accepted Answer · 2022-04-26 15:55:52Z

1

You don't need to wrap lit(col('item1')). lit is used to create a literal static value, while col is to refer to a specific column. Depends on what exactly you're trying to achieve, but this change will at least fix your error

selected = selected.withColumn('item2', col('item1'))

answered Apr 26, 2022 at 15:55

pltc

6,0371 gold badge16 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

pltc Over a year ago

great, feel free to accept the answer and close the thread

Collectives™ on Stack Overflow

AnalysisException: cannot resolve '`item1`' given input columns: [];

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related