Python : Merge two Pandas Dataframes on a column of list

Question

I need to find intersection between two pandas dataframes based on a column of lists named "authors". enter image description here

But instead I get this error:

enter image description here

You need to show us what you tried. And as much as possible, paste the the code and errors here instead of providing screenshots. Make it easy for us to help you and you're likely to see more answers. — Ray
– Ray, Commented Jun 23, 2017 at 3:03

Oleg Medvedyev · Accepted Answer · 2017-06-23 03:03:56Z

3

You cannot merge on a list, because list cannot be hashed, see this. One option would be to create an additional column by converting list to string and merge on it, e.g.:

df['authors_as_string'] = df['authors'].apply(lambda x: "-".join(x))

This would produce:

   id    authors authors_as_string
0   1  [a, b, c]          a-b-c
1   2  [a, b, c]          a-b-c
2   3     [a, b]            a-b
3   4     [a, c]            a-c

Then you can merge on that third column.

Alternatively you can try other solutions posted in that question.

answered Jun 23, 2017 at 3:03

Oleg Medvedyev

1,60415 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python : Merge two Pandas Dataframes on a column of list

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related