remove duplicate dictionary python

Question

I have a problem, I have a list like this:

[{'id': 34, 'questionid': 5, 'text': 'yes', 'score': 1}, {'id': 10, 'questionid': 5, 
'text': 'test answer updated', 'score': 2}, {'id': 20, 'questionid': 5, 'text': 'no', 
'score': 0}, {'id': 35, 'questionid': 5, 'text': 'yes', 'score': 1}]

and I want remove duplicate "questionid", "text" and "score", for example in this case I want output like this:

[{'id': 34, 'questionid': 5, 'text': 'yes', 'score': 1}, {'id': 10, 'questionid': 5, 
'text': 'test answer updated', 'score': 2}, {'id': 20, 'questionid': 5, 'text': 'no', 
'score': 0}]

How can I get this output in python?

user7864386 · Accepted Answer · 2022-03-08 08:00:42Z

1

We could create dictionary that has "questionid", "text" and "score" tuple as key and dicts as values and use this dictionary to check for duplicate values in data:

from operator import itemgetter
out = {}
for d in data:
    key = itemgetter("questionid", "text", "score")(d)
    if key not in out:
        out[key] = d
out = list(out.values())

Output:

[{'id': 34, 'questionid': 5, 'text': 'yes', 'score': 1},
 {'id': 10, 'questionid': 5, 'text': 'test answer updated', 'score': 2},
 {'id': 20, 'questionid': 5, 'text': 'no', 'score': 0}]

answered Mar 8, 2022 at 8:00

user7864386

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

remove duplicate dictionary python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related