Finding duplicates from array using Python

Question

I'm quite new to Python and was wondering if there was a good way to create a new list of unduplicated users.

My problem is that I have something like this

[
{
    "userId": "987654321",
    "method": "CARD",
    "lastDigits": "1234",
    "type": "mc",
    "first_name": "Leroy",
    "last_name": "Jenkins",
    "exp": "01/23"
  },
  {
    "userId": "987654321",
    "method": "PAYPAL",
    "first_name": "Leroy",
    "last_name": "Jenkins"
  },
  {
    "userId": "123456789",
    "method": "CARD",
    "lastDigits": "4567",
    "type": "visa",
    "first_name": "Joe",
    "last_name": "Bloggs",
    "exp": "01/25"
  },
  {
    "userId": "46513498000",
    "method": "PAYPAL",
    "first_name": "Betty",
    "last_name": "White"
  }
]

Basically I need to match when the userId has matched and keep the object when "method": "CARD"instead of PAYPAL then reconstruct essentially the same list again but minus the duplicate userId's when the user has both CARD and PAYPAL

::EDIT:: User can just have PAYPAL. and if it does just have PAYPAL, just return that

example output needed

[
{
    "userId": "987654321",
    "method": "CARD",
    "lastDigits": "1234",
    "type": "mc",
    "first_name": "Leroy",
    "last_name": "Jenkins",
    "exp": "01/23"
  },
  {
    "userId": "123456789",
    "method": "CARD",
    "lastDigits": "4567",
    "type": "visa",
    "first_name": "Joe",
    "last_name": "Bloggs",
    "exp": "01/25"
  },
  {
    "userId": "46513498000",
    "method": "PAYPAL",
    "first_name": "Betty",
    "last_name": "White"
  }
]

Hi and welcome to SO. It is important for the community that you also demonstrate that you are working to solve your issue. The best way to do that in my opinion is to include the text based version of the source code you have so far, even if it is not working quite right. — JonSG
– JonSG, Commented Jan 20, 2022 at 14:31
Let me rephrase the requirement to see if I've got it right. If a userId has a method == 'CARD' you want that information but not if that same userId has both 'CARD' and 'PAYPAL' — jackal
– jackal, Commented Jan 20, 2022 at 14:32
If you want help getting started, reshape the list into a dictionary with a key of "userId" When you go to set a key with an entry of "PAYPAL" verify that this key has not be set already. — JonSG
– JonSG, Commented Jan 20, 2022 at 14:33

Md. Saroar Jahan · Accepted Answer · 2022-01-20 18:39:26Z

1

This will perfectly work for your. Try and check it

mylist=[
{
    "userId": "987654321",
    "method": "CARD",
    "lastDigits": "1234",
    "type": "mc",
    "first_name": "Leroy",
    "last_name": "Jenkins",
    "exp": "01/23"
  },
  {
    "userId": "987654321",
    "method": "PAYPAL",
    "first_name": "Leroy",
    "last_name": "Jenkins"
  },
  {
    "userId": "123456789",
    "method": "CARD",
    "lastDigits": "4567",
    "type": "visa",
    "first_name": "Joe",
    "last_name": "Bloggs",
    "exp": "01/25"
  },
  {
    "userId": "46513498000",
    "method": "PAYPAL",
    "first_name": "Betty",
    "last_name": "White"
  }
]
temp_list=[]
temp_id=[]
for x in mylist:
    if int(x['userId']) not in temp_id:
        temp_list.append(x)
        temp_id.append(int(x["userId"]))

print(temp_list)

answered Jan 20, 2022 at 18:39

Md. Saroar Jahan

5764 silver badges6 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

A l w a y s S u n n y · Accepted Answer · 2022-01-21 04:29:52Z

1

If I don't misunderstood your question then simple filtering will do the trick for you,

user_ids = []
final_users = []
for user in users:
    user_ids.append(int(user['userId']))
    if user['userId'] not in user_ids and user['method'] != 'PAYPAL':
        final_users.append(user)
print(final_users)

Working Code: https://rextester.com/COBGVU63922

edited Jan 21, 2022 at 4:29

answered Jan 20, 2022 at 14:38

A l w a y s S u n n y

38.8k9 gold badges68 silver badges120 bronze badges

3 Comments

Mikey Over a year ago

Ye this is pretty much it, but i forgot to mention. The user can just have PAYPAL. i.e:

Mikey Over a year ago

[ {     "userId": "987654321",     "method": "CARD",     "lastDigits": "1234",     "type": "mc",     "first_name": "Leroy",     "last_name": "Jenkins",     "exp": "01/23"   },   {     "userId": "987654321",     "method": "PAYPAL",     "first_name": "Leroy",     "last_name": "Jenkins"   },   {     "userId": "54982100",     "method": "PAYPAL",     "first_name": "Bilbo",     "last_name": "Baggins"   } ]

Mikey Over a year ago

If this is the case, PAYPAL is returned

Jan Jaap Meijerink · Accepted Answer · 2022-01-20 14:34:21Z

0

users = {}

for d in user_list:
    uid = d["userId"]
    # If user id not in users, we add it
    if uid not in users:
        users[uid] = d

    # Otherwise we check if the already recorded method was "PAYPAL", 
    # if so we overwrite it.
    elif users[uid]["method"] == "PAYPAL":
       users[uid] = d

# To convert dict we just created back to list:
user_list = list(users.values())

answered Jan 20, 2022 at 14:34

Jan Jaap Meijerink

4472 silver badges7 bronze badges

Comments

Corralien · Accepted Answer · 2022-01-20 14:35:43Z

0

Use defaultdict:

from collections import defaultdict

newdata = defaultdict(dict)

for item in data:
    userid = newdata[item['userId']]
    if userid == {} and item['method'] == 'CARD':
        userid.update(item)

Output:

# newdata = list(newdata.values())
>>> newdata
[{'userId': '987654321',
  'method': 'CARD',
  'lastDigits': '1234',
  'type': 'mc',
  'first_name': 'Leroy',
  'last_name': 'Jenkins',
  'exp': '01/23'},
 {'userId': '123456789',
  'method': 'CARD',
  'lastDigits': '4567',
  'type': 'visa',
  'first_name': 'Joe',
  'last_name': 'Bloggs',
  'exp': '01/25'}]

answered Jan 20, 2022 at 14:35

Corralien

121k8 gold badges43 silver badges68 bronze badges

Collectives™ on Stack Overflow

Finding duplicates from array using Python

4 Answers 4

Comments

3 Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

3 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related