How to check if Pandas column has value from list of string?

Question

I have a dataframe and a list

df = pd.DataFrame({'IDs':[1234,5346,1234,8793,8793],
                    'Names':['APPLE ABCD ONE','APPLE ABCD','NO STRAWBERRY YES','ORANGE AVAILABLE','TEA AVAILABLE']})

kw = ['APPLE ABCD', 'ORANGE', 'LEMONS', 'STRAWBERRY', 'BLUEBERRY', 'TEA COFFEE']

I want to create a new column flag such that if Names column contain keyword from kw, flag will be 1 else 0.

Expected Output:

    IDs     Names               Flag
0   1234    APPLE ABCD ONE      1
1   5346    APPLE ABCD          1
2   1234    NO STRAWBERRY YES   1
3   8793    ORANGE AVAILABLE    1
4   8793    TEA AVAILABLE       0

I am able to get the output using below code:

ind=[]
for idx, value in df.iterrows():
    x = 0
    for u in kw:
        if u in value['Names']:
            ind.append(True)
            x = 1
            break
    if x == 0:
        ind.append(False)

df['flag'] = ind

Is there an alternate way to avoid for loop and making it more efficient?

Possible duplicate of check if string in pandas dataframe column is in list — Space Impact
– Space Impact, Commented Nov 17, 2018 at 11:36

Franco Piccolo · Accepted Answer · 2018-11-17 11:35:39Z

32

Use apply and lambda like:

df['Names'].apply(lambda x: any([k in x for k in kw]))

0     True
1     True
2     True
3     True
4    False
Name: Names, dtype: bool

answered Nov 17, 2018 at 11:35

Franco Piccolo

7,4909 gold badges42 silver badges57 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Helen Kapatsa Over a year ago

It works perfectly, thanks Franco. It would be convenient to count all the 'true' in resulting object, so: names = df['Names'].apply(lambda x: any([k in x for k in kw])); names.value_counts()

Aditya Lahiri · Accepted Answer · 2019-06-14 07:10:59Z

23

You can use the isin function of pandas

df['Names'].isin(kw)

answered Jun 14, 2019 at 7:10

Aditya Lahiri

4653 silver badges4 bronze badges

2 Comments

abhishah901 Over a year ago

Does this check substrings? Or just perfect matches?

Maaike Over a year ago

It only checks perfect matches.

Collectives™ on Stack Overflow

How to check if Pandas column has value from list of string?

2 Answers 2

1 Comment

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related