How to filter a pandas dataframe using multiple partial strings?

Question

I understand how to filter a dataframe in pandas using a single or two partial strings:

final_df = df[df['Answers'].str.contains("not in","not on")]

However I am unable to extend the filtering to more than two partial strings.

final_df = df[df['Answers'].str.contains("not in","not on","not have")]

If I try, I get the following error:

TypeError: unsupported operand type(s) for &: 'str' and 'int'

How do I tweak if I have to extend the filtering based on multiple partial strings? Thank You.

Space Impact · Accepted Answer · 2019-07-31 05:58:43Z

4

Use str.contains with | for multiple search elements:

mask = df['Answers'].str.contains(regex_pattern)
final_df = df[mask]

To create the regex pattern if you have the search elements use:

strings_to_find = ["not in","not on","not have"]
regex_pattern = '|'.join(strings_to_find)
regex_pattern 
'not in|not on|not have'

answered Jul 31, 2019 at 5:55

Space Impact

13.3k26 silver badges51 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

it would be great if you add how to get regex with |. using join