Remove certain strings from list of strings as column in pandas.DataFrame

Question

I have a pandas.DataFrame:

    index    question_id    tag
    0        1858           [pset3, game-of-fifteen]
    1        2409           [pset4]
    2        4346           [pset6, cs50submit]
    3        9139           [pset8, pset5, gradebook]
    4        9631           [pset4, recover]

I need to remove every string from list of strings in tag column except pset* strings.

So I need to end with something like this:

    index    question_id    tag
    0        1858           [pset3]
    1        2409           [pset4]
    2        4346           [pset6]
    3        9139           [pset8, pset5]
    4        9631           [pset4]

How can I do that please?

akuiper · Accepted Answer · 2017-04-12 21:03:01Z

2

One option: Use apply method to loop through the items in the tag column; for each item, use a list comprehension to filter strings based on the prefix using startswith method:

df['tag'] = df.tag.apply(lambda lst: [x for x in lst if x.startswith("pset")])
df

answered Apr 12, 2017 at 21:03

akuiper

216k33 gold badges362 silver badges379 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

James · Accepted Answer · 2017-04-12 21:03:19Z

2

You can apply a function to the tag series that constructs a list using only the elements that start with 'pset'

df.tag.apply(lambda x: [xx for xx in x if xx.startswith('pset')])

# returns:
0           [pset3]
1           [pset4]
2           [pset6]
3    [pset8, pset5]
4           [pset4]

answered Apr 12, 2017 at 21:03

James

37k4 gold badges54 silver badges79 bronze badges

Comments

Vaishali · Accepted Answer · 2017-04-12 21:05:12Z

2

You can even use python in operator

df.tag = df.tag.apply(lambda x: [elem for elem in x if 'pset' in elem])

0           [pset3]
1           [pset4]
2           [pset6]
3    [pset8, pset5]
4           [pset4]

answered Apr 12, 2017 at 21:05

Vaishali

38.5k5 gold badges62 silver badges88 bronze badges

Collectives™ on Stack Overflow

Remove certain strings from list of strings as column in pandas.DataFrame

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related