Error in Iterating through Pandas DataFrame with if statement

Question

I have the following pandas DataFrame.

   Id UserId    Name            Date                 Class  TagBased
0   2   23  Autobiographer  2016-01-12T18:44:49.267     3   False
1   3   22  Autobiographer  2016-01-12T18:44:49.267     3   False
2   4   21  Autobiographer  2016-01-12T18:44:49.267     3   False
3   5   20  Autobiographer  2016-01-12T18:44:49.267     3   False
4   6   19  Autobiographer  2016-01-12T18:44:49.267     3   False

I want to iterate through "TagBased" column and put the User Ids in a list where TagBased=True. I have used the following code but I am getting no output which is incorrect because there are 18 True values in TagBased.

user_tagBased = []

for i in range(len(df)):
    if (df['TagBased'] is True):
        user_TagBased.append(df['UserId'])
print(user_TagBased)

Output: []

try df.loc[df['TagBased'],'UserId'].tolist() you dont need loops most of the times in pandas — anky
– anky, Commented Jun 24, 2020 at 15:15
I am getting the following error by trying this method: KeyError: "None of [Index(['False', 'False', 'False', 'False', 'False', 'False', 'False', 'False',\n 'False', 'False',\n ...\n 'False', 'False', 'False', 'False', 'False', 'False', 'False', 'False',\n 'False', 'False'],\n dtype='object', length=18087)] are in the [index]" — Ishan Dutta
– Ishan Dutta, Commented Jun 24, 2020 at 15:17
better is df.loc[df['TagBased'].eq("True"),'UserId'].tolist() since the values are string — anky
– anky, Commented Jun 24, 2020 at 15:35

mabergerx · Accepted Answer · 2020-06-24 15:30:56Z

1

As others are suggesting, using Pandas conditional filtering is the best choice here without using loops! However, to still explain why your code did not work as expected:

You are appending df['UserId'] in a for-loop while df['UserId'] is a column. Same goes for df['TagBased'] check, which is also a column.

I assume you want to append the userId at the current row in the for-loop.

You can do that by iterating through the df rows:

user_tagBased = []

for index, row in df.iterrows():
    if row['TagBased'] == 'True': # Because it is a string and not a boolean here
        user_tagBased.append(row['UserId'])

edited Jun 24, 2020 at 15:30

answered Jun 24, 2020 at 15:18

mabergerx

1,2337 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

NYC Coder · Accepted Answer · 2020-06-24 15:18:49Z

1

Try this, you don't need to use loops for this:

user_list = df[df['TagBased']==True]['UserId'].tolist()
print(user_list)

[19, 19]

answered Jun 24, 2020 at 15:18

NYC Coder

7,6443 gold badges14 silver badges25 bronze badges

Comments

Valdi_Bo · Accepted Answer · 2020-06-24 15:26:38Z

0

There is no need to use any loop.

Note that:

df.TagBased - yields a Series of bool type - TagBased column (I assume that TagBased column is of bool type).
df[df.TagBased] - is an example of boolean indexing - it retrieves rows where TagBased is True
df[df.TagBased].UserId - limits the above result to just UserId, almost what you want, but this is a Series, whereas you want a list.

So the code to produce your expected result, with saving in the destination variable, is:

user_tagBased = df[df.TagBased].UserId.to_list()

answered Jun 24, 2020 at 15:26

Valdi_Bo

31.1k4 gold badges29 silver badges45 bronze badges

Collectives™ on Stack Overflow

Error in Iterating through Pandas DataFrame with if statement

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related