Comparing dataframe datetime column value in Python? [duplicate]

Question

I am new to Pandas. I have the following pandas dataframe which contains the following values :

index print_statement      timestamp 
0     echo "I AM HAPPY2" 2018-11-12 08:01:00       
1     echo "I AM HAPPY3" 2018-11-12 08:01:00       
2     echo "I AM HAPPY1" 2018-11-12 08:01:00       
3     echo "I AM HAPPY4" 2018-12-12 08:02:00      
4     echo "I AM HAPPY5" 2018-12-13 08:02:00

I want to compare the df as: - let's say I have a time_argument which is datetime.datetime(2018, 12, 12, 5, 1). I want to store the result in another dataframe where timestamp > time_argument.

I tried using the following approach:

for index, row in df.iterrows():
     date_store = row['time_to_expire']
     if date_store.to_pydatetime() >= ii:
         df_final = row

But I am not getting the desired answer.

Hope I am clear with the question.

Mayank Porwal · Accepted Answer · 2018-12-11 14:39:43Z

5

You can do this:

First convert timestamp column into Pandas datetime:

In [2346]: df.timestamp = pd.to_datetime(df.timestamp)
In [2347]: df
Out[2347]: 
      print_statement           timestamp
0  echo "I AM HAPPY2" 2018-11-12 08:01:00
1  echo "I AM HAPPY3" 2018-11-12 08:01:00
2  echo "I AM HAPPY1" 2018-11-12 08:01:00
3  echo "I AM HAPPY4" 2018-12-12 08:02:00
4  echo "I AM HAPPY5" 2018-12-13 08:02:00

In [2348]: time_argument = datetime.datetime(2018, 12, 12, 5, 1)

In [2350]: result = df[df.timestamp > time_argument]
Out[2350]: result
      print_statement           timestamp
3  echo "I AM HAPPY4" 2018-12-12 08:02:00
4  echo "I AM HAPPY5" 2018-12-13 08:02:00

edited Dec 11, 2018 at 14:39

answered Dec 11, 2018 at 14:24

Mayank Porwal

34.2k9 gold badges45 silver badges65 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Mayank Porwal Over a year ago

@jezrael Got it. Edited my answer also. Thanks.

Aniket Maithani Over a year ago

@MayankPorwal But if I pass time_argument = datetime.datetime(2018, 12, 11, 4, 59) . In that case it is showing me the same result as of datetime.datetime(2018, 12, 12, 5, 1)` . Anything I am missing here ?

Mayank Porwal Over a year ago

@AniketMaithani Yes, it should produce the same result. As, the new time_argument is basically = 2018-12-11 04:59. So, you are searching for rows > 11th Dec 2018, which is basically the last 2 rows of your dataframe.

Aniket Maithani Over a year ago

Thanks for the clarification @MayankPorwal. In case I want to compare the date as well as time in that case ?

Mayank Porwal Over a year ago

@AniketMaithani The code compares date with time already. Just make sure to give correct value to the time_argument variable. It will do what you want.

Collectives™ on Stack Overflow

Comparing dataframe datetime column value in Python? [duplicate]

1 Answer 1

5 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

5 Comments

Linked

Related