Pandas: Selecting DataFrame rows between two dates (Datetime Index)

Question

I have a Pandas DataFrame with a DatetimeIndex and one column MSE Loss the index is formatted as follows:

DatetimeIndex(['2015-07-16 07:14:41', '2015-07-16 07:14:48',
           '2015-07-16 07:14:54', '2015-07-16 07:15:01',
           '2015-07-16 07:15:07', '2015-07-16 07:15:14',...]

It includes several days.

I want to select all the rows (all times) of a particular days without specifically knowing the actual time intervals. For example: Between 2015-07-16 07:00:00 and 2015-07-16 23:00:00

I tried the approach outlined here: here

But df[date_from:date_to]

outputs:

KeyError: Timestamp('2015-07-16 07:00:00')

So it wants exact indices. Furthermore, I don't have a datecolumn. Only an index with the dates.

What is the best way to select a whole day by just providing a date 2015-07-16 and then how could I select a specific time range within a particular day?

Andrew L · Accepted Answer · 2017-06-14 15:38:30Z

21

Option 1:

Sample df:

df
                      a
2015-07-16 07:14:41  12
2015-07-16 07:14:48  34
2015-07-16 07:14:54  65
2015-07-16 07:15:01  34
2015-07-16 07:15:07  23
2015-07-16 07:15:14   1

It looks like you're trying this without .loc (won't work without it):

df.loc['2015-07-16 07:00:00':'2015-07-16 23:00:00']
                      a
2015-07-16 07:14:41  12
2015-07-16 07:14:48  34
2015-07-16 07:14:54  65
2015-07-16 07:15:01  34
2015-07-16 07:15:07  23
2015-07-16 07:15:14   1

Option 2:

You can use boolean indexing on the index:

df[(df.index.get_level_values(0) >= '2015-07-16 07:00:00') & (df.index.get_level_values(0) <= '2015-07-16 23:00:00')]

edited Jun 14, 2017 at 15:38

answered Jun 14, 2017 at 15:30

Andrew L

7,1083 gold badges28 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

JrtPec · Accepted Answer · 2017-06-14 15:50:51Z

8

You can use truncate:

begin = pd.Timestamp('2015-07-16 07:00:00')
end = pd.Timestamp('2015-07-16 23:00:00')

df.truncate(before=begin, after=end)

answered Jun 14, 2017 at 15:50

JrtPec

3213 silver badges19 bronze badges

1 Comment

ewalel Over a year ago

Using truncate requires a sorted datetime index

Florida Man · Accepted Answer · 2022-10-07 14:04:21Z

0

You can use the panda function between_time.

the_timed_df=df["my_time_column"].between_time(date_from,date_to)

Should do what you want if I did not mess some detail up :-)

answered Oct 7, 2022 at 14:04

Florida Man

2,1775 gold badges30 silver badges51 bronze badges

1 Comment

johnDanger Over a year ago

I think this only works with times, so it would have to be between_time(time_from, time_to).

Collectives™ on Stack Overflow

Pandas: Selecting DataFrame rows between two dates (Datetime Index)

3 Answers 3

Comments

1 Comment

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related