Extracting date from string and saving in new pandas DataFrame columns

Question

Background:

I have a pandas DataFrame containing a tweet and weather column. The DataFrame columns are current as follows -

Objective:
I am trying to extract the datestamp from the weather column (e.g the datestamp for row index 0 is '(2020-07-14)') and save it in a new date column, with the purpose of filtering on it, e.g filtering to the latest date.

I know how to change a column string value to a datestamp, if it were something like '20140512'. However I have no idea how to identify a datestamp in the current format and extract that into a new column.

Any advice would be greatly appreciated

is it always inside of the weather column, in (YYYY-MM-DD) format? — Derek Eden
– Derek Eden, Commented Jul 17, 2020 at 20:50

Derek Eden · Accepted Answer · 2020-07-17 21:00:11Z

1

you could do something like this, assuming it's in the weather column and always has the same formatting:

df['date'] = pd.to_datetime(df['weather'].str.extract('\((\d{4}-\d{2}-\d{2})\)')[0])

or

import re
df['date'] = pd.to_datetime(df['weather'].apply(lambda x: re.search('\((\d{4}-\d{2}-\d{2})\)', x).group(1)))

edited Jul 17, 2020 at 21:00

answered Jul 17, 2020 at 20:54

Derek Eden

4,6584 gold badges22 silver badges39 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Extracting date from string and saving in new pandas DataFrame columns

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related