Python pandas plot time-series with gap

Question

I am trying to plot a pandas DataFrame with TimeStamp indizes that has a time gap in its indizes. Using pandas.plot() results in linear interpolation between the last TimeStamp of the former segment and the first TimeStamp of the next. I do not want linear interpolation, nor do I want empty space between the two date segments. Is there a way to do that?

Suppose we have a DataFrame with TimeStamp indizes:

>>> import numpy as np
>>> import pandas as pd
>>> import matplotlib.pyplot as plt
>>> df = pd.DataFrame(np.random.randn(1000), index=pd.date_range('1/1/2000', periods=1000))
>>> df = df.cumsum()

Now lets take two time chunks of it and plot it:

>>> df = pd.concat([df['Jan 2000':'Aug 2000'], df['Jan 2001':'Aug 2001']])
>>> df.plot()
>>> plt.show()

The resulting plot has an interpolation line connecting the TimeStamps enclosing the gap. I cannot figure out how to upload pictures on this machine, but these pictures from Google Groups show my problem (interpolated.jpg, no-interpolation.jpg and no gaps.jpg). I can recreate the first as shown above. The second is achievable by replacing all gap values with NaN (see also this question). How can I achieve the third version, where the time gap is omitted?

Stop harming Monica · Accepted Answer · 2016-02-01 17:32:42Z

10

Try:

df.plot(x=df.index.astype(str))

You may want to customize ticks and tick labels.

EDIT

That works for me using pandas 0.17.1 and numpy 1.10.4.

All you really need is a way to convert the DatetimeIndex to another type which is not datetime-like. In order to get meaningful labels I chose str. If x=df.index.astype(str) does not work with your combination of pandas/numpy/whatever you can try other options:

df.index.to_series().dt.strftime('%Y-%m-%d')
df.index.to_series().apply(lambda x: x.strftime('%Y-%m-%d'))
...

I realized that resetting the index is not necessary so I removed that part.

edited Feb 1, 2016 at 17:32

answered Jan 29, 2016 at 18:37

Stop harming Monica

12.7k1 gold badge40 silver badges63 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Alarik Over a year ago

I cannot reproduce this. Oddly, this raises a ValueError: Cannot cast DatetimeIndex to dtype |S0 for me. Otherwise your picture is the solution I want. I am using pandas 0.17.0

Stop harming Monica Over a year ago

It might be fixed in pandas 0.17.1. I edited the answer to add more options anyway. You just have to find a way to convert the timestamps to strings.

cheino · Accepted Answer · 2019-09-29 02:00:24Z

0

In my case I had DateTimeIndex objects instead of TimeStamp, but the following works for me in pandas 0.24.2 to eliminate the time series gaps after converting the DatetimeIndex objects to string.

df = pd.read_sql_query(sql, sql_engine)
df.set_index('date'), inplace=True)
df.index = df.index.map(str)

answered Sep 29, 2019 at 2:00

cheino

1752 silver badges7 bronze badges

Collectives™ on Stack Overflow

Python pandas plot time-series with gap

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related