0

When I use the diff function in my snippet:

for customer_id, cus in tqdm(df.groupby(['customer_ID'])):
        # Get differences
        diff_df1 = cus[num_features].diff(1, axis = 0).iloc[[-1]].values.astype(np.float32)

I get:

NotImplementedError

The exact same code did run without any error before (on Colab), whereas now I'm using an Azure DSVM via JupyterHub and I get this error.

I already found this pandas pd.DataFrame.diff(axis=1) NotImplementationError but the solution doesnt work for me as I dont have any Date types. Also I did upgrade pandas but it didnt change anything.

EDIT:
I have found that the error occurs when the datatype is 'int16' or 'int8'. Converting the dtypes to 'int64' solves it. However I leave the question open in case someone can explain it or show a solution that works with int8/int16.

Improve this question
5
  • What is num_features? Commented Aug 23, 2022 at 22:52
  • any changes in the data? for example num_features or customer_ID? Commented Aug 23, 2022 at 22:56
  • @BeRT2me a list with column names (numerical columns), please see my Edit Commented Aug 24, 2022 at 10:17
  • @perpetualstudent No, please see Edit Commented Aug 24, 2022 at 10:18
  • oh i see, it could be due to the data type difference between python native int type and the numpy int types Commented Aug 24, 2022 at 10:55
Related questions
0
numpy.diff() use with pandas DataFrame error
0
Extrapolating diffs with python
0
Python dataframes
Load 7 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.