dataframe transformation of pandas dataframe

Question

I want to manipulate the dataframe element into the data type of the element. the example below dataframe.

A      B         C           D
1      2       12-03-2010   1
45     acxz    3-02-2010    3
43     2.9     14-08-2010   4
45.3   3.5     23-09-2019   2.46
nan    34.23   09-09-2020   09-02-2015
45     nan     sam          10-09-2016
24     45.23   02-03-2021   wax
xyz    32      raz          na

Transform this dataframe into below dataframe.

A        B         C         D
int     int     datetime    int
int     string  datetime    int
int     float   datetime    int
float   float   datetime    float
string  float   datetime    datetime
int     string  string      datetime
int     float   datetime    string
string  int     string      string

can anyone suggest me any way to achieve the below dataframe from the above data using pandas.

@jezrael but head only extract at max 5 data without argument and below one is new dataframe from the above dataframe. — Naruto
– Naruto, Commented Feb 2, 2021 at 7:14
so, since head is the issue in the example code from jezrael, all you need to do is.... — Pac0
– Pac0, Commented Feb 2, 2021 at 7:14

jezrael · Accepted Answer · 2021-02-02 07:41:18Z

1

Use DataFrame.applymap by types, convert to strings and last use replace:

df = pd.DataFrame({
    "a": [1, 0.01, 'aaa', pd.to_datetime('2015-01-01')],
    "b": ['yy', pd.to_datetime('2015-01-01'), 1, 0]
   
})

d = {"<class 'pandas._libs.tslibs.timestamps.Timestamp'>":'datetime',
     "<class 'int'>":'int',
     "<class 'float'>":'float',
     "<class 'str'>":'string'}
df = df.applymap(type).astype(str).replace(d)
print (df)
          a         b
0       int    string
1     float  datetime
2    string       int
3  datetime       int

answered Feb 2, 2021 at 7:41

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

8 Comments

Naruto Over a year ago

how you are generating d variable dictonary.

jezrael Over a year ago

@Rishav - Manually, it is only for replace

Naruto Over a year ago

great @Jezrael.

Naruto Over a year ago

@jezreal yes, but need to check for Nan values.

Naruto Over a year ago

@jezreal getting issue with DateTime, the above script treats it as a string, not as DateTime.

|

Collectives™ on Stack Overflow

dataframe transformation of pandas dataframe

1 Answer 1

8 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

8 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related