Append multiple csv into a dataframe using for loop [duplicate]

Question

I need to iterate through all files in a folder to open all csv files. After I got all the file directory in a list: a. I need to read them and append them to a dataframe with the same column names.

a = [] #empty list
for root, dirs, files in os.walk('C:\\Users\\thaiq\\Week5'):
    for file in files:
        if file.endswith('.csv') and 'Rentals' in file:
            a.append(str(os.path.join(root,file)))

ridedata = pd.DataFrame([]) #empty dataframe

for rides in a:
    file = pd.read_csv(rides,header=0) #open each file in list a
    ridedata.append(file)

ridedata return empty, plz help :(

Unlike python list.append, df.append actually returns a result that needs to be assigned. But aside from that, you should be using pd.concat instead. — cs95
– cs95, Commented Jun 18, 2019 at 15:46

Zoe - Save the data dump · Accepted Answer · 2019-06-18 16:07:47Z

0

ridedata = pd.concat([ridedata, file])

edited Jun 18, 2019 at 16:07

Zoe - Save the data dump

28.4k22 gold badges130 silver badges163 bronze badges

answered Jun 18, 2019 at 15:43

Ahmed

1206 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Append multiple csv into a dataframe using for loop [duplicate]

1 Answer 1

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Linked

Related