Loop excel files, add one more column and save them in Python

Question

I have a folder D:/test/src in which have lots of excel files, I want to add one more column date which is 2019-08-01 in each one and save them into another folder D:/test/dst.

Here is what I have done. It works, but a little bit slow. So if you have quicker or others ideas, welcome to share. Thanks at advance.

import pandas as pd
import os
import glob

src = "D:/test/src/*.xls*"
dst = "D:/test/dst/"

dfs = []
for file in glob.glob(src):
    df = pd.read_excel(file)
    df['date'] = "2019-08-01"
    df["date"] = df["date"].astype(str)
    df.to_excel(os.path.join(dst, os.path.basename(file)),
                index=False)
    dfs.append(df)

use multithreading

Alderven
– Alderven

2019-08-02 07:54:48 +00:00
Commented Aug 2, 2019 at 7:54 — Alderven
– Alderven, Commented Aug 2, 2019 at 7:54
Thanks, could you show this in my example?

ah bon
– ah bon

2019-08-02 08:06:43 +00:00
Commented Aug 2, 2019 at 8:06 — ah bon
– ah bon, Commented Aug 2, 2019 at 8:06

Alderven · Accepted Answer · 2019-08-02 08:22:16Z

2

Use threading:

import glob
import threading
import pandas as pd

src = "D:/test/src/*.xls*"
dst = "D:/test/dst/"

def update(excel_file):
    df = pd.read_excel(excel_file)
    df['date'] = "2019-08-01"
    df["date"] = df["date"].astype(str)
    df.to_excel(os.path.join(dst, os.path.basename(excel_file)), index=False)

for file in glob.glob(src):
    threading.Thread(target=update, args=(file,)).start()

answered Aug 2, 2019 at 8:22

Alderven

8,2885 gold badges28 silver badges42 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Loop excel files, add one more column and save them in Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related