Python copying multiple files simultaneously (Multithreading)

Question

I have some python code that I use to copy files from one directly to another, however it is a very slow process and is sequential. I would like to find a way to do multithreading, copying more that one by one file, but rather have 10 or 100 processes running doing this. Here is my current core that process one by one file:

import os
import shutil

directory = "All_files"

with open('files.txt','w') as f:
    for filename in os.listdir(directory):
        src = directory+"/"+filename+"/02-Partners.pdf"
        file_exists = os.path.exists(src)
        if file_exists == True:
            dst="part/"+filename+"_"+"02-Partners.pdf"
            shutil.copyfile(src,dst)
            f.write('%s \n' % (filename))

Any assistance in getting multiple files copying at the same time will be appreciated.

try the threading library it is part of python's standard library — Dodu
– Dodu, Commented Jun 14, 2022 at 13:39

savingDuck468 · Accepted Answer · 2022-06-14 14:07:05Z

1

Take a look at python's threading basic package and see if it fits you.

https://docs.python.org/3/library/threading.html

answered Jun 14, 2022 at 14:07

savingDuck468

3471 gold badge2 silver badges6 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python copying multiple files simultaneously (Multithreading)

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related