running two scripts simultaneously from a master script when each script has multiple threads within it in python

Question

I want to run two or more python scripts simultaneously from a master script. Each of these scripts already have threads within them which are running in parallel. For example I run

script1.py

if __name__ == '__main__':
    pid_vav = PID_VAV('B2')
    t1 = threading.Thread(target=pid_vav.Controls)
    t1.daemon = False
    t1.start()
    t2 = threading.Thread(target=pid_vav.mqttConnection)
    t2.daemon = False
    t2.start()

script2.py

if __name__ == '__main__':
    pid_vav = PID_VAV('B4')
    t1 = threading.Thread(target=pid_vav.Controls)
    t1.daemon = False
    t1.start()
    t2 = threading.Thread(target=pid_vav.mqttConnection)
    t2.daemon = False
    t2.start()

I am running this script1.py and script2.py separately. Only difference is the parameter which I am passing to the class. Is it possible to have a master script such that if I just run that, both these scripts will run ?

Thanks

First off the above code cannot run from another script because __name__ will be __main__ only if the file is invoked if it is imported that piece of code won't work. If you want to make it work you need to move that code to a function and import that function in the master script and call both the functions simultaneously — jaswanth
– jaswanth, Commented Jan 31, 2020 at 10:26
@jaswanth the runpy module works around that, but of course that's not pretty. — o11c
– o11c, Commented Feb 3, 2020 at 4:11
I am not realizing why the question is being downvoted.If anyone understands why, please help me understand — chink
– chink, Commented Feb 7, 2020 at 5:28

Kasem Alsharaa · Accepted Answer · 2020-02-09 19:52:14Z

5

Assuming you want the output of both scripts to be shown when you run the master script.
You can make use of the subprocess module to call the python file, and you can use the threading module to start separate threads

from threading import Thread
import subprocess

t1 = Thread(target=subprocess.run, args=(["python", "script1.py"],))
t2 = Thread(target=subprocess.run, args=(["python", "script2.py"],))

t1.start()
t2.start()

t1.join()
t2.join()

answered Feb 9, 2020 at 19:52

Kasem Alsharaa

9201 gold badge6 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

DeenaDeepak · Accepted Answer · 2020-01-31 13:37:15Z

2

If u want to trigger 2 scripts from a master script u can use the below method. It will help you trigger both scripts as thread and the thread can also produce different threads based on the callable scripts. You can even make Scripts run independently.

import subprocess

pid1 = subprocess.Popen([sys.executable, "script1.py"]) 
pid2 = subprocess.Popen([sys.executable, "script2.py"])

answered Jan 31, 2020 at 13:37

DeenaDeepak

1111 gold badge1 silver badge9 bronze badges

3 Comments

chink Over a year ago

When I run this in a separate script, the script ran without error, but nothing was happening?

gelonida Over a year ago

was the separate script in the same directory than script1.py and script2.py?

DeenaDeepak Over a year ago

You can save this snippet as a separate script and run the script !!! keep your scripts parallel to this script. then this script will help you to execute both your script.

n1tr0xs · Accepted Answer · 2020-02-09 19:20:58Z

1

Yes, ofc.

script_master.py:

from os import system
system('start script1.py && start script2.py')

But I think you could to use this code:

script_together.py:

if __name__ == '__main__':
    todo=[]

    todo.append(threading.Thread(target=lambda: PID_VAV('B2').Controls, daemon=False))
    todo.append(threading.Thread(target=lambda: PID_VAV('B4').mqttConnection, daemon=False))
    for th in todo:
        th.start()
    for th in todo:
        th.join()

edited Feb 9, 2020 at 19:20

answered Jan 31, 2020 at 10:24

n1tr0xs

4072 silver badges9 bronze badges

7 Comments

n1tr0xs Over a year ago

@cvg I think yes, but I`m cant test.

chink Over a year ago

can you help me understand how it runs in background. 2 threads for each argument ?

chink Over a year ago

thread1 is doing operations related to B2 only, how many threads will be running?

n1tr0xs Over a year ago

@cvg but in question you wrote pid_vav = PID_VAV('B4')

chink Over a year ago

operations of thread 1 are performed twice, once for each parameter , but both the operations are done for paramter B2 only.

|

soitgoes · Accepted Answer · 2020-02-09 20:37:28Z

If you're happy to have the code for both live in one file, you can use multiprocessing to run them concurrently on different CPU cores.

import multiprocessing as mp
from threading import Thread

def start_process(pid_vav_label):
    pid_vav, threads = PID_VAV(pid_vav_label), []
    threads.append(Thread(target=pid_vav.Controls))
    threads.append(Thread(target=pid_vav.mqttConnection))
    for thread in threads:
        thread.start()
    # Join if necessary
    for thread in threads:
        thread.join()

if __name__ == '__main__':
    processes = []
    for label in ['B2', 'B4']:
        processes.append(mp.Process(target=start_process, args=(label,)))
        processes[-1].start()
    # Again, can join if necessary
    for process in processes:
        process.join()

Collectives™ on Stack Overflow

running two scripts simultaneously from a master script when each script has multiple threads within it in python

4 Answers 4

Comments

3 Comments

7 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

3 Comments

7 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related