Running several scripts in parallel bash scripts on remote machines

Question

in the following bash script , we want to run in parallel several scripts on remote machines

ssh $server_a  /tmp/activate_nodes.bash &
ssh $server_b  /tmp/activate_services.bash &
ssh $server_c  /tmp/activate_components.bash &
ssh $server_d  /tmp/activate_nfs.bash &
.
.
.

not sure about to put the "&" on the end of the script or some other approach ?

Note the target is to run all 25 scripts on 25 diff machines , so all runing of the scripts will be in few second , while scripts proccess on remote machine will still run until end

Seems a fair enough approach to me - what is your concern? If you put a wait at the end of the script it will wait for all the background tasks to end before terminating the script - otherwise the background tasks might get terminated. — code_fodder
– code_fodder, Commented May 5, 2020 at 21:21
my concern is that this steps are simple , and maybe I missed something — jessica
– jessica, Commented May 5, 2020 at 21:24
oh...lol... then its just simple : ) ... remember the wait at the end though - it will be useful : ) — code_fodder
– code_fodder, Commented May 5, 2020 at 21:25
"The target is to run all 25 scripts on 25 diff machines"... do you mean you want to start 625 processes altogether? — Mark Setchell
– Mark Setchell, Commented May 6, 2020 at 17:54

Eric Bolinger · Accepted Answer · 2020-05-06 17:38:13Z

1

Running these in parallel is fine, except for the interleaved output. To save output for later analysis, you can also "tee" the logs for later inspection:

#!/usr/bin/env bash
ssh $server_a  /tmp/activate_nodes.bash      2>&1 | tee ${server_a}_$$.log &
ssh $server_b  /tmp/activate_services.bash   2>&1 | tee ${server_b}_$$.log &
ssh $server_c  /tmp/activate_components.bash 2>&1 | tee ${server_c}_$$.log &
ssh $server_d  /tmp/activate_nfs.bash        2>&1 | tee ${server_d}_$$.log &
wait

edited May 6, 2020 at 17:38

answered May 5, 2020 at 22:20

Eric Bolinger

2,9721 gold badge15 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Jetchisel Over a year ago

I would add 2>&1 before the pipe to catch the error messages too.

Eric Bolinger Over a year ago

Thanks Jetchisel! You should feel free to edit answers (treating SO as a WIKI). Edits are reviewed as well.

Collectives™ on Stack Overflow

Running several scripts in parallel bash scripts on remote machines

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related