How to execute a Bash script multiple times in parallel with different arguments each time?

Question

I haven't explained this question enough so it was misunderstood as duplicate.

I want to read N lines each time of a CSV file and execute a script that operates the lines (names). How can I send N lines as an argument to another script and execute it in parallel?

The file is a CSV with +400000 lines like this:

nombre,ape_paterno,ape_materno
ALFREDO,AGUILAR,AGUILAR
ANGEL,AGUILAR,AGUILAR
CARLOS,AGUILAR,AGUILAR
DANIEL,AGUILAR,AGUILAR
EDUARDO,AGUILAR,AGUILAR
ELIZABETH,AGUILAR,AGUILAR
FERNANDO ,AGUILAR,AGUILAR
FRANCISCA,AGUILAR,AGUILAR
FRANCISCO ,AGUILAR,AGUILAR
FRANCISCO JAVIER,AGUILAR,AGUILAR
...

I want something like this:

{
read 
while IFS="," read $N lines
do 
   sh ${DIR}/Downloader.sh $N-Lines-as-argument &
done } < "$input"
wait

I have tried the answers from here but my result gives null.

It is a duplicate, did you try answers from any of those other page? — Inian
– Inian, Commented Apr 6, 2017 at 18:36
@anubhava GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin16) — forkfork
– forkfork, Commented Apr 6, 2017 at 18:51
@forkfork: Can you show your attempted code in question that is giving null output — anubhava
– anubhava, Commented Apr 6, 2017 at 19:02

anubhava · Accepted Answer · 2017-04-06 19:12:09Z

1

You can use this script in BASH:

#!/bin/bash

n=50 # number of line to read every time

while read -r && arr=("$REPLY"); do
   # read n-1 lines using a for loop
   for ((i=1; i<n; i++)); do
      read -r && arr+=("$REPLY")
   done
   # call your script using 50 element array as argument
   bash ${DIR}/Downloader.sh "${arr[@]}" &
done < file

answered Apr 6, 2017 at 19:12

anubhava

790k67 gold badges603 silver badges671 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to execute a Bash script multiple times in parallel with different arguments each time?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related