Shell script for MultiThreaded File Processing

Question

I have a file which has 10-20 records. I need to call a process over these records. Can someone help me write some multithreaded shell script for it?

your request lacks a bit of info on what is it you're trying to execute in parallel; mind adding some example to your post? — Rubens
– Rubens, Commented Jan 15, 2013 at 16:21

Rubens · Accepted Answer · 2013-01-15 16:23:52Z

1

In a general execution, you may use xargs:

cat file | xargs -n 1 -I {} bash -c 'your_script.sh {}'

Having {} as an argument being given to your_script.sh, and -n 1 determining the number of lines to be passed as arguments to your script.

For example:

$ cat > file
a
b 
c

$ cat > t.sh
echo [ $1 ];

$ cat file | xargs -n 1 -I {} bash -c './t.sh {}'
[ a ]
[ b ]
[ c ]

answered Jan 15, 2013 at 16:23

Rubens

14.8k11 gold badges68 silver badges94 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1