Execute multiple mysql satement in shell script parallelly using GNU Parallel

Question

I have a shell script that has multiple load data statements that loads data from csv files into tables in MySQL. How to make use of GNU Parallel to execute these statements in parallel?

My shell script looks like this:

#!/bin/bash

mysql --defaults-extra-file=config.cnf -e "SELECT *
FROM table1
INTO OUTFILE '$path/table1.csv' FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\n';"

mysql --defaults-extra-file=config.cnf -e "SELECT *
FROM table2
INTO OUTFILE '$path/table2.csv' FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\n';"

mysql --defaults-extra-file=config.cnf -e "SELECT *
FROM table3
INTO OUTFILE '$path/table3.csv' FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\n';"

echo "END of script"

Ole Tange · Accepted Answer · 2016-04-30 20:07:59Z

2

doit() {
  table="$1"
  tablepath="$2"
  mysql --defaults-extra-file=config.cnf -e "SELECT *
    FROM $table
    INTO OUTFILE '$tablepath' FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\n';"
}
export -f doit
parallel doit {/.} {} ::: path/table*.csv

answered Apr 30, 2016 at 20:07

Ole Tange

34.1k9 gold badges93 silver badges111 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Execute multiple mysql satement in shell script parallelly using GNU Parallel

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related