Naive parallel import of Compressed MYSQL dump file

gistfile1.bash

# Split MYSQL dump file

zcat dump.sql.gz | awk '/DROP TABLE IF EXISTS/{n++}{print >"out" n ".sql" }'

# Parallel import using GNU Parallel http://www.gnu.org/software/parallel/

ls -rS *.sql | parallel --joblog joblog.txt mysql -uXXX -pYYY db_name "<"

If you installed GNU Parallel you got GNU SQL in the same package, so maybe this is more readable:

ls -rS *.dump | parallel --joblog joblog.txt sql mysql://user:pass@/db_name "<"

good suggestion, tnx!

Works brilliant with 10 threads parallel:

ls -rS data.*.sql | parallel -j10 --joblog joblog.txt mysql -uuser -ppass dbname "<"

OSX compatible:

gunzip -c wiebetaaltwat_stable.sql.gz | awk '/DROP TABLE IF EXISTS/{n++}{filename = "out" n ".sql"; print > filename}'

mysql imports are sequential and this will not have any effect.