GitHub - gordonread/parallel

Simple bash script to run commands in parallel.

$ parallel --help
Usage: parallel [options] [command [args]] [files]

Run command on items in stdin or following in parallel. File optionally represented in command with {}

ls | parallel gzip
ls *.gz | parallel --quiet --jobs 20 gzip -d
parallel --command "gzip -d" --files "*.gz"
parallel gzip -d *.gz
find . -type f -print0 | parallel -0 gzip
ls bzip2.* | parallel ls -l {} \; gzip -v {} \; ls -l {}.gz

Options:
  -h|--help            Display this help
  -0|--null            Input items separated by null
  -j|--jobs [arg]      Number of jobs, default 32,
  -l|--load [arg]      Maximum load,
  -s|--stop            Stop if a command errors,
  -k|--keep-going      Keep going even if command fails
  -c|--command [arg]   Run command given...
  -f|--files [arg]     ... On these items
  -q|--quiet           Don't echo commands
  -n|--dry-run         Dry run - print but don't execute commands

Can be used in a similar way to xargs by piping the result of a command to parallel: