Updated answer (Jan 2020)
xargs is now the recommended tool to achieve parallel execution. It’s pre-installed almost everywhere. For running multiple rsync tasks the command would be:
ls /srv/mail | xargs -n1 -P4 -I% rsync -Pa % myserver.com:/srv/mail/
This will list all folders in /srv/mail, pipe them to xargs, which will read them one-by-one and and run 4 rsync processes at a time. The % char replaces the input argument for each command call.
Original answer using parallel:
ls /srv/mail | parallel -v -j8 rsync -raz --progress {} myserver.com:/srv/mail/{}
Related Posts:
- How do I pause my shell script for a second before continuing?
- In the shell, what does ” 2>&1 ” mean?
- In the shell, what does ” 2>&1 ” mean?
- How do I use a regex in a shell script?
- How to grep for case insensitive string in a file?
- Difference between wait and sleep
- Multi-line string with extra space (preserved indentation)
- Multi-line string with extra space (preserved indentation)
- ‘\r’: command not found – .bashrc / .bash_profile [duplicate]
- ‘\r’: command not found – .bashrc / .bash_profile [duplicate]
- How can I check if a directory exists in a Bash shell script?
- How can I declare and use Boolean variables in a shell script?
- How to reload .bashrc settings without logging out and back in again?
- How can I declare and use Boolean variables in a shell script?
- How to reload .bash_profile from the command line?
- What is the purpose of “&&” in a shell command?
- Replace one substring for another string in shell script
- How can I count all the lines of code in a directory recursively?
- How can I kill a process by name instead of PID, on Linux?
- Which characters need to be escaped when using Bash?
- Shell: How to call one shell script from another shell script?
- find: missing argument to -exec
- How to check if an environment variable exists and get its value?
- How to convert a string to lower case in Bash?
- Create a new file in git bash
- How to specify the private SSH-key to use when executing shell command on Git?
- Sorting data based on second column of a file
- Multi-dimensional arrays in Bash
- Variable interpolation in the shell
- What’s the meaning of the parameter -e for bash shell command line?
- zip error – Nothing to do
- Check existence of input argument in a Bash shell script
- Associative arrays in Shell scripts
- How to split one string into multiple strings separated by at least one space in bash shell?
- Copy multiple files from one directory to another from Linux shell
- Shell script not running, command not found
- source command not found in sh shell
- Difference between sh and Bash
- Integer expression expected error in shell script
- What is the difference between double and single square brackets in bash?
- How do I tell if a regular file does not exist in Bash?
- How to create a file in Linux from terminal window? [closed]
- Extract substring in Bash
- Ubuntu says “bash: ./program Permission denied” [closed]
- Read a file line by line assigning the value to a variable
- What does export PS1=”\[\033[36m\]\u\[\033[m\]@\[\033[32m\]\h:\[\033[33;1m\]\w\[\033[m\]\$ ” mean in MacOS’ bash Terminal?
- How to concatenate string variables in Bash
- How do I execute a bash script in Terminal?
- -bash: syntax error near unexpected token `newline’
- Loop through an array of strings in Bash?
- Parsing JSON with Unix tools
- How to check if a variable is set in Bash?
- “[ ]” vs. “[[ ]]” in Bash shell
- Pseudo-terminal will not be allocated because stdin is not a terminal
- Cannot use mkdir in home directory: permission denied (Linux Lubuntu)
- How do I compare two string variables in an ‘if’ statement in Bash?
- Using find command in bash script
- How can I compare numbers in Bash?
- Is bash a programming language?
- Emulating a do-while loop in Bash
- Pass variable from one Jenkins stage to others in sh
- How to change the output color of echo in Linux
- What is cp: cannot stat error in Unix, I get this error when trying to copy thing from one folder to another
- How to use gdb with pipes and stdin
- How do I set a variable to the output of a command in Bash?
- Grep ‘binary file matches’. How to get normal grep output?
- Bash if statement with multiple conditions throws an error
- What is the difference between “#!/usr/bin/env bash” and “#!/usr/bin/bash”?
- Laravel PHP Command Not Found
- Getting an “ambiguous redirect” error
- Bash syntax error: unexpected end of file
- Is there a “goto” statement in bash?
- How do I edit $PATH (.bash_profile) on OS X?
- Difference between return and exit in Bash functions
- Check number of arguments passed to a Bash script
- How to modify a global variable within a function in bash?
- Run a string as a command within a Bash script
- choosing between $0 and BASH_SOURCE
- Fast ping sweep in python
- Writing a simple shell in C using fork/execvp
- Using SED with wildcard
- chmod: changing permissions of ‘my_script.sh’: Operation not permitted
- How can I check if a program exists from a Bash script?
- Bash command to sum a column of numbers
- Is there anything in Zsh like .bash_profile?
- Running programs in parallel using xargs
- Linux find and grep command together
- How to output a multiline string in Bash?
- How to ssh from within a bash script?
- Bash mkdir and subfolders
- Bash mkdir and subfolders
- Linux Bash: Move multiple different files into same directory
- What is a simple explanation for how pipes work in Bash?
- Error handling in Bash
- Timeout a command in bash without unnecessary delay
- Error when using ‘sed’ with ‘find’ command on OS X: “invalid command code .”
- Check if array is empty in Bash
- Run an interactive bash subshell with initial commands without returning to the (“super”) shell immediately
- Clean way to write complex multi-line string to a variable
- How to run command as user who has /usr/sbin/nologin as Shell?