Tutorial by Examples

Many repetitive jobs can be performed more efficiently if you utilize more of your computer's resources (i.e. CPU's and RAM). Below is an example of running multiple jobs in parallel. Suppose you have a < list of files >, say output from ls. Also, let these files are bz2 compressed and the fo...

Now, let's imagine we have 1 large file (e.g. 30 GB) that needs to be converted, line by line. Say we have a script, convert.sh, that does this <task>. We can pipe contents of this file to stdin for parallel to take in and work with in chunks such as <stdin> | parallel --pipe --block &l...