Patronage & Donations
If you use the Slackware UK services on a regular basis, and would like to contribute to running costs, make a continuing patronage (and receive special benefits), or make a one off PayPal payment, please use one of the following buttons:
Patreon Logo
For regular monthly donations
PayPal Logo
For one time donations
All donations will be gratefully received - thank you!
Toggle theme:Toggle Theme Button
Content of directory's README

This program is used to split up data from stdin in blocks which are
sent as input to parallel invocations of commands. The output from
those are then concatenated in the right order and sent to stdout.

Splitting up and parallelizing jobs like this might be useful to speed
up compression using multiple CPU cores or even multiple computers.

For this approach to be useful, the compressed format needs to allow
multiple compressed files to be concatenated. This is the case for
gzip, bzip2, lzip and xz.

Example 1, use multiple logical cores:
splitjob -j 4 bzip2 < bigfile > bigfile.bz2

Example 2, use remote machines:
splitjob "ssh host1 gzip" "ssh host2 gzip" < f > f.gz

The above example assumes that ssh is configured to allow logins
without asking for password. See the manpage for ssh-keygen or do
a google search for examples on how to accomplish this.

Example 3, Use bigger blocks to reduce overhead:
splitjob -j 2 -b 10M gzip < file > file.gz

For "xz -9" a block size of 384 MB gives best compression.

Example 4, parallel decompression:
splitjob -X -r 10 -j 10 -b 384M "xz -d -" < file.xz > file

Icon  Name                    Last modified      Size  Description
[<--] Parent Directory - [!!!] README 2022-07-30 05:29 1.1K [TXT] slack-desc 2022-07-30 05:29 897 [SPT] splitjob.SlackBuild 2022-07-30 05:29 2.9K [   ] splitjob.info 2022-07-30 05:29 314
Server (facade0) bandwidth utilisation
0  Bandwidth graph measuring   0.14 Gbit/s  10 Gbit/s