Increase your Download speed

It is true that wget is ultimate command line downloader. But when it comes to download acceleration wget fails to deliver the download speed.

Linux and UNIX oses can use Axel and prozilla programs. These programs opens more than one HTTP/FTP connection per download and each connection transfer its own, separate, part of the file. It may sound weird, but it works very well in practice.

For example, some FTP sites limit the speed of each connection; therefore opening more than one connection at a time multiplies the allowable bandwidth. Be forewarned that some FTP operators don’t like it when you do this. It is better to open the additional connections on several servers and download from all of them simultaneously.

This article covers the installation and usage of download accelerator. You will surprise to see how much difference these accelerators program can make. read more…


Installation and Configuration of Condor cluster

Manage compute-intensive jobs with Condor.

Condor lets you queue multiple jobs, searches for free machines on the network (those with no keyboard activity, no load average, and no active Telnet users), and submits jobs to them, then returns the results to the machine from where it was submitted. Condor is a batch system — once a job is submitted, there is no interaction between the job and the user. Any input to the job must be in a file which is submitted along with the executable to the Condor pool, while all the output during the execution of the job is written to a file, which is sent back as the result of execution to the submitting machine.

read more…