From the Editor - Got a Linux Server? Thank a Beowulf.

November 1st, 2004 by Don Marti in

Ten years ago, Donald Becker and Thomas Sterling built a 16-node cluster, the original Beowulf, and started Linux and commodity hardware on a program of relentless improvement.
Your rating: None

In May 1965, IBM Chairman T. J. Watson, Jr., wrote of large scientific computers, “at some point between two and three years ago it became evident that the fallout from the building of such large-scale machines was so great as to justify their continuance at almost any cost” (on Dr Mark Smotherman's site at www.cs.clemson.edu/~mark/acs.html). That doesn't mean that high-performance computing (HPC) startups have an easy time entering the enterprise market. From Control Data to Thinking Machines, history shows that if you concentrate on winning in HPC, you don't get the skills to cross over to regular business customers.

But ten years after the first Beowulf, examples of what Watson called fallout are everywhere on the Linux scene. From smoking out bad power supplies to fixing device drivers to making manageability work for the PC architecture, HPC customers are ruthless in demanding tweaks to turn a rack of off-the-shelf stuff from a maintenance nightmare to an asset. For an IT vendor, an HPC program can work like an automaker's racing program to test cutting-edge ideas and get everyone fired up to win bragging rights.

Early Linux clusters were labor-intensive, with “crash carts” including keyboard and monitor for BIOS access. Today, LinuxBIOS makes the pit crew's work feasible for more and more machines per administrator. See Bernard Li's article on how to take advantage of years of cluster experience from some of the biggest, most innovative Linux supercomputing sites (page 52).

And, forget about manageability for a while—let's talk performance issues. Paul Terry, Amar Shan and Pentti Huttunen might have just sped up many people's work by a whole lot. Check out their scheduler performance numbers on page 68 and prepare for more efficient work on your parallel jobs.

Leigh Orf has some great imagery of thunderstorms, rendered just for this issue, and the software behind them is something you can download and hack yourself. Get some ideas about scientific visualization on page 62, and send us some images.

This issue isn't all clusters—Andres Benitez and Vicente Gonzales show how they turned inexpensive non-networked air conditioners into a money-saving system for a classroom building (page 44). And Nick Moffitt, whose spam-fighting articles have been a hit on the Linux Journal Web site, is here with an introduction to a new, flexible revision control system (page 90).

Whether you're putting together a cluster or enjoying the benefits of Beowulf-driven improvements in hardware, Linux and related tools, have a great time experimenting with all the amazing technology and cool projects in this issue.

Don Marti is editor in chief of Linux Journal.

__________________________


Special Magazine Offer -- Free Gift with Subscription
Receive a free digital copy of Linux Journal's System Administration Special Edition as well as instant online access to current and past issues. CLICK HERE for offer

Linux Journal: delivering readers the advice and inspiration they need to get the most out of their Linux systems since 1994.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
Anonymous's picture

Re: Thanks a Beowulf.

On October 13th, 2004 Anonymous says:

The big cover box at the top of the home page says "Thanks a Beowulf." You might want to change "Thanks" to "Thank". The period looks totally out of place compared to the other titles as well, but that's your call.

Anonymous's picture

Re: Thanks a Beowulf.

On October 18th, 2004 Anonymous says:

Are u an ***** or what? No thanks.

guitronics's picture

Re: Thanks a Beowulf.

On October 27th, 2004 guitronics (not verified) says:

I'd like to know more about Linux Clusters, how 'bout some info?

Less name-calling/insults,please.

robthewolf's picture

re clustering

On December 1st, 2004 robthewolf (not verified) says:

look up info on openmosix. There are many links from there. not much point in me reiterating them.
http://openmosix.sourceforge.net/
there are probably quite a few ways to set it up and get it working. I am currently trying to set up and test my own cluster using older computers. I am using Gentoo to insall the openmosix kernel, there are other methods like clusterknoppix and loaf (see the site). This is turning in to a much bigger project than originally planned. feel free to email me to share ideas.
Rob

robthewolf's picture

it didnt post my email addres

On December 1st, 2004 robthewolf (not verified) says:

it didnt post my email address so to avoid spam it is my name above @hotmail dot com

Anonymous's picture

Re: Thanks a Beowulf.

On October 18th, 2004 Anonymous says:

I was trying to be helpful after noticing a typo.
Feel free to STFU and go back to your instant messaging.

Post new comment

Please note that comments may not appear immediately, so there is no need to repost your comment.
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <pre> <ul> <ol> <li> <dl> <dt> <dd> <i> <b>
  • Lines and paragraphs break automatically.

More information about formatting options

Newsletter

Each week Linux Journal editors will tell you what's hot in the world of Linux. You will receive late breaking news, technical tips and tricks, and links to in-depth stories featured on www.linuxjournal.com.
Sign up for our Email Newsletter

Tech Tip Videos

From the Magazine

December 2009, #188

If last month's Infrastrucuture issue was too "big" for you then try on this month's Embedded issue. Find out how to use Player for programming mobile robots, build a humidity controller for your root cellar, find out how to reduce the boot time of your embedded system, and if you're new to embedded systems find out the basics that go into one. You can also read about the Beagle Board, the Mesh Potato and a spate of other interestingly named items. And along with our regular columns don't miss our new monthly column: Economy Size Geek.


Read this issue