Getting Serial: The Ultimate Linux Box S-ATA Disk Subsystem
May 28th, 2003 by Glenn Stone in
One of the big advantages of Linux is you don't need all that much buck to get maximum bang. With the advent of serial ATA disk drives and controllers, I thought we might undertake this approach in hardware as well. Street prices on comparable RAID controllers--I compared the 3Ware Escalade 8500-4, which we use here, to an Adaptec 2400--seem to be fairly close. The new Ultra 320 controllers were double those prices. Likewise with the disk drives; 73GB-class SCSI drives seemed to run at least double their serial ATA brethren, and the speed didn't appear to matter. So let's see how much bang we can get for half the bucks.
The folks at Monarch Computer Systems sent me a serial ATA testbed system: a nice Dual Athlon 2800+ system with 2GB of RAM running Red Hat 9, the 3Ware Escalade 8500-4 drive and three Seagate 80GB S-ATA-150 drives in RAID 5. It also has an ATI FireGL X1 you'll hear about in a subsequent article.
The 3Ware 8500-4 is short as RAID cards go; it's only slightly longer than the end of the 64-bit PCI slot that holds it. The geography of the card is different as well; instead of the connectors for the drive cables going on the top edge of the card (as they would for parallel ATA), they go on the end of the card, away from the bracket--the one closest to the drives. This makes routing the cables easier. Of course, the cables themselves are much smaller than regular parallel ATA cables, not much different in size from a piece of CAT5 network cable. The drives themselves look similar to their parallel cousins, except on the business end. There it looks a lot like the parallel and power connectors have each shrunk into something resembling the dongle slot for a PCMCIA Ethernet card. You can hear a slight but definite clunk as the cable achieves its desired position in either drive or card slot. There aren't any worries about whether the cable is all the way in, as there can be with parallel drives. On the other hand, whatever is holding the connector in doesn't hold it so well that removing it is difficult. Monarch had installed adapters so the standard ATX Molex connectors could power the drives.
3Ware has been quite responsive to the Linux community over the last few years. They have made sure the latest stable drivers end up in the mainstream kernel; the Monarch box was running a Red Hat standard 2.4.20 kernel. In addition, both Web-based and scriptable command-line monitoring tools are downloadable from the 3Ware web site.
And when the rubber meets the road, the serial ATA system holds its own. I compared tiobench numbers between it and the Dell Precision system I reviewed for print recently, which had an Ultra 320 RAID controller and drives, as a benchmark. I was surprised to find the SCSI system was beaten in a few areas, despite being designed to be twice as fast. Serial ATA sequential reads were the biggest factor; while on a single thread, the SCSI drives turned in 95MB/s to S-ATA's 54. When you ramped the thread count up, S-ATA decayed gracefully to 29MB/s through 8 threads, while the SCSI system plummeted immediately to the low 20s at 2 threads and stayed there. On random reads, the S-ATA machine started slower--1.0MB/s vs. 1.5MB/s--but as the thread count increased, it came out slightly ahead, 2.4 to 2.1MB/s. On random reads, more threads means statistically less distance to move for each read; your performance actually goes up. Writing was where the performance difference represented by the dollar cost showed up; the SCSI system wrote a consistent 33-35MB/s across the thread counts, where the S-ATA wrote 10-13MB/s. It was a similar story for random, where the SCSI turned in numbers in the 5MB/s range, whereas S-ATA ran 0.46MB/s.
A few words about configuration are in order here: neither of these systems is completely optimal. The Dell SCSI RAID box is RAID 0, meaning writing is slow in an unaccelerated environment. Conversely, the Monarch S-ATA box has RAID 5 on three drives, when my experience says four drives is the minimum optimal configuration for 3Ware RAID 5 systems. I expect that if we had both systems in full-out RAID 5 configurations, the S-ATA system would give SCSI a thorough thrashing on read, while putting up respectable numbers on write. Again, this is an educated guess; there's no substitute for testing a system against the real world (or as close as you can get without risking your nest egg).
The results are fairly clear: serial ATA is some fairly serious bang for not a lot of bucks. Prices from Froogle, Google's merchandise-finding page, showed the Seagate drives at $145 a pop and the 3Ware 8500-4 at $350 or so. And with 160MB and larger S-ATA disks around the corner and 300MB/s S-ATA controllers on the roadmap, serial-ATA RAID seems to be well on its way to becoming the best way to get a lot of cheap, fast storage in one Ultimate Linux Box.
The roadmap from here to the final Ultimate Linux Box looks like this: next time, we look at the ATI FireGL graphics card, followed by things concerned with sound (I have not forgotten!). I believe the final choice of motherboard and processor will be a welcome surprise, pointing the way to the future of Linux.
We'd like to thank Monarch Computer Systems for providing us with a testbed.
Glenn Stone is a Red Hat Certified Engineer, sysadmin, technical writer, cover model and general Linux flunkie. He has been hand-building computers for fun and profit since 1999, and he is a happy denizen of the Pacific Northwest.
Special Magazine Offer -- 2 Free Trial Issues!
Receive 2 free trial issues of Linux Journal as well as instant online access to current and past issues. There's NO RISK and NO OBLIGATION to buy. CLICK HERE for offer
Linux Journal: delivering readers the advice and inspiration they need to get the most out of their Linux systems since 1994.
Sorry, offer available in the US only. International orders, click here.
Subscribe now!
Recently Popular
| Linux HOWTO: Video Editing Magic with ffmpeg | Jul-23-08 |
| The new business of free radio | Jul-24-08 |
| Why We Must React to ACTA | Jul-24-08 |
| Chapter 16: Ubuntu and Your iPod | Aug-30-06 |
| Boot with GRUB | May-01-01 |
| Building a Call Center with LTSP and Soft Phones | Aug-25-05 |
Featured Videos
Non-linear video editing tools are great, but they're not always the best tool for the job. This is where a powerful tool like ffmpeg becomes useful. This tutorial by Elliot Isaacson covers the basics of transcoding video, as well as more advanced tricks like creating animations, screen captures, and slow motion effects.
Shawn Powers reviews the HP Mini-Note portable computer.
Thanks to our sponsor: Silicon Mechanics
Silicon Mechanics is a leading manufacturer of rackmount servers, storage, and high performance computing hardware. The best warranty offerings available are backed by experts dedicated to customer satisfaction.
From the Magazine
August 2008, #172
There's nuttin like a Cool Project to give you some relief from the summer heat, so get out your parka cuz we got a bunch of em. First up is the BUG, not a bug, The BUG. It's got a GPS, camera and more, in a hand-sized package that's user programmable. The BUG does everything. It's both a floor wax and a dessert topping. Get one now. Need a software version of a Swiss Army knife? Take a look at Billix, and don't leave home without it. Then, chew on this one, an X server on a Gumstix device driving an E-Ink display. Need more storage? How about 16 Terabytes? Can do.
And, of course, we have the usual cast of characters: Marcel, Reuven, Dave, Kyle, Doc, plus the new kid on the block Shawn Powers. But it doesn't stop there: build a MythTV box on a budget, build your own GIS system, set up the tools to monitor your enterprise and more. Finally, remember The War of the Worlds? Now you can play too.
Delicious
Digg
Reddit
Newsvine
Technorati







Re: Getting Serial: The Ultimate Linux Box S-ATA Disk Subsystem
On May 28th, 2003 Anonymous says:
serial-ATA RAID seems to be well on its way to becoming the best way to get a lot of cheap, fast storage in one Ultimate Linux Box
As long, of course, that you don't have to do any random writes. So that just about rules it out for file/print, web, database, multi-user application, mail server, anything write intensive, etc., as compared to scsi performance.
That's one limited Ultimate Linux Box.
Maybe it's time for new subcategories under Ultimate GNU/Linux Box:
RAID levels
On June 2nd, 2003 Anonymous says:
He really should've been clearer on the difference between the RAID levels. RAID 5 usually performs very poorly on writes compared to RAID 0.
Its pretty silly to compare systems running different RAID levels actually.
Also - why do you suggest 4 + drives for a RAID 5 array on 3ware cards? Any specific problems, or does it simply perform better?
What drives do you use with your Escalade?
On June 2nd, 2003 Anonymous says:
I'm using Western Digital 40g and 120g drives with a 3ware Escalade 8500-8 and having serious problems. The disks are connected via Highpoint SATA converters.
The controller constantly reports bad verifies and runs an array rebuild. It's not happy.
So... what disks are you using?
Oh be quiet: His comparison was useless
On May 29th, 2003 Anonymous says:
The comparison was worthless: The SATA system was a raid5.. so with random writes every write required two random reads, and two random writes. Furthermore, on three disks there is no room for writes to operating concurently in raid5 (because every operation will touch two drives). The scsi system was RAID0 so was able to run multiple commands at once.
The article was interesting but it wasn't a comparison. A real, apples to apples, comparison is obviously in order.
Re: Oh be quiet: His comparison was useless
On June 9th, 2003 Anonymous says:
Absolutly Write! Can't compare SCSI Raid 0 v SATA Raid 5. I bet a SATA Raid 0 array v SCSI Raid 5 would reverse the numbers!
I agree a test needs to be done, but not such a flawed test.
Re: Oh be quiet: His comparison was useless
On June 5th, 2003 Anonymous says:
absolutely. completely. 0 vs. 5 is the major issue here, not scsi vs. ata.