April 2013 Issue of Linux Journal: High Performance Computing

When I was in college, there was a rich kid down the hall who had a computer with 16MB of RAM. Before you scoff, you need to think back to 1993. The standard amount of RAM in a new computer was 2MB, with 4MB being "high-end". Anyway, this kid's computer was amazingly fast because he could create a RAM disk big enough to contain Windows 3.1 completely, so the entire OS ran from RAM. It was the 1993 rich-kid version of an SSD.

Back then, the most intense computation I ever did on a computer was image rendering with POV-Ray. We all assumed the rich kid would blow us out of the water with his awesome computer running completely in RAM—except that he didn't. Although his computer was indeed the most responsive computer I'd ever seen, it didn't have a math coprocessor. My friend with the 386DX2-66 computer with 4MB of RAM could render POV-Ray images faster than anything I'd ever seen. And, that's when I first understood high-performance computing. Granted, HPC has changed through the years, but the concept remains the same—heavy-duty hardware for heavy-duty number-crunching. And, this month, we focus on HPC in the Linux world.

Reuven M. Lerner starts out the issue with Web security. Firewalls and intrusion detection can't protect you from poor coding, so it's important to develop with a security mindset, and Reuven provides some great information to that end. Next, Dave Taylor reminds us of the other side of what's important with programming: having fun. Dave continues his series on Cribbage and shows how complicated it is to program things that seem simple for humans to do in their heads.

Kyle Rankin helps solve a problem that pops up when taking a laptop back and forth from work to home. Plugging in a different external monitor can be frustrating when all of your programs and windows don't line up the same. If you add a monitor with a different aspect ratio, the frustration can be even greater. Kyle shows how he handles the problem on his own laptop.

In my Open-Source Classroom column, I tackle the issue of overly long URLs. Although it's perfectly acceptable to use a free URL shortener, things like Google shutting down Google Reader remind us that if we're depending on a free service, we can't complain when it goes away. I demonstrate a handful of ways to shorten URLs from your own hosted domain.

And finally, let's get to the meat of this issue—namely, HPC stuff. Adam Monsen describes how to use MapReduce with Hadoop on Linux. Grep is an amazing tool, but there are times when you need to trade in the grep Swiss Army knife for a chainsaw. Adam shows how. If you're facing the issue of grepping enough data to turn to MapReduce, perhaps you also should look into data deduplication. Jeramiah Bowling follows Adam's article with a piece on Opendedup. If you find yourself dedicating the majority of your drive space to storing redundant data, you'll want to read Jeramiah's study.

When you think of high-performance computing, it's unlikely that "Python" is the first language to pop into your head. Joey Bernard explores IPython and SciPy this month, which use parallel processing, bringing HPC functionality to Python code. When it comes to high-performance computing, terms like FIFO buffers, ring buffers and work queues are at least as important as the code being crunched. Alexander Krizhanovsky delves deep into the methods of scaling multicore environments to get the most out of your server farm.

David Strauss rounds out the HPC content with an interesting take on server containers replacing the concept of VMs. Although very much related to the concepts of cloud computing (SaaS, PaaS, IaaS), server containers might be the next logical step in computing solutions. Check out David's article and see what you think.

The HPC issue always makes my own server farm seem insignificant. Granted, most people don't have an entire server rack in their basements like I do, but still, I'm certainly not doing any high-performance computing down there. Computers are, however, becoming more and more powerful while at the same time shrinking physically. It wasn't so long ago that a math coprocessor was the miracle of modern computing. Who knows what tomorrow will bring. Thankfully, with Linux, we'll likely get to experience the newest and best technology early on, and for free. That's what happens when you run a high-performance operating system.

Available to Subscribers: April 1

______________________

Shawn Powers is an Associate Editor for Linux Journal. You might find him chatting on the IRC channel, or Twitter

Comments

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

I really don't understand

juliaware's picture

I really don't understand much technical language but I am sure that This article will be help for all reading this. Website Development Qatar | Website Development Doha

Discount Oakleys,Sale Cheap Sunglasses,Oakley Frogskins

podcfzu8's picture

No matter what, as long as seriously after years of experience, design, production and market demand, will be the public favorite.I like the glasses need a different feeling, and Oakley glasses definitely let you subvert the concept of traditional optical products.Some people may see more celebrities wearing glasses - presumably to look cool, but it looks cool number and did not add much.Oakley Men's Active Sunglasses design did not consider how the world and protect your image. The sunglasses too narrow on both sides of your head?Due to ultraviolet rays can be accumulated, irreversible Damage by the eye is not easy to repair. When buying sunglasses, was not to ignore the anti-ultraviolet function.You can imagine the glasses horizontal split in two, the eye is a little biased on the "dividing line" position for the best. Adjusting the position of the eye glasses nose pads and temple.Gray and green, pastel colors, does not change color in time to see the scenery outside, but also to ensure that depending on the material definition, minimum through external objects color change also.Thin man with a round face photo frame Oakley sunglasses. The human face is a circular frame of elongate shape Oakley sunglasses.You should choose the regular manufacturers of the normal glasses had to Oakley sunglasses UV production function should not just focus on style, ignoring the intrinsic quality.With sunglasses in his hand corners facing the fluorescent light, so that the reflective mirror smooth scrolling, mirror reflection of the fluorescent film appears wavy, distorted shape to prove that the lens is not flat, so that the mirror can damage eyesight.Oakley glasses legend, with their beauty and complexity, is a fantastic personal preference. All of these in the sun, often originally depicted VIP.Polarizing film made according to the principle of the polarization of light, with the effective elimination of the special features of the glare, light filter disorganized, driving improved visual, adding to driving pleasure.Nylon sunglasses lens material advantage in that it has a very high flexibility and excellent optical quality, and impact resistance. Nylon lens shortcomings can not be made into a polarized lenses.The Oakley by strict distortion test, to ensure that the frame of the toughness and stability, mirror arm radian particularly attentive to the skin, weak arm end design, should face contour adjust.Fashion magazines and runway shows, designer eyewear accessories with their plans - that does not belong to sunglasses - either clear lenses or only slightly tinted color lens.Oakley sunglasses of all ages and a variety of colors, shapes and designs are sold in the market. Whether you're the kind of person, and a pair of sunglasses, this is for you.The company's trademark has been integrated into the courage to symphony and write their own life, should have the courage to world-class athletes challenge the physical limits of the global culture.You can wear loose-fitting clothing, but can reflect your personal style, but may lack a huge pair of sunglasses.Proper clothing, ladies can add some devices, the device can each case, get together events in their own clothing line.A fashionable glasses in front of you, grasp the opportunity, let the dream feeling immediately fulfill you.

ドイツ軍がこのアイデアの製品化を時計メーカーに打診している

laulan's picture

ドイツ軍がこのアイデアの製品化を時計メーカーに打診している。1879年にドイツ皇帝ヴィルヘルム1世がドイツ海軍用としてジラール・ペルゴに腕時計を2,000個製作させたという記録が残っている[9]。メンズ腕時計

Reply to comment | Linux Journal

telephone fixe's picture

Great goods from you, man. I have understand your
stuff previous to and you are just too wonderful. I actually like what you
have acquired here, really like what you're saying and the way in which you say it. You make it enjoyable and you still care for to keep it sensible. I can't wait to read far more from you.
This is really a great site.

abut info

Anonymous's picture

I am lucky That I found this web blog, Precisely the right information That I Was searching for!
India Seo Webdesign

not living upto the mobile revolution

Anonymous's picture

Linux though successful on the PC has not been able to transform the same amount of traction on the mobile OS side.

http://www.techendeavour.com/mobile-application-development

web Host

Anonymous's picture

Where is this magazine sold?

Lara, contributor at
gotowebguy.webnode.com jjj45zzz

web Host

Anonymous's picture

Where is this magazine sold?

Lara, contributor at
gotowebguy.webnode.com jjj45zzz

I love this site, thank you

Jiad's picture

I love this site, thank you to all who are created, I learned many things, very positive, a thousand thank you.
voyance mail gratuite

I've had a personal

billwu's picture

I've had a personal experience with bullying and lost a very close friend to suicide due to bullying. I have been helping to assist her sister do anti bullying presentations and it means a lot to me to see the school i go to make this a priority of theirs too. Thank you :)
linde diagnostic tool

Long live Linux

Selidbe's picture

Hi-end OS + Linux = winning combination. Thanks for this informative article.

If you are about to

davidlaw's picture

If you are about to plan any event and worried on the type of facilities to provide for your guests, here is the right solution on sanitary facilities. porta potty rental prices

Reply to comment | Linux Journal

Misty's picture

Thanks for publishing these details online.

Reply to comment | Linux Journal

techplanet7's picture

Everything is very open with a really clear explanation of the issues.
It was really informative. Your site is extremely
helpful. Thank you for sharing!

I'm sure coming again to

sennheiser hd 428's picture

I'm sure coming again to construe these articles and blogs
sennheiser hd 428

cover ad

nawglan's picture

I wish the cover of the epub version wasn't marred by a large microway advertisement.

I'm glad Calibre allows me to replace the cover image.

Reply to comment | Linux Journal

d'leedon's picture

Being surrounded by renowned schools including Cedar Primary School,
Maris Stella High School (Primary), and the St. Andrew's Village suite of Kindergarten to Junior College education. d'leedon

Reply to comment | Linux Journal

Birgit's picture

I was recommended this blog by means of my cousin.
I'm no longer positive whether or not this put up is written by way of him as nobody else recognise such exact approximately my trouble. You're amazing!
Thank you!

Yep. Typo.

Shawn Powers's picture

Dangit, yes, indeed it was a typo that I missed. It was supposed to be 486. The 386 math coprocessor bit was correct, but the generations of CPU had blended in my head.

Also, I didn't mention in the article that we said things like, "The SX stands for 'sux'", but of course those are the things we remember best. Thanks for the correction.

Shawn Powers is an Associate Editor for Linux Journal. You might find him chatting on the IRC channel, or Twitter

Reply to comment | Linux Journal

home business advertiser's picture

Thank you for the auspicious writeup. It in fact was a amusement account it.
Look advanced to more added agreeable from you! However, how can we communicate?

really, it probably means

mi ip's picture

really, it probably means 486DX2-66. mi ip

386DX2-66?

Anonymous's picture

Seriously, what cock! There was no such CPU in the i386 line up.

White Paper
Linux Management with Red Hat Satellite: Measuring Business Impact and ROI

Linux has become a key foundation for supporting today's rapidly growing IT environments. Linux is being used to deploy business applications and databases, trading on its reputation as a low-cost operating environment. For many IT organizations, Linux is a mainstay for deploying Web servers and has evolved from handling basic file, print, and utility workloads to running mission-critical applications and databases, physically, virtually, and in the cloud. As Linux grows in importance in terms of value to the business, managing Linux environments to high standards of service quality — availability, security, and performance — becomes an essential requirement for business success.

Learn More

Sponsored by Red Hat

White Paper
Private PaaS for the Agile Enterprise

If you already use virtualized infrastructure, you are well on your way to leveraging the power of the cloud. Virtualization offers the promise of limitless resources, but how do you manage that scalability when your DevOps team doesn’t scale? In today’s hypercompetitive markets, fast results can make a difference between leading the pack vs. obsolescence. Organizations need more benefits from cloud computing than just raw resources. They need agility, flexibility, convenience, ROI, and control.

Stackato private Platform-as-a-Service technology from ActiveState extends your private cloud infrastructure by creating a private PaaS to provide on-demand availability, flexibility, control, and ultimately, faster time-to-market for your enterprise.

Learn More

Sponsored by ActiveState