Behind the Cloud It's Still Just Computers

I had the pleasure of joining a video conference with our local Drupal expert, Katherine Druckman, and Barry Jaspan, one of the system architects from Acquia. Acquia is a company that specializes in Drupal. While their company does many things for clients interested in using Drupal, we were specifically talking about cloud computing. Acquia offers a highly available, fully scalable, and managed Drupal environment. For the end user, it means you pay a set amount every month, and your website is always there. It's always updated, it's always backed up, and it's always available. For that magic to happen, however, the folks at Acquia have to play the man behind the curtain and become the Wizard of Oz. That's where the focus of our talk was, and it was fascinating to hear some inside info on running a cloud service. The folks at Acquia actually use Amazon's cloud services to make their own cloud platform. Perhaps that's a cloud within a cloud, but nonetheless it's an economical way to leverage other people's datacenters in order to provide a service of your own. Using Amazon's EC2 service to spin up servers as you need them is great. It does come with some frustrating hinderances too though.

Advantages

  • As client needs grow or shrink, adding or removing servers takes literally seconds.
  • Hardware maintenance is "farmed out" to Amazon. No more failed hard drives, faulty network cards, or power concerns.
  • As a vendor, you only pay for the server power you need. No need to over-buy servers in case you need them.

Disadvantages

  • While spinning up new servers is instant, you're limited (mostly) to spinning up servers. There is no SAN, which can be a real problem.
  • Creating failover support must be done completely with software. Not having actual hardware is an advantage, until you wish you had specialized hardware.
  • Scaling can be challenging. Granted Amazon offers different size hardware, but load balancing and scaling still aren't magic. MySQL for instance still runs on a single server.

That's Where the Magic Happens

At Acquia, they've created a complex backend. Clients don't see anything other than a working service, but they've solved some complicated issues rather nicely. For example:

Drupal's Data Store

Drupal stores local files. Yes, most of the content is dynamically created from the database, but there are some things that Drupal expects to see on a filesystem. Images, documents, files, etc. are stored on a local filesystem and accessed by the web server. In a highly available environment without a shared SAN, that can be challenging. Acquia currently uses a filesystem that is spanned across several servers in such a way that if a server fails, the others keep the filesystem going. It works a bit like a network based RAID5 array. Unfortunately, it doesn't always work the way the Acquians (can I call them that?) like. Rather than just leave a mostly-working system as their default, the architects are working toward a better system. Using Varnish to cache the files, it will likely be possible to allow a seamless failover to a mirrored backup rather than worrying about a network based distributed filesystem. How it will all come together is still being planned, but it's exciting to see software solutions for hardware limitations.

MySQL, Your SQL…

If you were hoping for a magic bullet regarding the scaling of MySQL, unfortunately that's just not in the cards. Oh, there are ways to make it more efficient, with things like memcached, but in the end an instance of MySQL requires a server to run on. Thankfully Amazon offers some pretty beefy server instances if you need them. In the end, expertise is what really makes the database back end able to handle any load. If a site is busy enough to overtax MySQL, even on a huge server, it's time to tune up your Drupal install. If every page load makes 11,837 database calls, there's no MySQL server in the world that can help.

Clouds Don't Make Geeks Obsolete

Cloud computing is really great for end users looking to farm out the management of their servers. It's also really great for a company that wants to offer services, but doesn't want to invest in a datacenter. At the end of the day, however, cloud computing isn't a magic bullet. It still requires geeks behind the curtain keeping things running. The exciting part, at least for me, is that solving problems in the cloud is drastically different than traditional datacenters. I'm an old dog that likes to learn new tricks, and solving application issues within the limitations of virtual servers in the cloud is a whole new game. So go spin up that EC2 instance, and start solving problems. You'll become a pretty valuable employee to someone!

______________________

Shawn Powers is an Associate Editor for Linux Journal. You might find him chatting on the IRC channel, or Twitter

Comments

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

A video conference

Jakele's picture

I have to say that I would also love to join a video conference with your local Drupal expert, it does sound interesting and the whole article made me very curious. http://www.theuen.com/commentaries/new-brood-lord-strategy-video-how-to-...

I like this article, it was

horoscope's picture

I like this article, it was very important for me

Cloud Computing is great when done right.

metalx2000's picture

Cloud Computing is great when done right, and you take steps to protect yourself. I love the idea of being able to easily access my data and programs from anywhere in the world. I'v been doing this for a while with ssh.

For people who want to control their data, have it locally, don't want it stored on some server they don't have control over, and still have easy setup and an easy interface, there is the PogoPlug. I love mine. It makes it easy for my wife to access her files from anywhere and she don't have to do anything but go to my.pogoplug.com and enter her user name and password (or just use the app on her Android Phone). For me, I can mount the pogo drives anywhere on my computer from anywhere and I can still ssh in if I want.

Some people don't want that power or the hassle that comes with it. I will admit I use Google Docs, a lot. I don't really create a lot of spread sheets or write a lot of books. But, I do write a lot of notes. Mostly programing notes. Every time I learn something new I make a new document for it. I could do this on my pogo. I could ssh in to my home computer and do it. But, Google Docs does a real good job of seaching through the documents when I need to find something.

So, I'm not really putting any personal info in my Google Docs. And as far as worrying about Google deleting one of my Docs or cancelling my account (Which has happened to people), every 3 month I download all my Google Docs and burn them to a CD I put in my safe.

So, if you are going to use a Cloud that someone else has control over, especially one that is free, be sure to still back up locally. Just to be sure.

http://filmsbykris.com/
Everything you ever need to know about Open-Source Software.

It's not just computers

Anonymouses's picture

> Behind the Cloud It's Still Just Computers
NO. There are also other things. Vital ones. Like your data.

Where is your data in the cloud? In what country? Which governments have access to it? Do you really trust a company that has you data? What if they ask you more and more money... so that you can access your data? What are the legal implications if you are a company (or a lawyer, or a doctor, or...) and the data of your clients... are in other people's hands?

Yes yes...

Shawn Powers's picture

But the article wasn't a philosophical one. Whether or not the cloud is ideal for an individual is a very pertinent and worthwhile discussion. This was about managing a cloud, and a glimpse behind the scenes.

Shawn Powers is an Associate Editor for Linux Journal. You might find him chatting on the IRC channel, or Twitter

White Paper
Linux Management with Red Hat Satellite: Measuring Business Impact and ROI

Linux has become a key foundation for supporting today's rapidly growing IT environments. Linux is being used to deploy business applications and databases, trading on its reputation as a low-cost operating environment. For many IT organizations, Linux is a mainstay for deploying Web servers and has evolved from handling basic file, print, and utility workloads to running mission-critical applications and databases, physically, virtually, and in the cloud. As Linux grows in importance in terms of value to the business, managing Linux environments to high standards of service quality — availability, security, and performance — becomes an essential requirement for business success.

Learn More

Sponsored by Red Hat

White Paper
Private PaaS for the Agile Enterprise

If you already use virtualized infrastructure, you are well on your way to leveraging the power of the cloud. Virtualization offers the promise of limitless resources, but how do you manage that scalability when your DevOps team doesn’t scale? In today’s hypercompetitive markets, fast results can make a difference between leading the pack vs. obsolescence. Organizations need more benefits from cloud computing than just raw resources. They need agility, flexibility, convenience, ROI, and control.

Stackato private Platform-as-a-Service technology from ActiveState extends your private cloud infrastructure by creating a private PaaS to provide on-demand availability, flexibility, control, and ultimately, faster time-to-market for your enterprise.

Learn More

Sponsored by ActiveState