The Open Source Force Behind the Obama Campaign

JFK said "Victory has a thousand fathers, but defeat is an orphan." So I'm here to claim Linux-based geek paternity for the successful presidential campaign of Barack Obama. The geeks didn't do it alone, of course. But their role was huge.

I had been following that role ever since covering the Howard Dean Presidential Campaign back in '03-04 for Linux Journal. Get your flashbacks at Saving the Net, The Syndication Solution, Letters from the Campaign Pressure Cooker, Hacking Democracy, Lessons on Open Source Politics from the Campaign Forge — in that order.

So, when it became clear that there was lots of geek power operating in and around the Obama campaign, an assignment developed: write about it for the November '08 issue of Linux Journal, which would hit the stands in late October, just before the election.

This I did. After working hard on researching and writing the piece, and whittling it down to three thousand words, it turned out that we had more than enough purely Linux-related stuff for that issue, and the piece was shelved until after the election, which is where we are now.

Rather than update the piece with more recent data and quotage, I decided to run it as I wrote it in August. To my surprise, the story isn't stale. Instead it marks a point — one among many — when history was being made. One suspected that at the time. One knows it now.

Here goes.


August 11, 2008

Since the dawn of mass media, the most obvious activity of political campaigns — especially presidential ones — has been image-making. You paint a flattering portrait of your candidate and an unflattering one of his or her opponent. In the 2008 presidential campaign "cycle" (as the professionals call it), the candidate with the best paint job so far (as of mid-August, when I'm writing this) has been Barack Obama. In "What Obama Can Teach You About Millenial Marketing" Advertising Age says ,...the unabashed embrace of select brands by millennials, from technology to beverages to fashion, has made this decade a true golden era of marketing for those who know what they're doing. And "...when it comes to marketing, the Barack Obama campaign knows what it's doing. Mr. Obama's brand management, unprecedented in presidential politics, shows pitch-perfect understanding of the keys to appealing to the youngest voters...His success, it seems, is a result of both product and the branding behind it."

Reading this I am reminded of Isaac Asimov's distinction (in Second Foundation) between "the answer that satisfied" and "the answer that was true". Because much of the Obama campaign's success so far isn't about branding, demographics, or even politics as we've known it for too long. It's about using technology to make democracy work.

The story begins in 2001, when a political operator named Joe Trippi went to work as an advisor to Progeny, the company headed by Ian Murdock, whose first name is the second half of Debian. Two years later Joe was running the presidential campaign of Howard Dean, who owed much (if not nearly all) of his grass roots support and fund-raising success to smart (and cheap) use of the Net -- and lots of open source geekery. "I always wondered how could you take that same collaboration that occurs in Linux and open source and apply it here," Joe told Larry Lessig in a 2003 interview. "What would happen if there were a way to do that and engage everybody in a presidential campaign?" When Larry asked Joe if that made Dean's an open-source campaign, Joe said, "Yes... I guess it’s about as open as you can do it in modern-day politics".

In his own blog, Ian Murdock said of Joe, "Within the first hour of talking with him, Joe understood the open source movement as well as I did and was able to show me things I hadn't been able to see even after eight years."

The first time I met Joe was in a video IM session. Joe's face was on the screen of my laptop in California, while my face was on Britt Blaser's laptop, which he carried around the halls and meeting rooms of the Dean Campaign headquarters in Burlington, Vermont — as if he were a waiter with a talking snack tray. The tour worked so well that I was already familiar with the layout of the place when I arrived in the dead of Winter and the height of the campaign's energy: mid-January, 2004, on the eve of the Iowa Caucuses.

Several memories of that visit stand out for me. One is of Nicco Mele minding racks of servers and other LAMP-based electronics, and grumbling about what a mess it was dealing with the various state and local party operators, each with their own patched-together tech, which usually qualified more as problems than as "solutions". Another is of Zack Rosen, sitting on a box in the corner of a cubicle with three or four other geeks, hacking something in Drupal. Zack got involved through HackersForDean, which he did with Josh Koenig. Another is of Dave Winer, working on what he called "a really interesting RSS project to roll out in time for the Iowa caucus results on Monday night." Posting that same day (January 17), Dave added, "I am neutral on the Democratic presidential candidates. I may have opinions, but in my technical work, they're simply not relevant. I believe in politically agnostic tools."

Looking back, I think what I saw was the equivalent for politics of the Tech Model Railroad Club or the Home Brew Computer Club. It was where a new and highly practical tech movement started. Britt Blaser calls it "the first campaign that functioned more like a Web service than a marketing blitz".

Dean dropped out of the race after losing in Iowa, but neither the techies nor their code were running for office. Instead the "Dean Diaspora" began the work of improving democracy with free and open technology.

One member of that diaspora was Jascha Franklin-Hodge. "After I got back to Boston I started reconnecting with some of my friends that I had been ignoring for six months", Jascha told me. "And the thing I kept hearing from people was, 'Oh you worked for Howard Dean. That's so cool. I went to a meet-up and a I started volunteering in my local democratic party. I went up to neighbors and knocked on doors'. These were people for whom the experience of being involved wasn't just about supporting a candidate. It was also about finding their own political voice, finding their own civic talent."

So Jascha got together with three other Dean tech veterans -- Clay A. Johnson, Joe Rospars, and Ben Self -- and started Blue State Digital. In a June 2008 story, Business Week called Blue State Digital "Obama's secret political weapon". By the end of July Blue State's work was behind more than $200 million raised online, 1,000,000 users and 75,000 campaign events. By the time you read this, those numbers will be way low.

I became acquainted with Blue State Digital's work for the Obama campaign on June 3 of this year, when I got an email pointing me to a MyBO ad with the filename "techinterest?foo". The ad recruited "exceptionally talented web developers" with "A deep understanding of LAMP development processes and best practices", "Experience scaling (a) large LAMP application", "Experience building complex applications using PHP and MySQL" with "deep knowledge of MySQL performance and query optimization" and "Advanced or expert CSS, Javascript, and AJAX skills". The email also noted that McCain's campaign site runs on Windows.

Blue State hardly needed the ad. As Jascha put it to me, "The work that we do does put us at a huge advantage when shopping for talent. What we do is bigger for a lot of developers than making software for a bank. We want geeks to get up and be happy in the morning, and think 'I'm building something today that millions of people tomorrow are going to use to help change the world'."

The Obama Campaign isn't much into "social computing" of the Facebook and MySpace sort. But it's outstanding at using computing to make the campaign social in the real world.

When I go to MyBO and look for events within 25 miles of my zipcode near Cambridge, 64 come up. They include: community organizing meetups, musical performances, speech-watching parties, gatherings at farmers markets and carnivals, fundraisers with notables, church picnics and barbeques, stagings for voter registration walks, carpool caravans, youth organization rallies, school alumni coffees... the list goes on and on. All within the next month. Each event is marked by a little symbol on a Google map. Above both the list and the map are three buttons: a green KML one for Google Earth, an orange XML one for RSS feed, and a green ICAL one to create calendar files.

To the right of the map is the my.BarackObama column. From the top it has My Dashboard, My Neighborhood, Friends, Events, Messages, Groups, Fundraising and My Blog. The last six are headings to the right of a "+". Expand those and you'll find 18 ways to engage with with other people, the campaign, or both. And still there is plenty of white space. The page's action is fast, smooth, simple and clean.

When I go to the McCain campaign website and look for events within the same 25 miles, 16 come up: 13 are appeals to join phone banks or to volunteer in some other way; 3 are for parties by individuals on the same "national event day", and each has the same canned copy.

Of course this isn't fair. Massachusetts is not only an exceptionally blue state, but home to Blue State Digital as well.

So I just ran the same test for 85018, a zip code in central Phoenix: the heart of McCain Country. There I get 23 events for Obama events and 16 for McCain. Obama's have the same variety as those around Boston. McCain's all seem to be stamped out under personalized headers. There are 13 parties (mostly given by individuals) on the same "national event day" as those in Boston. Each has the same boilerplate copy. Three are scheduled for other times. Two of those involve veterans.

So, how does Blue State do it? And how exactly are Linux and open source involved? Here's how Jascha put it to me:

Almost all of our tools put user interaction and user creation first. Take events management systems. In the past they were made so an organization could post its official calendar online. We said that's great but not nearly as interesting as letting your supporters create their own calendars. So we created tools where the first priority was to make it easy for somebody coming onto the website to host a house party, or to arrange to pick up litter alongside a highway while wearing t-shirts for their organization: everything from the mundane to the innovative. We wanted to make it easy to create an event, schedule it, make it searchable, handle RSVPs, and for people to do their own fund-raising.

The two services we use most in the context of events are Google and Yahoo's mapping and geocoding APIs. We'll geocode your address with lon/lat, and use that to place nearby events.

We have lots of databases of other geographical information. For example, the lon/lat center of a Zip+4. Congressional districts for zip codes, census information, census tract, block numbers... If you're just filling out a sign-up form, we don't require you to put in everything. If you donate later, we can get your address then if you don't want to give it at first.

The stack is LAMP: Linux, Apache, MySQL, PHP. On the back end we use lots of open source libraries and tool kits. We use YUI, and Ext, which are javascript UI libraries. One of our developers is the creator of the Horde project, which is a big open source PHP framework.

We don't like to re-invent wheels. So, for example, we don't write our own database connection library. We're using ADOdb, which is one of the more popular ones for PHP, and python as well. We use PEAR, which is PHP's library of tools and utilities. We use PEAR modules for everything from sending email to doing caching... We use things like memcached. We use open source monitoring tools.

We use RSS all over the place: events, blogs... we use it to link parts of our own system internally, say to share information between two different client systems, or between two parts of our system. Wherever possible we try to build those interface points around accepted standards for interchange. If they need to be opened up, or if the client wants direct access to them, we say "go ahead and use whatever RSS library you have".

If we're working with a tool and add a significant feature to it, or fix a bug, we of course share that with developers and the project.

The front end, however, is all stuff that we've purpose-built for political and nonprofit organizations -- or anybody that wants to engage membership with a bigger goal in mind.

While the Obama Campaign hogs the spotlight, other Dean-vintage hackers are busy working on something both Obama and McCain have been advocating as senators: transparency and accountability in government. Greg Elin, a data specialist with the Sunlight Foundation and the family of efforts it supports (OpenCongress.org, Congresspedia.org, FedSpending.org, OpenSecrets.org, EarmarkWatch.org, LOUISdb.org...):

Almost all of our projects and funded projects are open source -- though sometimes our code is a bit hacked so it takes a while to release it. Nearly every group I know is completely invested in open source: MySQL, PostgreSQL, Apache... The frameworks are being rapidly adopted: Rails, Django, Symfony...

The work I'm most interested in these days is dynamic-scripting -- what I think about as "flow-and-go" data sets instead of what Jeff Jonas coined as "rack-and-stack" data sets. Dynamic scripting is Unix pipes! That is, every application does input and output. We leave the world of databases-make-reports and enter the world of RSS-flows-in and RSS-flows-out.

Two examples of flow. A Sunlight database, LouisDB.com, scrapes the Congressional Daily Record daily, transforming it into XML. Garrett Schure (Sunlight Labs developer) and Josh Ruihley did a word count algorithm on the Congressional Record to come up with Congress' "Word of the Day" and the microsite http://capitolwords.org — which goes back to 2001 and has an RSS feed, API, and a widget people can put on their site. Louisdb.com makes it easier to search the Congressional Record — and now there's a script boiling it down into tweetable content that others can use, too. Second example, from MySociety: TheyWorkForYou. It provides profiles of what Members are doing in Parliament by parsing the Parliament's daily record and votes. Lastly, many sites rely on the work of Josh Tauber's http://govtrack.us b/c. Josh scrapes all sorts of data on bills in Congress and transforms it into XML. Josh's data is open and so also is his code. It's a tremendous contribution.

And what about Howard Dean? Well, in 2005 he became Chairman of the Democratic National Committee. His old presidential campaign site, DeanForAmerica, morphed smoothly into DemocracyForAmerica, which supports many candidates instead of just one. Says Jascha, "He took all these people, who in some cases had taken over their local democratic party organizations, and helped them channel that energy and that civic spirit towards electing democratic and progressive candidates around the country. They've raised money for people. They've gotten the word out, coordinated volunteers. Here in Boston you had a city councilman, Sam Yoon, who won an at-large city council seat with tremendous support from DFA. All these people who had been involved with Dean went out and volunteered for Yoon."

Britt Blaser:

Before Dean, politicians don't know the Internet was created by makers, not by machers, which is political-speak for powerful deal-makers who rule politics through influence, money and arm-twisting. The Dean campaign's Internet staff -- its makers -- was the nucleus of a new class of political experts, focused on means rather than ends. Like Linux hackers, Dean’s makers felt and acted more like a guild than partisans, and they similarly related more easily to people outside the campaign than to their bosses. Since most of them were volunteers, the concept of boss didn't mean a lot to them. They were seeking collaborators outside the campaign for political purposes, but the tools they built map surprisingly well to governmental purposes, since every issue becomes law after a successful campaign for hearts and minds and money.

Which is all very good. But is it good enough? Of all the interactions I've had with Dean-vintage veterans, one with Liza Sabater stands out. Like several others, she lamented the late CivicSpaceLabs (a creation of Zack Rosen and others). Among other things, it did wonders with Drupal.

"The truth is that there is not one open source project out there that comes closes to the promise of CivicSpaceLabs", Liza says. "And that to me is the fundamental difference between the 2004 and the 2008 elections. For all the talk about Obama's campaign being netcentric and groundbreaking, the code to their site is still proprietary. I don't foresee the Obama campaign releasing that code to make it easier for any and all people to replicate what they have created. Same thing, by the way, with MoveOn.org, Democracy For America and even the organizing tools created by the DNCC."

Phil Windley, former CIO for Utah, isn't happy with what he sees from either campaign: "My view from here is that the 'Net is being treated like a big broadcast medium with a built-in cash register".

Greg Elin puts this uneven progress in perspective:

Programmers and technologists who grew up with the web and with open source have been entering the political and e-government arena the past several years bringing with them the tools and practices of open source and Web 2.0. They are collaborating with -- and sometimes competing with -- existing technologists who were often activists who learned spreadsheets and databases and desktop publishing and then the web to communicate their message. So we are seeing a geek-i-fication of everything from campaigns to good government groups to government itself. More open source. More frameworks. More collaborative communication among individual developers. It's uneven, it's bumpy, but it is definitely happening. The tipping point has occurred now in politics and government -- the question remains only where the tree is going to land.

Democracy shouldn't be about candidates and campaigns as products or brands. Image matters, but it's still just superficial. The substance of democracy is what hackers have known for the duration: freedom, liberty, openness, generosity, and constructive responsibility. The best code doesn't just win. It just works.

We need to keep doing that. And teaching it too.

______________________

Doc Searls is Senior Editor of Linux Journal

Comments

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Youtube relies on proprietary and patented Flash

Anonymous's picture

Youtube relies on proprietary and patented Flash. So Obama excludes free software users. He propotes the usage of patented royalty-bearing file formats such as h264.

... what open-source force? Obama's backed by Steve Ballmer

Zerias's picture

this article had me dropping my jaw. Obama is and was backed by Steve Ballmer. If there ever was a clear indication of a candidate to AVOID and get the hell away from for Open Source supporters, I can't think of anything clearer. Thanks a lot. Open Source has officially been screwed over by idiots supporting Obama that simply do not understand what the Liberal Democrat party stands for, and who the friends of the Liberal Democrats are. http://zerias.blogspot.com/2008/11/open-source-is-screwed.html

What about JQuery?

forklifts's picture

don't get me wrong i'm no fan boy of microsoft, but things have changed there. There are communicating with the Linux team to bring silverlight, and the fact they've included JQuery into visual studio says alot. I don't think it's fair to bash Microsoft for open source because how could they pay the thousands of developers working on platforms.

Maybe...

fpoole's picture

Maybe Ballmer backed Obama not because of any support for his shady business practices but because even Microsoft requires that the economy enables some degree of prosperity of the proletariat-I-mean "consumer class."

But what do I know? Even paranoid stoners let their guards down once in a while. :P

Nice validation

Doc Searls's picture

In From Linux to Obama, Joe Trippi writes,

I’ve worked on and written a lot about the Open Source movement, and how collaborative, online and open movements have transformed our politics—and our country—over the past decade. It was the Dean campaign’s restless legion of hackers, programmers, and supporters that got the ball rolling, opening up our politics in a way that has permanence beyond any election or cycle. And, before that, it was Linux and the rest of the Open Source movement that hadn’t found their impact on politics yet, but certainly understood the power and potential of online collaboration.

As I’ve said over and over, this technology-driven, bottom-up transformation has completely changed the way elections operate – from recruiting new supporters, to raising money, to pushing new ideas (and rejecting bad ones). And it changed how communities form and ordinary citizens communicate across the board — from political organizing to parenting advice.

Joe goes on to point readers here (calling it a "must-read"), adding,

I’ve never read a more accurate explanation of how the Linux movement and Open Source influenced and formed the foundational thinking for the political movement that, now, has helped produce Barack Obama’s Victory.

Thanks, Joe.

Doc Searls is Senior Editor of Linux Journal

why bureacracy is still present

adeel's picture

first off, interesting article; always nice to see linux being used in interesting ways.

but bear in mind the inherent reason why 'streamlining' is not in the best interest of the politicians: jobs. By streamlining a process, you cut jobs, and these are the 'blue-collar' middle-America jobs that require no real education, nor provide any real benefit to the public but bolster political numbers. When a President states that during his administration, he created 50,000 new jobs, what he really means is that he made the process that much more inefficient. The more inefficient something is, the more resources it needs to do it.

Case and point, county record clerks. They're function was valid before computers and databases become a standard practice, but they're still there and they're lazier than ever. All they really do is run a trivial search on their database, and collect your money. Wrap a front-end around the database and hook it up to PayPal & the net, and there goes that $45,0000 annual expense in the budget.

Another example are toll booths. What's the purpose of them in this age? You have all those EZ-pass/I-pass/etc on every toll road, so why not just fold the cost of the little transponders into the annual tag renewal fees? Everyone is forced to get insurance when getting a license plate, why not this as well? Easy, because in one fell swoop, you will have un-employed 10,000 toll booth attendants.

In theory, government is supposed to be for the greater good and public benefit, but unfortunately it never is (hence the pork barrelled politics and all). Ultimately, we need to keep in mind that world isn't just full of roses and daisies, but thorns as well and we need be wary of it all. So ultimately, transparency really isn't in the best interest of the politicians, nor is efficiency for that matter. Just read up on how much hassle http://public.resource.org has been put through to get 'transparency'

change.gov

Jeff M's picture

Let's see if how far Obama pushes this into government - the possibilities are endless. Besides opening up and giving access to government, the ability to use OS to automate and streamline many functions could save a fortune in expenses.

FOSS + Governance

Doc Searls's picture

Christian,

I think it would make an interesting study to see what software components, created by and for the campaign, are now free or headed that way. I suspect some will get out. And I am sure the influence of political uses on Drupal have not been small.

There are so many geeks that are now involved in politics, and taking their knowledge and code with them, both in and out of campaigns. That matters more than what the campaign and its contractors decide to do with the code they created or re-used.

What matters most, for the sake of democracy and governance, is that the raw materials for building anything you like are out there, free and open, and in growing abundance. Those materials will be increased in variety and quality by the process of use and re-use. It matters how much is kept non-free by the candidates and campaigns, but it matters less all the time because the ratio of free to non-free only goes up.

This is all a separate matter from the Obama campaign, I believe. They, their contractors and their volunteers all used FOSS and its principles in smart, organized and effective ways. The campaign was top-down and bottom up where both needed to be.

Governance will be different. There are already signs that the Obama White House will be no less bunkered by an ethos of extreme loyalty and access control than the Bush one. But there are virtues at play here, including those of transparency and accountability, that are coming to prevail in Washington, whether the administration and the houses of Congress like it or not. And those virtues arise from the experience the world and its builders have had with FOSS.

Doc Searls is Senior Editor of Linux Journal

Mandatory Reading

jMac's picture

Incredible articles Doc.......

Blogged, linked and attributed here:

http://www.jonathanmacdonald.com/?p=2230

Play from your f-ing heart.

Lots of small modular bits that do one thing well

einfeldt's picture

hi,

Nice article, Doc! I am fascinated by the role that Free Open Source Software (FOSS) plays in helping people learn how to work well as a team, and often on the fly in an ad hoc, distributed way. It might be that the cultural implications of the global shift to FOSS might be that we learn how to play together better in the social symphony that is democracy when it works right. We did see some of that in the Obama campaign.

But as you point out, all is not brightness and joy from a coding perspective with the Obama campaign. I voted for Obama and would do it again in a heartbeat, but it did find it a bit disturbing that the "Fierce Urgency of Now" meant that information in his campaign meant a relatively hierarchical information flow. Information was given out on a "need to know basis" and you had to demonstrate that you were going to deliver the goods for Obama. The Obama machine was indeed a well-oiled machine, but it was no Apache Project, that's for sure. Nor was it even a benevolent dictatorship a la the Linux Kernel project, where the dictator for life serves only at the pleasure of his lieutenants and _acknowledges it_.

Maybe it is unfair to expect the same level of flatness in a US presidential campaign that we would see in a FOSS project. And maybe some FOSS projects could learn from the setting-aside of egos that we saw in the Obama campaign in service of the Fierce Urgency of Now.

And yet IMHO, it is the other way around. Obama and his team need to learn to give back in the one area that defines true FOSS projects: control. The ability to fork is the right to own, and I didn't sense to much in the way of allowing the power to fork in the Obama campaign. Your quote from Liza Sabater tells it all, and gives us a measure of what we need to demand from political campaigns that we, the FOSS community, support:

"I don't foresee the Obama campaign releasing that code to make it easier for any and all people to replicate what they have created. Same thing, by the way, with MoveOn.org, Democracy For America and even the organizing tools created by the DNCC."

That just ain't Free Software.

I can't imagine Richard Stallman getting to excited about the Obama campaign under those conditions. And say what you will about Richard, he is rarely wrong about code, the GPL3 fissure notwithstanding.

Christian Einfeldt,
Producer, The Digital Tipping Point

Doc - Great Article

PXLated's picture

Fascinated by how tech can get us back to transparency in govt. where it really is by and for the people and the politicians really are nothing more than our agents. The Obama tech is just the start. Change can't come soon enough.

Thanks for a fascinating article!

On's picture

Thanks for a fascinating article!
Let us all hope that new president, which maybe for very long time is the real president of 'the people', not only in the USA but elsewhere! Would also make the change and make the wish of 'the people', Open Source also a winner!

On
WebAPP, Open Source CMS

Webinar
One Click, Universal Protection: Implementing Centralized Security Policies on Linux Systems

As Linux continues to play an ever increasing role in corporate data centers and institutions, ensuring the integrity and protection of these systems must be a priority. With 60% of the world's websites and an increasing share of organization's mission-critical workloads running on Linux, failing to stop malware and other advanced threats on Linux can increasingly impact an organization's reputation and bottom line.

Learn More

Sponsored by Bit9

Webinar
Linux Backup and Recovery Webinar

Most companies incorporate backup procedures for critical data, which can be restored quickly if a loss occurs. However, fewer companies are prepared for catastrophic system failures, in which they lose all data, the entire operating system, applications, settings, patches and more, reducing their system(s) to “bare metal.” After all, before data can be restored to a system, there must be a system to restore it to.

In this one hour webinar, learn how to enhance your existing backup strategies for better disaster recovery preparedness using Storix System Backup Administrator (SBAdmin), a highly flexible bare-metal recovery solution for UNIX and Linux systems.

Learn More

Sponsored by Storix