EOF - Adventures in Re-provisioning
You can model the San Francisco Bay Area with your right hand. Bring the tip of your thumb and index finger together, then part them slightly. The gap between them is the Golden Gate, with its famous bridge. Going clockwise from there, the end of your bent index finger is Marin County. Berkeley and Oakland are at the base of your index finger. San Jose is at the base of your thumb. The rest of your thumb is the Peninsula. San Francisco is the whole tip of your thumb. The knuckle below your thumb's nail is San Bruno Mountain. That's where our story starts.
In the 1940s, San Bruno Mountain's long ridge began to bristle with towers for TV and FM stations. Since then, most of those stations have moved to Sutro Tower in the midst of the City—a landmark locals call “the world's largest roach clip”. One of the few remaining TV transmitters on San Bruno is KTSF, also known as Channel 26—that was its old analog channel. Now digital, it actually radiates on Channel 27, even if TV tuners still say “26”. In fact, the displayed channels for most TV stations in the US are now other than those they transmit on. Being digital, they can transmit data that tells the receiver what channel to display, regardless of the actual channel used. But that stuff hardly matters, because the percentage of Americans still watching over-the-air TV is down to single digits. Instead, they watch cable or satellite or bypass TV altogether and watch on a computer or a handheld mobile device. Still, KTSF puts out a signal with a listed power of a half-million watts. Thus, TV's mainframe age persists.
Inside the base of KTSF's tower is a small yellow shack with a leaky roof. It was here that I stood with Tim Pozar last May as he showed me how gear in a rack inside the shack was relaying many megabits' worth of Internet bandwidth from one point to another, each transmitter emitting signals measured in thousandths of a single watt. He and a colleague were busy shaking down a link to the Maker Faire that would happen down on the Peninsula a few days later. (It worked fine.)
Tim's long résumé includes decades spent both as an Internet pioneer and a broadcast engineer. Of the two tracks' convergence, he explained, “I do work for Univision in San Francisco building out video servers for them. I was talking to Don Ready over there, who is the Assistant Chief Engineer. He told me with some regret that he is doing very little 'broadcast engineering' now. Most of the time he is doing IT. Fiber, twisted pair, Ethernet, IP, switches, routers and Linux servers are the new technology for distribution of broadcast.”
But the shift isn't a matter just of swapping one tech for another. It involves clever and resourceful re-provisioning. In both principle and practice, re-provisioning is central to the means and missions of openness in general and Linux in particular. Old purpose-built structures host new stuff made for new purposes—or (as with the case of Linux) better ways of serving the old purposes. In many cases, the old and the new coexist and cooperate. KTSF and its high-wattage structures still operate within a broadcast regime that's leveraging its original infrastructure about as far as it will go, while new infrastructure gets built within the old. Credit goes to old systems welcoming the new and to resourceful pioneers, such as Tim and his colleagues with the Bay Area Wireless Users Group (and other groups with similar names).
In that latter category is the work Tim and his buddy Matt Peterson are doing on the Farallons Broadband Project, which is organized by the California Academy of Sciences, the City of San Francisco, the Internet Archive and the US Fish & Wildlife Service. The Farallons, or Farallones, are a collection of small rocky islands 27 miles from San Francisco. There is no hard electrical infrastructure connecting the Farallons to land. Electricity is made there mostly by generators. The Internet is provided by a few milliwatts of wireless from San Bruno Mountain.
The wireless project is an exercise in minimized cost and complication. The “kit” includes Ubiquiti Bullet M2 (2.4GHz) and Rocket5 (5.2/5.5GHz) radios, a Pacific Wireless radome antenna, a Soekris net5501 comms computer and a Cisco WCX-C2950 switch. He hopes we'll forgive him using OpenBSD 4.5. (He's done plenty with Linux in other settings, but for this project he says, “pf is great. Easy syntax, handles NAT tricks well.”) You can see one result through the Farallones Cam, which shows you plenty of the island's two main features: scary surf and zillions of birds.
I also followed Tim on a visit to the giant Digital Realty Trust data center, on the south edge of San Francisco. The center occupies a former retail chain furniture warehouse, which is another example of re-provisioning at work. The place is packed with servers for some of the most familiar domains on the Web, plus hundreds more of all sizes. What struck me standing in there, between racks and racks of humming equipment, is how much the whole place resembled broadcast transmission rooms. I could see there how the Net is almost done subsuming broadcast—and yet how giant data centers are hardly an end state for the Net itself. Much re-provisioning has yet to be done. In fact, it will never stop, as long as old structures and systems learn from new technologies and uses.
A photo set of my visit with Tim is at the Linux Journal Flickr site: www.flickr.com/photos/linuxjournal
Doc Searls is Senior Editor of Linux Journal. He is also a fellow with the Berkman Center for Internet and Society at Harvard University and the Center for Information Technology and Society at UC Santa Barbara.
Doc Searls is Senior Editor of Linux Journal
Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.
Sponsored by AMD
Built-in forensics, incident response, and security with Red Hat Enterprise Linux 6
Every security policy provides guidance and requirements for ensuring adequate protection of information and data, as well as high-level technical and administrative security requirements for a system in a given environment. Traditionally, providing security for a system focuses on the confidentiality of the information on it. However, protecting the data integrity and system and data availability is just as important. For example, when processing United States intelligence information, there are three attributes that require protection: confidentiality, integrity, and availability.
Learn more about catching the bad guy in this free white paper.
Sponsored by DLT Solutions
| Dynamic DNS—an Object Lesson in Problem Solving | May 21, 2013 |
| Using Salt Stack and Vagrant for Drupal Development | May 20, 2013 |
| Making Linux and Android Get Along (It's Not as Hard as It Sounds) | May 16, 2013 |
| Drupal Is a Framework: Why Everyone Needs to Understand This | May 15, 2013 |
| Home, My Backup Data Center | May 13, 2013 |
| Non-Linux FOSS: Seashore | May 10, 2013 |
- Dynamic DNS—an Object Lesson in Problem Solving
- Making Linux and Android Get Along (It's Not as Hard as It Sounds)
- Using Salt Stack and Vagrant for Drupal Development
- New Products
- Validate an E-Mail Address with PHP, the Right Way
- Drupal Is a Framework: Why Everyone Needs to Understand This
- A Topic for Discussion - Open Source Feature-Richness?
- The Secret Password Is...
- RSS Feeds
- New Products
Enter to Win an Adafruit Pi Cobbler Breakout Kit for Raspberry Pi

It's Raspberry Pi month at Linux Journal. Each week in May, Adafruit will be giving away a Pi-related prize to a lucky, randomly drawn LJ reader. Winners will be announced weekly.
Fill out the fields below to enter to win this week's prize-- a Pi Cobbler Breakout Kit for Raspberry Pi.
Congratulations to our winners so far:
- 5-8-13, Pi Starter Pack: Jack Davis
- 5-15-13, Pi Model B 512MB RAM: Patrick Dunn
- 5-21-13, Prototyping Pi Plate Kit: Philip Kirby
- Next winner announced on 5-27-13!
Free Webinar: Hadoop
How to Build an Optimal Hadoop Cluster to Store and Maintain Unlimited Amounts of Data Using Microservers
Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.
Some of key questions to be discussed are:
- What is the “typical” Hadoop cluster and what should be installed on the different machine types?
- Why should you consider the typical workload patterns when making your hardware decisions?
- Are all microservers created equal for Hadoop deployments?
- How do I plan for expansion if I require more compute, memory, storage or networking?





35 sec ago
1 min 55 sec ago
4 hours 26 min ago
6 hours 17 min ago
11 hours 31 min ago
14 hours 42 min ago
16 hours 57 min ago
17 hours 26 min ago
18 hours 24 min ago
19 hours 53 min ago