EOF - Turning the Internet Outside In
You can only hack what's hackable. We owe Linux to the fact that operating systems are hackable, and that they can run on common hardware, much of which is also hackable. We also owe Linux to the Internet, which is a hack on wiring and data trafficking.
For PCs and mobile devices, Linux is a defaulted choice. It's at GandhiCon 4. That and the first three GandhiCons are implicit in the Mohandas Gandhi quote, “First they ignore you, then they laugh at you, then they fight you, then you win.”
The Internet, however, is another matter. The Internet Protocol (IP) arrived at GandhiCon 4 by 1981 (with IPv4). That's because it was created as what we might call a public protocol, connecting devices using just about any kind of network wiring, hardware and data link protocols (Ethernet, Token Ring, FDDI and so on), without prejudice. This made it easy and cheap for anybody to use.
By design, the Internet Protocol was decentralized. It reduced network complexity inside the network as far as possible, while relying on intelligence at its end nodes. It was even agnostic toward addressing schemes, leaving choices up to implementations at higher levels in the stack and resolution up to the Address Resolution Protocol (ARP).
Alas, what most people know best about the Internet is not its decentralized, depoliticized and free (as in both freedom and beer) public nature, but rather its centralized, politicized and costly (as in both freedom and beer) private one. This is the Internet of domain names that are privately owned (actually, rented), controlled by a central naming authority (the Internet Corporation for Assigned Names and Numbers, or ICANN) and filled with “pipes” mostly owned by private interests and highly cartelized. This is not an Internet to which we can simply connect. Instead, it's one we can “access” only through Internet Service Providers—a class of businesses that was born when small independent companies found ways to make the Internet available to anybody with a land line and has since become the tertiary service of phone and cable companies selling “broadband” or “high-speed Internet” as the third act in a “triple play”.
Although the former Internet is hackable, the latter one is not.
As it happens, I've been living in the hackproof hell of the private, centralized Internet for the last two weeks, during which time my home connection here in Santa Barbara has been intermittently plagued by high latencies and packet losses. My ping and traceroute tests clearly isolate the problem somewhere between my cable modem and the first IP address my packets encounter: a gateway downtown that's also owned by the cable company. Cable company technicians that have come to my house (four so far) have excused from blame my cable modem and all wiring between it and the service pole. They know the problem is somewhere in their system. They still have not solved it, and neither can I, even with help from many friends far geekier than myself.
So here is a radical proposition. Let's build the Internet we want—a free, open and hackable Internet—from the outside in.
This is something Bob Frankston has been advocating for many years. What Bob wants is simple connectivity between any points floating on the vast resource he calls our “sea of bits”. His latest label for this is “ambient connectivity”. In his essay “Opportunity for Innovation”, Bob writes, “Once we can assume connectivity we can start taking advantage of the opportunities. It's not just about high-value applications like education, commerce and entertainment. It's about basic infrastructure. We won't discover the real value until we've had a chance to experience ambient connectivity.” In a follow-up essay titled “Zero Marginal Cost”, he adds:
The idea that we can create our own solutions using raw, unreliable bits is at the heart of the Internet's generativity....
We've already seen the power of zero marginal cost. It was the availability of unmeasured local phone service that gave the United States the lead in adopting the Internet in the 1990s. We rejected digital phone service because the phone companies chose to charge a premium for that service. We just worked around it using modems because there was zero marginal cost for using the existing infrastructure.
Bob's model of the Internet is home networking, expanded outward through converging communities. In my interview with Bob for the March 2008 issue of Linux Journal (www.linuxjournal.com/article/10033), he said, “The networks in our homes are a good example. You 'just' print without worry about negotiating for the printing provider.”
As it happens, I'm also shopping for home networking gear—in particular, for a router/switch to connect the 16 Ethernet jacks scattered about the house. Cat-6 wiring runs from each of those jacks to a patch panel in a wiring closet. The cable company's modem is in there too.
Lemme tell ya, if there's a category ripe for disruption, it's home networking. I've been looking at Belkin, Cisco/Linksys, D-Link, Netgear and others—none of which are especially helpful. The 8-port device I'm replacing is a Netgear router/switch that was billed as a “VPN Firewall” but failed at the essentials: its gears were stripped by the cable company's new 20Mb downstream data speeds.
So let's look at making the Net hackable from the outside in. VCs always are asking about market size and “pain points” in need of relief. I can't think of a bigger, or more ideally hackable, pain than the one we find right at home.
Doc Searls is Senior Editor of Linux Journal. He is also a fellow with the Berkman Center for Internet and Society at Harvard University and the Center for Information Technology and Society at UC Santa Barbara.
Doc Searls is Senior Editor of Linux Journal
Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.
Sponsored by AMD
Built-in forensics, incident response, and security with Red Hat Enterprise Linux 6
Every security policy provides guidance and requirements for ensuring adequate protection of information and data, as well as high-level technical and administrative security requirements for a system in a given environment. Traditionally, providing security for a system focuses on the confidentiality of the information on it. However, protecting the data integrity and system and data availability is just as important. For example, when processing United States intelligence information, there are three attributes that require protection: confidentiality, integrity, and availability.
Learn more about catching the bad guy in this free white paper.
Sponsored by DLT Solutions
| Designing Electronics with Linux | May 22, 2013 |
| Dynamic DNS—an Object Lesson in Problem Solving | May 21, 2013 |
| Using Salt Stack and Vagrant for Drupal Development | May 20, 2013 |
| Making Linux and Android Get Along (It's Not as Hard as It Sounds) | May 16, 2013 |
| Drupal Is a Framework: Why Everyone Needs to Understand This | May 15, 2013 |
| Home, My Backup Data Center | May 13, 2013 |
- New Products
- Linux Systems Administrator
- Senior Perl Developer
- Technical Support Rep
- UX Designer
- Web & UI Developer (JavaScript & j Query)
- Designing Electronics with Linux
- Dynamic DNS—an Object Lesson in Problem Solving
- Making Linux and Android Get Along (It's Not as Hard as It Sounds)
- Using Salt Stack and Vagrant for Drupal Development
- Nice article, thanks for the
9 hours 57 min ago - I once had a better way I
15 hours 43 min ago - Not only you I too assumed
16 hours 25 sec ago - another very interesting
17 hours 53 min ago - Reply to comment | Linux Journal
19 hours 46 min ago - Reply to comment | Linux Journal
1 day 2 hours ago - Reply to comment | Linux Journal
1 day 2 hours ago - Favorite (and easily brute-forced) pw's
1 day 4 hours ago - Have you tried Boxen? It's a
1 day 10 hours ago - seo services in india
1 day 15 hours ago
Enter to Win an Adafruit Pi Cobbler Breakout Kit for Raspberry Pi

It's Raspberry Pi month at Linux Journal. Each week in May, Adafruit will be giving away a Pi-related prize to a lucky, randomly drawn LJ reader. Winners will be announced weekly.
Fill out the fields below to enter to win this week's prize-- a Pi Cobbler Breakout Kit for Raspberry Pi.
Congratulations to our winners so far:
- 5-8-13, Pi Starter Pack: Jack Davis
- 5-15-13, Pi Model B 512MB RAM: Patrick Dunn
- 5-21-13, Prototyping Pi Plate Kit: Philip Kirby
- Next winner announced on 5-27-13!
Featured Jobs
| Linux Systems Administrator | Houston and Austin, Texas | Host Gator |
| Senior Perl Developer | Austin, Texas | Host Gator |
| Technical Support Rep | Houston and Austin, Texas | Host Gator |
| UX Designer | Austin, Texas | Host Gator |
| Web & UI Developer (JavaScript & j Query) | Austin, Texas | Host Gator |
Free Webinar: Hadoop
How to Build an Optimal Hadoop Cluster to Store and Maintain Unlimited Amounts of Data Using Microservers
Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.
Some of key questions to be discussed are:
- What is the “typical” Hadoop cluster and what should be installed on the different machine types?
- Why should you consider the typical workload patterns when making your hardware decisions?
- Are all microservers created equal for Hadoop deployments?
- How do I plan for expansion if I require more compute, memory, storage or networking?




Comments
Hacking from the Outside In
I've recently done quite a bit of hacking from the "ends" of the internet back inside. And I'm very very excited about it. Having noone really to share this with, I figured I would post it here.
At home my primary workstation runs Slackware 13 and can run a multitude of virtual guest machines. I've built it for that reason. I also have a DSL connection to the internet, nothing fancy, 8mb/512kb and a static IP. I also have a few IPv6 tunnels from HE.net.
My goal was to run virtual machines with private IPv4 addresses but public IPv6 addresses. Today that goal is a reality. There's a project called vde2 (Virtual Distributed Ethernet) from a group called VirtualSquare. To me, an understanding of internet protocols and this project were crucial. This is a virtual switch. A virtual switch which can also connect to other virtual switches over the internet.
So, on my server at home, I run a virtual machine. It gets an IPv4 address of 10.22.22.0/24 and can connect through to the regular internet via nat. It's also running radvd and handing out IPv6 addresses, but public ones. So every virtual machine I run gets a different public IPv6 address.
Now it gets even more interesting. I'm currently sitting at work. I can run a vde switch locally, and connect it (via ssh) like a virtual plug or crossover cable to home. Now if I run virtual machines (or even my host machine as this is a laptop), my local tap0 interface gets an IPv6 address... from home. As long as my ipv6 default gateway is correct, I'm connecting to the ipv6 internet using the ipv4 internet as a foundation. I connect through my office connection to home, then out to the ipv6 internet.
I can now run more than a dozen different OS's, from different physical locations, using the same IPv6 subnet from any physical location.
It was a bit of work on my part. But imagine wrapping this in a nice bundle and selling it as a service?
Internet hacking from the outside in, to go.
Come talk to me in #linuxjournal on freenode. I'm [flrichar] (n=fredr@2001:470:e075:2200:216:3eff:fe1e:eecb): Fred Richards, or [FredR](n=fredr@2001:470:e075:2200:d0ae:93ff:fe26:8415): Fred Richards ...
or someone@2001:470:e075:2200::0/64
I'm sure I'll run out of nicknames before I run out of IPs or virtual machines.
-- FLR or flrichar is a superfan of Linux Journal, and goofs around in the LJ IRC Channel
Simple Data Provider
As a Sr Network Engineer for an application data services company, I would _love_ to hack the internet from the ends inward. In fact, in theory, I guarantee I could build what you are looking for. I could build it in my head. But in reality, there are several hurdles to overcome.
Doc, you talk of home networking, but trust me, the typical consumer-grade networking equipment is pretty weak and limited. Networks are typically designed and built from the core out, with each piece of equipment having particular roles and responsibilities. From the core, out to the distribution level, then finally to the fringes of the access layer. Typically, access equipment could not handle the vast processing power necessary in the core.
Not saying that it couldn't be done, but an upgrade to end user and CPE equipment would be in order. Linux would take the same consumer hardware much, much further.
Another hurdle, would be to keep the historical players out of the loop. Why do the telcos and cablecos have a duopoly? Well, whenever anyone needed a wire to their home, they were the only ones in the business of running those cables. Long distance, high bandwidth wireless (802.16 Wimax perhaps) would be a better alternative, based on standards of course.
Another bad habit of ISPs is oversubscribing. Most companies are in business to make money, at any and all costs, to the point where I've seen some pretty crazy over-subscriptions. Your cable headend node probably serves upwards of 4000 people. Do you live in a highly populated area?
So at the CPE side, you want a powerful, wireless unit, with lots of diversity. With the ability to connect to many others, where the greater number of your neighbors would work in your favor instead of against it. That piece really needs the "bittorrent" effect. Think that can be done currently with ipv4? I don't think so.
Where are we going to get millions of IP addresses per end user? I'm sure IPv6 could fill that gap.
These are just some of my ideas. Instead of following the normal layers, from physical on up, I'm thinking more of the top down, solving issues with protocols first. It still needs some under laying infrastructure help to flesh out.
One of my dreams is to create a "data provider". A company who's sole purpose is to run data to your home. That's it. DNS? Email, web hosting? On your own. Supply only raw IP connectivity. The local water authority doesn't dictate how I use water in my home, so why is my ISP so involved in my data?
Just some thoughts.
-- FLR or flrichar is a superfan of Linux Journal, and goofs around in the LJ IRC Channel