Fixing Loopy Networks Using Low-tech Methods

September 17th, 2009 by Shawn Powers in

Your rating: None Average: 2.6 (14 votes)

Download in .ogv format
__________________________
Shawn Powers is an Associate Editor for Linux Journal. You might find him chatting on the IRC channel, or Twitter


Special Magazine Offer -- Free Gift with Subscription
Receive a free digital copy of Linux Journal's System Administration Special Edition as well as instant online access to current and past issues. CLICK HERE for offer

Linux Journal: delivering readers the advice and inspiration they need to get the most out of their Linux systems since 1994.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
Darklurker's picture

Yep

On October 6th, 2009 Darklurker (not verified) says:

Been there too. It's normally a PITA to fix, especially if you've got dumb switches and hundreds of drops. STP in the smart switches helps, but can do weird things in other ways.
But you're right, at the end of the day, it happens because somebody plugged two switches together, and until you find that problem, life sucks.

What makes life suck even worse is when you realize it was YOU who plugged the two switches together in a closet with 300 drops in it. hehe. Yeah, I got a plaque for that one. ;)

Anonymous's picture

HP Switches

On September 23rd, 2009 Anonymous (not verified) says:

You could have solved that problem in about 5 seconds from your desk. HP even has a pretty GUI, but being Linux Journal, you can ssh in there as well. :)

Daniele's picture

Scaling the troubleshooting

On September 19th, 2009 Daniele (not verified) says:

In a big environment where you have more than 6-10 downlinks to other switches, I usually use the "bisection method" as a trouble-finding algorithm (http://en.wikipedia.org/wiki/Bisection_method).
That is, for example, you disconnect the first half of the network connections you have on the main switch. If the problem persists, you reconnect them (to make the poor, remaining network service to flow again) and disconnect the first half of the second half and so on, recursively. If the problem disappears, reconnect half-at-a-time (recursively) the disconnected cables.

Since in the clip I see you use a specific vendor for your main switch, I can say that using the same switches configured to run multiple spanning-tree, we had good results in detecting and automatically blocking loops till the first level of unmanaged, non-stp switches (with fast intervention times since mstp is faster than stp).

Keep in mind that enabling stp on your network, loops are less likely to block the entire network, but more difficult to come up to your attention since you need good monitoring tools to query your network equipments about stp state for each port.

Shawn Powers's picture

Of course I know about STP

On September 18th, 2009 Shawn Powers says:

The problem isn't with my main switches, it's with the cheapo desktop switches in the classroom. We are a school, and don't have enough network drops into the rooms, so we have to use desktop switches in each room to allow more computer connections.

The cheap switches don't have STP, and so cause a network breakdown. My "good" switches don't see a network loop, they just see millions of multicast packets, and dutifully try to send them to every port in the district.

In a perfect world, I'd have enough drops for each room -- but it's a school, and we're lucky to have computers at all. :(

__________________________

Shawn Powers is an Associate Editor for Linux Journal. You might find him chatting on the IRC channel, or Twitter

Venomfang's picture

Loopbacks in schools.

On September 18th, 2009 Venomfang (not verified) says:

Been there done that.

I do tech work for a private school; have the same issues. Money is tight and when rooms get built or added on they cheap out on the network infrastructure ( cabling and switches ).

Also it doesn't matter if you use STP or not, you still have to deal with the network loopback in that classroom; because someone plugged there cat5 cable into 2 ports on the wall.

It really becomes a pain.

Aaron C. de Bruyn's picture

Old...

On September 20th, 2009 Aaron C. de Bruyn (not verified) says:

Damn. Back when I was in school, we had to worry about someone taking the 50 ohm resistor off the end of a BNC cable...

Technoslick's picture

Old-fashioned troubleshooting today? Image that.

On September 18th, 2009 Technoslick (not verified) says:

Bravo. So gratifying to see a demonstration of old-fashioned deductive reasoning used in a real-world situation, where hands-off, hi-tech equipment aren't being utilized. School techs in my rural county also have to deal with inadequate equipment supported by inadequate budgets. The situation isn't going to change soon, if ever. Any of them would embrace your MacGyver way of troubleshooting in keeping their inadequate computer systems running.

Gareth's picture

loops?

On September 18th, 2009 Gareth (not verified) says:

Firstly I would just like to say thank you for your tech tips which I find intuitive and an excellent resource for the linux community!

However with regards to this article in particular I would not call this article fixing loopy network, instead I would call it delaying the inevitable.

As a previous poster has mentioned you should be using spanning Tree Protocol (STP) if you have three or more switches interconnected. In a correctly configured network this situation should never occur.

Out of curiosity how often are you having to do this?

Anonymous's picture

looping?

On September 17th, 2009 Anonymous (not verified) says:

In a large scale environment, you should be using spanning-tree capable switches in order to prevent L2 loops from bringing down your system.

on the plus-side, that means you have the ability to have a hot-standby cable (like via an alternate path) between your switches, and STP will make sure that only one is in use at any time.

Net Admin's picture

I feel so sorry for ur

On September 17th, 2009 Net Admin (not verified) says:

I feel so sorry for ur employer.

Post new comment

Please note that comments may not appear immediately, so there is no need to repost your comment.
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <pre> <ul> <ol> <li> <dl> <dt> <dd> <i> <b>
  • Lines and paragraphs break automatically.

More information about formatting options

Newsletter

Each week Linux Journal editors will tell you what's hot in the world of Linux. You will receive late breaking news, technical tips and tricks, and links to in-depth stories featured on www.linuxjournal.com.
Sign up for our Email Newsletter

Tech Tip Videos

From the Magazine

December 2009, #188

If last month's Infrastrucuture issue was too "big" for you then try on this month's Embedded issue. Find out how to use Player for programming mobile robots, build a humidity controller for your root cellar, find out how to reduce the boot time of your embedded system, and if you're new to embedded systems find out the basics that go into one. You can also read about the Beagle Board, the Mesh Potato and a spate of other interestingly named items. And along with our regular columns don't miss our new monthly column: Economy Size Geek.


Read this issue