Design World

  • Home
  • Technologies
    • 3D CAD
    • Electronics • electrical
    • Fastening & Joining
    • Factory automation
    • Linear Motion
    • Motion Control
    • Test & Measurement
    • Sensors
    • Fluid power
  • Learn
    • Ebooks / Tech Tips
    • Engineering Week
    • Future of Design Engineering
    • MC² Motion Control Classrooms
    • Podcasts
    • Videos
    • Webinars
  • LEAP AWARDS
  • Leadership
    • 2022 Voting
    • 2021 Winners
  • Design Guide Library
  • Resources
    • 3D Cad Models
      • PARTsolutions
      • TraceParts
    • Digital Issues
      • Design World
      • EE World
    • Women in Engineering
  • Supplier Listings

Outages Like the One at Level 3 Can Be Prevented. Here’s How.

By Diana Goovaerts | October 17, 2016

Share

Earlier this month, a wireless outage swept across the eastern United States, equally impacting customers from all four major wireless carriers. At the heart of the outage was a technical issue at Internet backbone company Level 3 Communications.

While the blackout was resolved fairly quickly, outages like the most recent one also carry hefty financial and brand reputation costs for the carriers.

But according to Continuity Software CEO Gil Hecht, incidents like these can be avoided. The key, Hecht said, is redundancy.

In order to have a fail-proof system, Hecht said it is critical to have redundancy in place across every layer of the infrastructure. For example, he said, if a company has fiber optic cable, there needs to be a second backup cable that runs along a different route than the original. Additionally, Hecht said all network systems must also be redundant. If redundancy is in place in both of those areas, then companies should be protected from any kind of disruption.

According to Hecht, though, the reason disruptions keep occurring is not that companies aren’t aware of the need for redundancy, but rather because some part of the network chain is not aware that the redundancy exists.

“It can either happen because there is a router or a switch somewhere that doesn’t know how to direct traffic through the alternate route, or it happens because you have two identical systems that have identical configurations, but in one the configuration drifts,” Hecht said. Drift can occur when a technician makes changes to one system but fails – for whatever reason – to mirror the changes in the other, he said.

Two additional factors are also at play in failures like the one at Level 3, Hecht said. First, redundancy is – by nature – something that is “very difficult” to test.

“To test redundancy you need to be willing to suffer down time,” Hecht said. “To test the alternate, you need to have primary path fail.”

Hecht noted there are alternative means to test by introducing automation, but said that’s where the second aggravating factor of cost comes in. Unlike fail testing, automation checks for redundancy by verifying elements of the system configuration. Most companies, though, tend to invest in the problem areas that have most recently touched their memory – which means there will inevitably be gaps in coverage elsewhere, Hecht said.

“Down time in data loss incidents will continue to happen for the foreseeable future because when humans are involved in building something they will make mistakes,” Hecht said. “The only way to avoid that is to introduce automation into testing, which you will only do where it makes financial sense. So by definition there will be holes.”

All that said, Hecht noted the country’s most critical infrastructure – especially in the financial, government and communications sectors – is fairly well protected.

“This failure was a relative success – very unpleasant, huge damage but ultimately it all came back online very quickly,” Hecht said. “I think this specific type of infrastructure failure is most likely not going to happen again in the short term because companies will develop systems to prevent it.”

When reached for comment, Level 3 Communications declined to provide details around its continuity plans or reporting relationship with customers. The company did, however, say the October 4 outage was “unfortunate” and it has “taken steps and put processes in place to keep these types of events from happening in the future.”

AT&T, Verizon, Sprint and T-Mobile declined to comment for this story.


Filed Under: Infrastructure

 

Related Articles Read More >

Do Sensors Make Infrastructure Safer?
Crawling Robots and Flying Drones May Help Missouri’s Bridges
Viasat and Facebook Collaborate to Expand Internet Connectivity in Rural Mexico
Smartphone-Based System to Monitor America’s Crumbling Infrastructure

DESIGN GUIDE LIBRARY

“motion

Enews Sign Up

Motion Control Classroom

Design World Digital Edition

cover

Browse the most current issue of Design World and back issues in an easy to use high quality format. Clip, share and download with the leading design engineering magazine today.

EDABoard the Forum for Electronics

Top global problem solving EE forum covering Microcontrollers, DSP, Networking, Analog and Digital Design, RF, Power Electronics, PCB Routing and much more

EDABoard: Forum for electronics

Sponsored Content

  • Global supply needs drive increased manufacturing footprint development
  • How to Increase Rotational Capacity for a Retaining Ring
  • Cordis high resolution electronic proportional pressure controls
  • WAGO’s custom designed interface wiring system making industrial applications easier
  • 10 Reasons to Specify Valve Manifolds
  • Case study: How a 3D-printed tool saved thousands of hours and dollars

Design World Podcasts

May 17, 2022
Another view on additive and the aerospace industry
See More >
Engineering Exchange

The Engineering Exchange is a global educational networking community for engineers.

Connect, share, and learn today »

Design World
  • Advertising
  • About us
  • Contact
  • Manage your Design World Subscription
  • Subscribe
  • Design World Digital Network
  • Engineering White Papers
  • LEAP AWARDS

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search Design World

  • Home
  • Technologies
    • 3D CAD
    • Electronics • electrical
    • Fastening & Joining
    • Factory automation
    • Linear Motion
    • Motion Control
    • Test & Measurement
    • Sensors
    • Fluid power
  • Learn
    • Ebooks / Tech Tips
    • Engineering Week
    • Future of Design Engineering
    • MC² Motion Control Classrooms
    • Podcasts
    • Videos
    • Webinars
  • LEAP AWARDS
  • Leadership
    • 2022 Voting
    • 2021 Winners
  • Design Guide Library
  • Resources
    • 3D Cad Models
      • PARTsolutions
      • TraceParts
    • Digital Issues
      • Design World
      • EE World
    • Women in Engineering
  • Supplier Listings