To: djane who wrote (44328 ) 4/14/1998 7:00:00 PM From: djane Respond to of 61433
After crippling outage, AT&T tackles customer relations By John Rendleman, PC Week Online 04.14.98 2:39 pm ET zdnet.com As engineers worked through last night and into today to restore service on AT&T's frame-relay network, Chairman Michael Armstrong dispatched a personal letter to the CEOs of each of the company's thousands of frame-relay customers apologizing for a massive 20-hour outage. The total failure of the network began Monday as a software or hardware glitch between two of the 145 Cisco/Stratacom frame-relay switches in the network quickly escalated into a complete service disruption to all frame-relay customers. "Frankly, these outages let our customers down, and I want to apologize to each and every one of them," Armstrong said during a news conference today. To help make amends, AT&T will suspend all charges for frame-relay service from the time the outage occurred until the company has identified and corrected the problem and implemented systems to prevent similar outages in the future. "We will not charge customers for frame-relay service until we have defined the problem and identified a solution," Armstrong said, adding that AT&T also sent a technical letter from Frank Ianna, executive vice president of network and computing services, to the CIOs and telecom managers of AT&T's frame relay customers explaining the extent of the problem. The outage undoubtedly will have long-term implications for AT&T, which has traditionally been considered the premier provider of wide area frame-relay services in terms of reliability and network performance. While the outage lasted, in excess of 5,000 corporations were unable to complete critical network-based business. Retailers, for example, were unable to authorize credit-card payments and financial institutions could not complete transactions. For those customers, "the network is the very heart of their business, and that is what we were affecting [with the frame-relay failure]," Armstrong said. AT&T provided select customers with regular updates every 15 or 20 minutes throughout the crisis, particularly in cases involving customers with critical applications. The New York-based telecommunications giant also worked closely with customers that had pre-existing backup service arrangements with AT&T, officials said. In the hours when the outage was most severe, AT&T engineers focused first on identifying and isolating the problem, then on gradually restoring customer circuits on the network, according to Armstrong and Ianna. By 11:45 a.m. ET today, AT&T had restored 75 percent of its customer circuits, and by approximately 12:15 p.m. the company had 80 percent of its customers back online. The restoration rate reached 96 percent by 12:40 p.m. In the days to come, AT&T will investigate the as-yet-undetermined root cause of the failure between the two switches and devise a solution to prevent future occurrences, Ianna said. Send E-mail to PC Week | Copyright notice