Poorly timed software upgrade paralyses Nasdaq

Nasdaq needed upgrade to handle unusually high trading volume, but ended up halting system for 17 minutes
Written by Larry Barrett, Contributor on

Traders were unable to buy or sell stocks for 17 crucial minutes Tuesday after Nasdaq officials attempted a software upgrade on the fly in the last half hour of trading. Something went wrong and investors were the ones who paid the price.

The timing of the outage couldn't have been worse. Following the Federal Reserve Board's decision to raise short-term interest rates one-quarter of a percent and adopt a "neutral" bias, traders pushed the Nasdaq composite up 74 points to another record close of 3,293.07 on volume of 1.48 billion shares, also an all-time record.

From 3.40pm to 3.57pm the nation's largest electronic stock market was unable to process trades.

Wayne Lee, a Nasdaq spokesman, said the software upgrade was necessary to "handle the extremely high volume of trading" late in the session. The move appeared to trigger problems with the market's trade reporting and quotation systems.

Lee said he didn't know if Nasdaq would be installing or upgrading more software Wednesday night or in the future to accommodate skyrocketing volume on the tech-laden exchange.

Lee was also unable to say what might have happened had the exchange not tried to upgrade the software in the last half hour of the trading day. "I don't have an answer for that," he said.

While the trading volume was extremely high, the Nasdaq has recently eclipsed the 1.3 billion share level on a number of occasions and moved above 1.4 billion shares on 14 April. Apparently, the difference between 1.4 billion shares and 1.48 billion shares was enough to require an immediate software update.

Brokers were scrambling to call their clients and explain the outage or fill those orders in after-hours trading.

Nasdaq officials were able to restore its systems in time to keep them open from 4pm until 6.30pm Recently, Nasdaq decided to keep its pricing systems open until 6.30, even though it still officially shut its own last trading session at 4pm.

"It was down for 20 minutes. It came up for a few seconds at the end, but then went back down," James Volk, co-director of institutional trading at D.A. Davidson and Co., told Reuters. The delay in processing orders meant a sharp increase in volume at after-hours services such as the Island ECN.

Longtime traders said Tuesday's outage was the first of its kind and likely a result of the frenzied trading near the close of trading. "Basically, around 3.35 (pm), the system just went down. Maybe it was overloaded," said a Nasdaq trader, who wanted to remain anonymous. "I called Nasdaq and they said it was systemwide."

Because the outage came so late in the day, some traders weren't affected by the glitch but said it could create some uncomfortable situations for both brokers and their clients.

"I guess the only thing you could do is write down the time and the price of the stock that a client wanted to sell or buy the stock at and then try to reconcile it once it's back up and running," said a trader at Olde Discount. "It's potentially a major problem, especially if the trade ended up going against the client and he or she tried to back out of it."

Back in September, the Nasdaq and MCI WorldCom announced the completion of a $600m (£372m) extranet that was supposed to double the speed and capacity of the exchange's trading network. MCI WorldCom's Enterprise Wide Network II was purportedly capable of handling volume up to 4 billion shares a day and could be scaled up to handle 8 million shares a day.

Officials said the EWN II was completed ahead of schedule, due to an accelerated 18-month process during which MCI WorldCom successfully migrated 7,000 trading workstations to the new Extranet. At the time, the Nasdaq said "users of the highly reliable EWN II are assured no single point of failure can affect any part of the entire system."

Reuters contributed to this report.

What do you think? Tell the Mailroom . And read what others have said.

See techTrader for more technology investment news, plus quotes and research.

See ZDII for US tech investor news.

Editorial standards


I put the Apple Watch Ultra through a Tough Mudder: Here's how it held up

I put the Apple Watch Ultra through a Tough Mudder: Here's how it held up

The cheapest electric cars you can buy (plus how the federal tax credit works)
Placeholder product image alt text

The cheapest electric cars you can buy (plus how the federal tax credit works)

Slow internet at home? This adapter is the key to faster wired connectivity

Slow internet at home? This adapter is the key to faster wired connectivity