ie8 fix
madison

Shocking gov't IT failure statistics!

By | August 9, 2010, 1:40pm PDT

Summary: The Office of Management and Budget (OMB) released data that shows disturbing trends on government IT projects.

The Office of Management and Budget (OMB) released data that shows disturbing trends on government IT projects. Moreover, the data suggests that the rate of federal IT failures is likely to increase substantially in coming years.

As part of an analysis of the federal IT Dashboard, the OMB compiled statistics regarding risky information technology projects. The following graph shows this data, with 2009 highlighted in red (click the image to see a larger version):

Strategic Analysis

According to a government presentation, the Management Watch List highlights projects “containing one or more planning weaknesses”. These projects are vulnerable to failure because of risks inherent during the planning stage.

The table shows a 42 percent decline in the number of major federal IT projects executed during the period 2004-2009. However, the average budget per project more than doubled during this same period, from $42 million in 2004 to $87 million in 2009.

Here is an astonishing fact: in 2009, 72 percent of major federal IT projects were on the Management Watch list!

My take. Common sense and conventional wisdom dictate that larger projects are more prone to fail than smaller ones. Key enemies of project success — complexity, politics, and duration — all rise substantially as project budgets increase.

If this data is accurate, then we can expect government IT failures to increase during the coming years, as large, poorly conceived projects make their way through the system.

Note to US Chief Information Officer, Vivek Kundra: I applaud your efforts to improve monitoring and control over federal IT projects. However, this data indicates a systemic lack of basic project governance throughout the federal government.

To avoid the coming catastrophe, I suggest implementing additional early-stage review and guidance processes at the agency level, supplemented by increased training. Unless you take intervention steps today, an unprecedented level of project waste will occur during the next 5-10 years.

Image from iStockphoto

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Michael Krigsman is a recognized authority on the causes and prevention of IT failures.

Disclosure

Michael Krigsman

Michael Krigsman writes and speaks about technology in a manner that most observers consider to be fair and balanced. Michael believes that writing about IT failures, which often have complex causes, creates a unique obligation to be reasonable and accurate in both reporting and analysis.

Michael maintains active personal and professional relationships with enterprise technology buyers, vendors, analyst firms (or individual analysts), consultants, and system integrators. As CEO of Asuret, Michael sells and delivers paid services to members of these same groups.

Vendors regularly reimburse Michael's out-of-pocket travel expenses to attend industry conferences and events. Conference organizers frequently waive entry fees when Michael attends industry events. Michael often speaks at industry conferences and events.

He is a member of the Enterprise Irregulars, a loose association of consultants, investors, industry representatives, analysts, and users of enterprise software.

For daily updates on Michael's activities, follow him on Twitter.

Biography

Michael Krigsman

Michael Krigsman is CEO of Asuret, Inc., a consulting company dedicated to reducing technology implementation failures. Asuret's suite of software tools improve the success rate of enterprise software deployments by quantifying and measuring governance issues that cause most project failures. Michael led the research effort underlying Asuret's model of collective intelligence and its practical application to reducing IT failures in consulting environments. He is a recognized authority on the causes and prevention of IT failures and is frequently quoted in the press on IT project and related CIO issues. He is considered an enterprise software industry "influencer" and provides advice to technology buyers, vendors, and services firms.

Previously, Michael served as CEO of Cambridge Publications, which develops tools and processes for software implementations and related business practice automation projects. Michael has been involved with hundreds of software development projects, for companies ranging from small startups to Fortune 500 organizations. Michael graduated with an M.B.A. from Boston University and a B.A. from Bard College. He is a Board member of the America's Cup Hall of Fame and the Herreshoff Marine Museum in Bristol, RI.

19
Comments

Join the conversation!

Just In

Not a New Problem
roger@... 15th Aug 2010
Unfortunately, this is not a new problem. I wrote about the high federal IT failure rates in my IASA editorial "On Obama's IT initiative" (http://www.objectwatch.com/white_papers.htm#EditorialIASA) and again in my white paper "The IT Complexity Crisis" (http://www.objectwatch.com/white_papers.htm#ITComplexity).

Until we wake up and realize that complexity is not a condition to be coddled but a disease to be eradicated, we have little hope of changing these statistics.

A recent development is important here. For the first time ever, The U.S. Patent office recently awarded a patent for a methodology and system that eliminates unnecessary IT complexity. (Disclosure: I am the patent holder.) This patent is not about how to better understand complexity, better test complexity, or better create complex systems. It is about how to eliminate the complexity that is directly responsible for these high failure rates. (Press release: http://www.objectwatch.com/press_release_04082010.htm)

In granting this patent, the Patent Office made these determinations:

- Complexity is measurable.
- Complexity is reducible.
- Complexity can be mathematically modeled.
- SIP (Simple Iterative Partitions) is a novel and unique approach to eliminating unnecessary IT complexity.

Until we start facing the problem of IT complexity head on, we have little hope of solving this highly expensive problem.
0 Votes
+ -
RE: Shocking gov't IT failure statistics!
wmmonroe@... 9th Aug 2010
The most shocking thing to me is that from 2006 - 2008 the number and percentage of projects on the watch list was so low.
0 Votes
+ -
Measurement changed?
vanderwal 9th Aug 2010
My recollection was measurement and assessment changed and got more strict and new guidelines finally came into effect. Passing hurdles prior was really a very low hurdle.
0 Votes
+ -
Contributr
RE: Shocking gov't IT failure statistics!
mkrigsman@... 9th Aug 2010
@vanderwal Even given your points, it doesn't explain the trend toward larger projects, which I think is an indicator of downstream failure.
0 Votes
+ -
Why is this news?
cornpie 9th Aug 2010
Having worked for both the government and contractors I have to tell you I'm surprised that the number isn't much higher than that. What is surprising to me is that this is news to anyone. Government performance on IT projects has always been dismal. Not that its all that great in the corporate world, but the government pretty much tops everyone. And if you think the feds are bad, try looking at state government some time.
0 Votes
+ -
Contributr
RE: Shocking gov't IT failure statistics!
mkrigsman@... 9th Aug 2010
@cornpie Poor performance on gov't IT projects is not news. The extent of poor planning and the negative trend is the surprising part.
0 Votes
+ -
I agree that...
cornpie 10th Aug 2010
@mkrigsman@... we don't seem to have learned anything.
0 Votes
+ -
@cornpie
I believe the federal government (and perhaps state and local governments) tend to identify "lofty" or massive goals that may appear on the surface to be "simple" like:

* End world hunger

* Cure cancer

* Integrate the criminal, suspects, terrorist, and spy databases together for national security agencies (NSA, FBI, CIA) and data mine it.

* Send a manned submarine 20,000 leagues under the sea

The list goes on. They all sound relatively simple on the surface, but are enormously complex as you begin to peel the layers away and understand what?s really involved.
0 Votes
+ -
IT consolidation (and lowering costs) leads to fewer, larger projects that are higher risk... This article means absolutely nothing. Also, did the author bother to read the presentation?

Slide 9:
"These projects are considered high-risk, requiring special attention from the highest level of agency management and oversight authorities due to the size, complexity, and/or nature of the risk of the project, but are not necessarily at-risk."
0 Votes
+ -
Contributr
RE: Shocking gov't IT failure statistics!
mkrigsman@... 9th Aug 2010
@qflux "The projects are considered high-risk....but are not necessarily at-risk." Sorry, but aside from semantics, the language means these projects are high risk, which is the point of this post.
0 Votes
+ -
Wow
philsimonsystems 10th Aug 2010
Great post, Michael.

I couldn't agree more:
Common sense and conventional wisdom dictate that larger projects are more prone to fail than smaller ones. Key enemies of project success ? complexity, politics, and duration ? all rise substantially as project budgets increase.

As I continue to interview SMB owners doing things right, I'm happy not to have to put up "big organization" mindsets explaining the need for superfluous complexity and the other things endemic to massive projects like these.
0 Votes
+ -
I suspect that the real project killer is feature creep as directors and managers try to piggy-back additional 'capabillities'/field changes that were never thought of during the planning phase, which happened 4 years prior to the actual start of the project. Too much bureaucratic lead time makes the project out-of-date before it starts.
0 Votes
+ -
RE: Shocking gov't IT failure statistics!
Objectivist1 10th Aug 2010
It's certainly not news that government is the king of IT failure. They're not good at anything. But I'll (weakly) defend the 2009 numbers by agreeing with other posters that tighter criteria may be the root cause, not a worsening track record. But no worries: the government will fix the problem by changing the criteria for future reports -- then they will report how much better things are!
0 Votes
+ -
RE: Shocking gov't IT failure statistics!
compusolver Updated - 10th Aug 2010
I can't speak about federal projects, but on one state y2k project, over a dozen FoxPro programmers were hired and worked for two years. The result was that just six weeks before New Years, a flaw was discovered in the algorithms used. One programmer then wrote a patch and a program to apply it which ran on the state's Dept of Labor computer network for many hours, fixing everything. So why didn't they just hire the one programmer, and for only a few days, to begin with?
0 Votes
+ -
Simple
klumper 10th Aug 2010
@compusolver
So why didn't they just hire the one programmer, and for only a few days, to begin with?

It would have been too efficient - and ungovernment like.
0 Votes
+ -
Government public, private sector not
pdegroot 10th Aug 2010
I've never worked for government, but I've certainly seen (and been involved in a few) IT projects at private companies that were costly failures. I'd be careful in assuming that governments are inherently less efficient here than the private sector. If the private sector were required to report the same stats on everything it did, or if an FOIA request was valid against private firms, we might get a better idea of how such projects fare in government vs. private environments.
0 Votes
+ -
Inefficiency abounds
klumper Updated - 10th Aug 2010
@pdegroot

After all, we're mostly human in these constructs and endeavors. The key difference is the kind of money GOVT can throw at any given problem. It remains a largely bottomless well when the funding is provided by taxpayers, with little accountability toward its efficient or *gasp* responsible use.

No matter how poorly run a private firm or department might be, eventually sh*t hits the fan as dictated by the bottom line. It's basically just a matter of time. At that point heads tend to roll, and sweeping changes or rethought approaches are adopted. Can you say the same for GOV -- especially one as capricious and scatterbrained as our Feds have proven to be in the modern era?
0 Votes
+ -
@klumper
Although the scale of money involved in government projects are large, there are spectacular failure stories of commercial companies who have spent significant percentages of their annual revenue on ERP or CRM projects such as Shane & Co., or Sleep Comfort.
0 Votes
+ -
I'll give you that
klumper 12th Aug 2010
@elizab

No one has yet to corner the market of spectacular failure. wink
0 Votes
+ -
Not a New Problem
roger@... 15th Aug 2010
Unfortunately, this is not a new problem. I wrote about the high federal IT failure rates in my IASA editorial "On Obama's IT initiative" (http://www.objectwatch.com/white_papers.htm#EditorialIASA) and again in my white paper "The IT Complexity Crisis" (http://www.objectwatch.com/white_papers.htm#ITComplexity).

Until we wake up and realize that complexity is not a condition to be coddled but a disease to be eradicated, we have little hope of changing these statistics.

A recent development is important here. For the first time ever, The U.S. Patent office recently awarded a patent for a methodology and system that eliminates unnecessary IT complexity. (Disclosure: I am the patent holder.) This patent is not about how to better understand complexity, better test complexity, or better create complex systems. It is about how to eliminate the complexity that is directly responsible for these high failure rates. (Press release: http://www.objectwatch.com/press_release_04082010.htm)

In granting this patent, the Patent Office made these determinations:

- Complexity is measurable.
- Complexity is reducible.
- Complexity can be mathematically modeled.
- SIP (Simple Iterative Partitions) is a novel and unique approach to eliminating unnecessary IT complexity.

Until we start facing the problem of IT complexity head on, we have little hope of solving this highly expensive problem.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix