ie8 fix
madison

Annual cost of IT failure: $6.2 trillion

By | September 30, 2009, 6:10am PDT

Summary: The total annual cost of worldwide IT failures is $6.2 trillion dollars, according to calculations performed by Roger Sessions, über-expert enterprise architect and CTO of ObjectWatch.

The total annual cost of worldwide IT failures is $6.2 trillion dollars, according to calculations performed by Roger Sessions, über-expert enterprise architect and CTO of ObjectWatch.

Roger presents his analysis in a blog post:

According to the World Technology and Services Alliance, countries spend, on average, 6.4% of the Gross Domestic Product (GDP) on Information Communications Technology, with 43% of this spent on hardware, software, and services. This means that, on average, 6.4 X .43 = 2.75 % of GDP is spent on hardware, software, and services. I will lump hardware, software, and services together under the banner of IT.

According to the 2009 U.S. Budget, 66% of all Federal IT dollars are invested in projects that are “at risk”. I assume this number is representative of the rest of the world.

A large number of these will eventually fail. I assume the failure rate of an “at risk” project is between 50% and 80%. For this analysis, I’ll take the average: 65%.

Every project failure incurs both direct costs (the cost of the IT investment itself) and indirect costs (the lost “opportunity” costs). I assume that the ratio of indirect to direct costs is between 5:1 and 10:1. For this analysis, I’ll take the average: 7.5:1.

To find the predicted cost of annual IT failure, we then multiply these numbers together: .0275 (fraction of GDP on IT) X .66 (fraction of IT at risk) X .65 (failure rate of at risk) X 7.5 (indirect costs) = .089. To predict the cost of IT failure on any country, multiply its GDP by .089.

Based on this, the following gives the annual cost of IT failure on various regions of the world in billions of USD:

REGION        GDP (B USD)  Cost of IT Failure (B USD)
World         69,800       6,180
USA           13,840       1,225
New Zealand   44           3.90
UK            2,260        200
Texas         1,250        110

THE PROJECT FAILURES ANALYSIS

Quantifying the cost of failure is an exceedingly important step in communicating the scope and breadth of this worldwide problem. Roger Sessions deserves our thanks for doing so.

The calculations are highly dependent on the underlying assumptions. Some of the key variables include:

  • Definition of “failure”
  • Rates of failure
  • Global variation in rates across country

Although Roger’s calculations are not precise, they paint a clear, directional picture suggesting the financial impact of IT failures.

Please share your thoughts on how these calculations can be refined.

[[Image from iStockphoto.]

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Michael Krigsman is a recognized authority on the causes and prevention of IT failures.

Disclosure

Michael Krigsman

Michael Krigsman writes and speaks about technology in a manner that most observers consider to be fair and balanced. Michael believes that writing about IT failures, which often have complex causes, creates a unique obligation to be reasonable and accurate in both reporting and analysis.

Michael maintains active personal and professional relationships with enterprise technology buyers, vendors, analyst firms (or individual analysts), consultants, and system integrators. As CEO of Asuret, Michael sells and delivers paid services to members of these same groups.

Vendors regularly reimburse Michael's out-of-pocket travel expenses to attend industry conferences and events. Conference organizers frequently waive entry fees when Michael attends industry events. Michael often speaks at industry conferences and events.

He is a member of the Enterprise Irregulars, a loose association of consultants, investors, industry representatives, analysts, and users of enterprise software.

For daily updates on Michael's activities, follow him on Twitter.

Biography

Michael Krigsman

Michael Krigsman is CEO of Asuret, Inc., a consulting company dedicated to reducing technology implementation failures. Asuret's suite of software tools improve the success rate of enterprise software deployments by quantifying and measuring governance issues that cause most project failures. Michael led the research effort underlying Asuret's model of collective intelligence and its practical application to reducing IT failures in consulting environments. He is a recognized authority on the causes and prevention of IT failures and is frequently quoted in the press on IT project and related CIO issues. He is considered an enterprise software industry "influencer" and provides advice to technology buyers, vendors, and services firms.

Previously, Michael served as CEO of Cambridge Publications, which develops tools and processes for software implementations and related business practice automation projects. Michael has been involved with hundreds of software development projects, for companies ranging from small startups to Fortune 500 organizations. Michael graduated with an M.B.A. from Boston University and a B.A. from Bard College. He is a Board member of the America's Cup Hall of Fame and the Herreshoff Marine Museum in Bristol, RI.

41
Comments

Join the conversation!

Just In

Contributr
Thanks for the link
mkrigsman@... 9th Oct 2009
Looks like an interesting, and it's now on my list to study!
0 Votes
+ -
I'm not buying their claims..
thetruth_z 30th Sep 2009
It looks like they're declaring all IT activities as a failure which is patently ridiculous..

The companies I support rarely experience a failure. I do the product evaluations up front and determine if a product is worthy of purchase and deployment.

I use the motto, if it isn't broke, don't fix it (or replace it). Since then each software vendor has come out with 6,7,8 new versions of software, but I'm not buying them.


I spec in low energy consumption systems built from off the shelf components for maximum reliability (no Gateways, Dells, HP, etc). I also instruct them to shut them down when they leave, less run-time for moving parts == higher reliability.

Most IT maintenance activity is centered around the nightly server backup. After that, it's the occasional keyboard, mouse, CPU fan, disk drive, minor software glitch, etc. I don't consider them to be IT failures.
0 Votes
+ -
Contributr
Definition of failure
mkrigsman@... Updated - 30th Sep 2009
Failure is not an all or nothing proposition. I generally consider failed projects to meet one of these three criteria:

1. Late
2. Over-budget
3. Doesn't meet planned objectives

From that standpoint, the numbers in this post are actually conservative and probably understate the problem.
0 Votes
+ -
6.2 trillion dollars is enough money to pay one hundred million(100,000,000) IT persons 62K$ per year. I don't think so, the number is WAYYY out line.

As for your criteria, those don't cut it since most management are NOT trained in the sciences, therefore incompetent to manage most technology driven projects.

I.E. A vast majority of management wants their projects completed for free, completed before it was proposed, and will manufacture gold coins on demand.

In the real world, technology projects are mostly dictated by principles of science, and the skill levels of those implementing them.
0 Votes
+ -
Contributr
Check the math or assumptions
mkrigsman@... 30th Sep 2009
Opinions that something is "way out of line" are fine, but what is the point of comparison.

Stating a strong opinion with out comment / criticism of the math or assumptions doesn't add anything.
0 Votes
+ -
For the most part, indirect costs are just the expenses lost in the project(at most 1x, Author assumes 7.5x). A as a majority of IT projects and upgrades are replacing some other existing system/proceedure.

And most IT upgrades have high secondary value even if the initial project was a failure(new PC's, etc).

I.E. A new $300 fax machine (operational costs $30/month verses expensive 400$/mo fax-copier lease) still functional even though the fax to/from email function doesn't work 100% of the time.

I would place the overall cost of IT failure number in the 50 to 300 billion dollar range.

Yep, that's right what is the Cost of Doing Business WITHOUT IT infrastructure???

No computers, no cell phones, no GPS, nothing more than some TI calculators and landline phones. That figure would be so high that one really can't put a price on it.

Meanwhile, the IT infrastructure we have won't last forever, without replacement it will fail. Then it's your back to the first premise, what is the cost of NO Information technology??


Lastly, it makes the ludicrous assumption that major federal IT projects (worthy of analysis) == ALL projects public and private.

Larger the projects have a near zero percent chance of 100% success. Every large project must make design and implementation compromises along the way. I.E. The spec writers aren't perfect, and make errors. Larger projects == more spec errors.
0 Votes
+ -
So anything learned while developing these
GuidingLight 30th Sep 2009
"failed projects" are not used in a new, sucessfull project?

That is the problemn with studies like these.

If 9 out of 10 objectives are met, it is a failure.

Yet those 9 objective that do work go on to save the company money: if the goal was to spend 1 million dollars to save 10 million, and end up only saving 8 million, is that still considered a "failure", as the objective was not met?

I will take that kind of failure any day.
0 Votes
+ -
definition of failure
streiger 1st Oct 2009
I think there are lots of gray areas when you try to define failure.

Late and over-budget projects that do meet planned objectives shouldn't be considered failed projects, depending on how late and over-budget they've actually got in the end.



0 Votes
+ -
RE: Annual cost of IT failure: $6.2 trillion
Mike106132000@... 30th Sep 2009
Failure is inevitable for risk takers. if you are not
prepared to take a risk, bury your money in the garden!
Most people prefer to invest their money and innovate and
hope they are successful.Failure however is inevitable.
The success rate therefore must be the amount success
exceeds failure in a risk taking environment. I think the
world manages usually to manage to achieve a good success
to failure rate in technology. I wish we could say the
same for other economic sectors like banking and the auto
mobile industry.
0 Votes
+ -
Iv'e got artucles up articles of software desasters going back to the first days of computing.

Humans have been able to build space shuttles, massive jumbo jets, huge engineering endevours, and yet the "Software engineers" are still stuck in the 60's and 70's.

We have CPU integrated circuits with 10's of millions of components, just as or more complex than the software that runs on it, look at how integrated circuits have evolved and the science of making CPU's.

Why is the software industry not able to work to the engineering standards that every other industry is required too.

ISO9001, quality assurance programs, TQM, code reviews, unit testing. Object orientation.

Why is there not a rock solid set of basic computing function tools, that have been tested and QA'd that are efficient and well engineered ?

A passenger jet aircraft has millions of complex components and has a much more hostil environment to deal with, yet their reliability is amazing.

What happens if one crashes, it's studies and the cause is found out, and whatever needs to be dont so that will not happen again is done.

An engineering who works on the design of a jumbo jet would be instantly fired if he said to his boss, look there are alot of components here a few "bugs" wont hurt.

Well and lax attitude is not a part of engineering, it's a backyard hacker, someone unskilled and untrained, stabbing in the dark hoping they will fall upon something that works.

This is the state of the art of computer "science".

CPU's have gone from the 4004 CPU little more than a basic function calculator to the multi-Gig 64-Bit machine in 30 years.

In that same 30 years we've gone from C to shining C. (mabey with a few enhancements tacked on along the way).

Until software engineering becomes just that an engineering disipline with all that entails the cost of not "DOING THE RIGHT THINGS RIGHT FIRST TIME" (Quality Assurance term) your CoNC (Cost of Non-confirmance) will be in the trillions of dollars.

How long will it be before Government leglisates to "clean up" the industry?

0 Votes
+ -
Philosophical Differences
SpikeyMike 30th Sep 2009
I think you'll find the difference between AMD and Intel to be quite startling.

AMD is the of the mindset that they don't release a product until it is ready. Intel, on the other hand...

The same can be said of your beloved Microsoft... Some even say that Microsoft's lack of quality has lowered user expectations.

And then there is the whole Microsoft development tools - Click and Drool.

They're marketed to managers as being 'so easy', even non-programmers can use them! See - no training needed! Saves the company money!

0 Votes
+ -
RE: Philosophical Differences
fatman65535 Updated - 30th Sep 2009
SpideyMike,

I think you hit the salient points when you said:

The same can be said of your beloved Microsoft... Some even say that Microsoft's lack of quality has lowered user expectations.

And then there is the whole Microsoft development tools - Click and Drool.

They're marketed to managers as being 'so easy', even non-programmers can use them! See - no training needed! Saves the company money!


To your first comment, why in the world do people put up with the crap that M$ foists on the world. It must be due to the fact that (purchasing) decisions are not made by IT people; but by clueless managers.

Second point, Click and Drool - I like that suggestion. OH, wow, eye candy, and the resources that it uses slows your computer down.

Third point, is that just another way of saying that if you have enough monkeys throwing bananas at a keyboard, they might be able to write some executable code?? That sounds like a variant of the Geico tag line: it's so easy, even a Caveman can do it!

IMHO - M$, epic FAIL

So much capital wasted feeding M$'s cash trough that could be put to better uses.
0 Votes
+ -
Well, it beats wasting it on
GuidingLight 30th Sep 2009
dead end things like Linux or Apple, would you not agree?

It must be due to the fact that (purchasing) decisions are not made by IT people; but by clueless managers.

Nice way of selling everyone so short. Guess you must be the only smart IT person, the rest are just plain stupid.

Second point, Click and Drool - I like that suggestion. OH, wow, eye candy, and the resources that it uses slows your computer down.

Selling eveyone else (but yourself) short again?

Third point, is that just another way of saying that if you have enough monkeys throwing bananas at a keyboard, they might be able to write some executable code?? That sounds like a variant of the Geico tag line: it's so easy, even a Caveman can do it!

Guess you are not a programmer, otherwise you would understand alot more, but then it sounds like you are just selling everyone else (but yourself) short again

IMHO - Your Post = Epic FAIL!

So why even bother?

0 Votes
+ -
Recommended reading
IT_User 30th Sep 2009
The Mythical Man-Month by Fred Brooks. The examples you cite from other disciplines depend on drawings and other aids to ensure the developer and the customer agree on the end result before they begin. We try to do this in software as well, as we have continued over my 40 years in the business, to fiddle and shape our life cycle process, with mixed success.

Which brings me to Brooks. As he points out, software is neither visual nor visualizable - usually, the software engineer and the team members are not sme's in the business process and there is no way to be sure what they are building is what is needed. This is the same limitation, by the way, that defies the notion of a valid software patent.

This is not to excuse the software industry. Admittedly, development carries some risk, but practitioners add to the risk by accepting in-process changes and other violations of sound engineering practices.

There are those among us who believe software engineering will never reach the maturity level of other disciplines, but we sure as heck can improve on today's record.

0 Votes
+ -
Acountability
Saurondor. 30th Sep 2009
I used a phrase a while back to explain this in the security context of application development, but it applies to what you mention too. "Features are added by programmers with code, security is added by lawyers with EULAs."
0 Votes
+ -
don't guarantee 100% quality. Sure, the space shuttle and jumbo jets fly fairly reliably. There was and is also a very long development cycle for each new model produced. And various parts are designed, prototyped, tested, redesigned and retested through enough iterations that the end result is something that works most of the time. It may still fail at some point due to testing procedures not stressing a component enough, a machined tolerance not allowing for enough wear or expansion from heat (even though the part was built to specifications), or just plain old human error, careless or otherwise.

Software isn't any different. Any conscientious software engineer or programmer will make every attempt to assure that the end product functions to specifications, but upper management and/or marketing regularly provide roadblocks to allowing success (and guaranteeing failure).
0 Votes
+ -
A few counter-examples
Earthling2 Updated - 30th Sep 2009
Enigneering works well and more or less predictably when there is nothing new. When new things are tried, disasters do happen and money and lives are lost. Just a few random examples:

- Icarus
- Titanic
- Airplanes made of aluminum
- Collapsing bridges
- Various power plant disasters
- Challenger and Columbia
- LHC accidents
- Boeing delays of the new plastic aircraft
- F22 program (for it being cancelled)
- Various car, battery, etc recalls
- Finally, the banking system!

When you speak of electronics industry, think of it: for many years we still use the same basic CPU architecture and even the same set of machine commands, traceable back to 8008. Almost all other CPU architectures are all but failed.

Also, the rest of engineering disciplines produces devices that operate within narrow limits. You can't just throw random input (voltage, etc) at CPUs. Airplanes must fly within a narrow speed band at high altitudes or they will fall or disintegrate. Nobody allows passengers to play with different parts of the plane, customize it by uninstalling wings or deleting landing gears. There are also no crooks trying to siphon the fuel nowhere near the planes.

Yet we grew to expect the software to work under very harsh conditions yet behave the way we expect, each of us, regardless of our different tastes.

Yet again, we expect that we shouold not pay for it. We pay, on average, higher price for an airline ticket. Granted, there is cost of production and service and fuel, but an airplane may fly for 10 years or more, yet we expect an OS to be refreshed a couple of times a year, for free. A recent OS upgrade is priced less than 3 visits to a cinema.

There are two factors that make the software industry look like a disaster: very high expectations about new features and having these done for free. Try to find examples of these outside the software industry and you'll find plenty.
0 Votes
+ -
I'm not buying the $6.2T number since the GWP (Gross World Product) is $55T. The only failure is this article.

0 Votes
+ -
Contributr
What about the math?
mkrigsman@... Updated - 30th Sep 2009
Just because a number seems high to you does not make it wrong.

If you want to advance this conversation, then critique the math or the assumptions. Simply stating your opinion without factual basis is fine, but rather pointless.

0 Votes
+ -
Bad assumptions
wolf_z 30th Sep 2009
1) Let's start with the opportunity cost assumption, that it's 7.5:1. That's downright *stupid*.

2) How much of that lost opportunity cost is for the first year? Since this is a "per year" thing, you can't count anything past the first year, right?

3) Let's finish up with the assumption that there is *ANY* lost opportunity cost at all or that opportunity cost can be quantified.

This article's subject is RIAA math at its most loathsome.

Oh, and no definition of what failure should be? No handling of partial failure? Must a project be 100% successful or 100% failure with nothing in between?

These simplistic calculations are worthless.
0 Votes
+ -
What about the reality?
Red_Beard Updated - 30th Sep 2009
Most people who are read the word "Failure" do not receive the same message as a project manager does; nor does a "failed" project bring no value.

What the math fails to represent is the success of implementing the project, despite the cost over-runs, the schedule being pushed back further than expected, etc.

Because the perception that this information is presenting only (to non project managers) 100% Success, or 100% Failure, this doesn't pass the smell test for most IT folks.

A better approach would be to try to find the cost over-runs of projects, a standard time period (lets say three years?), and the savings (or costs) to the functions affected by the implementation of the project over that time period. Calculate these out and I think most non-project managers (and there are more of them than not), would be able to get useful information out of the article, not just data.

Thanks,
RB
0 Votes
+ -
Contributr
Waste is the key thing
mkrigsman@... 30th Sep 2009
Fair points, but I think the key issue is the amount of economic waste. It's not a question of benefit, but of unnecessary money spent.

Thanks for commenting.
0 Votes
+ -
"Fair points, but I think the key issue is the amount of economic waste. It's not a question of benefit, but of unnecessary money spent."

How do you determine whether your money spent was "unnecessary"? If you have a project which you can't determine the intangible benefits vs the intangible failures, you have *nothing*.

If you can't measure it you can't manage it. And I have no faith in the measurement of opportunity cost. It's so often done without acknowledging (for instance) that using a copy of software for free means the person would have bought it for $1,000 if they couldn't get it from piracy so that user cost your company $1,000.

Likewise saying project X didn't deliver the million dollars of cost savings it was supposed to is one thing. How then can you also say that it cost the company 7.5 million in potential revenue?

That's the fly in the ointment and what makes these kind of calculations worthless.
0 Votes
+ -
its quite simple
someitguy79 1st Oct 2009
Saying IT failures is 11 - 12% of World GDP is ridiculous. I doubt IT spending world wide is that high. Even so you are saying 100% IT spending = failure.
0 Votes
+ -
The Reason for Failures Focus!
Steve Romero 30th Sep 2009
Amazing and sobering at the same time.

This is the perfect answer the next time somebody asks you why your blog focuses on IT Failures.

This is why I spend my life evangelizing IT Governance and its critical and essential processes, such as Project and Portfolio Management (PPM).

Thanks for the post Michael. I am sure to make countless references to this information.

Steve Romero, IT Governance Evangelist
http://community.ca.com/blogs/theitgovernanceevangelist/
0 Votes
+ -
RE: Annual cost of IT failure: $6.2 trillion
doug.hanchard@... 30th Sep 2009
There are failures and there are repairs or upgrades. When a failure occurs in an ICT project, it rarely constitutes a complete loss of investment. Cost over runs occur and the results are often exceed complete outright failure or cancellation of the project.

There are some well known disasters in ICT projects. Among them was the EDS contract to outsource the entire U.S. Navy / Marine Corp network. The 7B contract with 4B extenstion ran into massive problems. The program's ITIL implementation solved the gaps that existed in transitioning the network to an outsource model, streamlined operations and single network architecture.

Initially there were shortfalls and signficant "failures" in its contract language, implementation strategy and technology transition. Yet today, the U.S. Navy and U.S. Marine Corp have what they wanted.

It could be argued that this project was a failure - yet succeeded.

Financial audits and categorizing the results of ICT programs is risky at best and unreliable and false at its worst.


0 Votes
+ -
Cost of doing business?
Saurondor. 30th Sep 2009
Is this something bad or just the cost of doing business? Take for example fuel consumption. According to http://www.hart-isee.com/index.php?page=world-population-gdp-growth for example.

"In the US, the market for energy and transportation in the US is a 1. 6 trillion dollar annual market. This constitutes roughly 11% of total US GDP. Energy purchases by consumers represent about 4.4 percent of total GDP. "

Say half of that (2.2% of GDP) is spent on gasoline. Internal combustion engines have a 25-30% efficiency. Meaning about 75-80% is lost as heat, friction, internal turbulence and expelled as gas through the exhaust.

I'm sure lots of you out there can find examples of "heat", "friction", "internal turbulence" and of course "expelled hot gas" going around in companies. Leading to the cited examples of inefficiency. It's not all about the tools and the programmers.
0 Votes
+ -
The only comments I can see here that appear relevant are questions about my multiplication factor, the one I call "lost opportunity costs".

Lost opportunity costs are basically the ROI that would have been realized on the investment (in this case, the new IT system) had the investment been successful.

Perhaps an example will clarify this concept.

Between 1994 and 2005, the Internal Revenue Service spent $185 million on a new electronic fraud detection system. The project was abandoned in 2006.

According to a report in 2008 by the Treasury Inspector General for Tax Administration, the Federal Government lost approximately $894 million in fraudulent refunds during 2006 because the system was not operational.

So in this case, the direct cost of the failure was $185 million and the indirect cost (the lost opportunity costs) was $894 million. Of course, that $894 million was lost just in 2006. Presumably the same amount was lost in 2007 and subsequent years.

To say that the only cost to the U.S. economy was the $185 million spent on the IT system itself is just plain wrong.

By the way, this example is taken from my editorial in Perspectives of the International Association of Software Architects published in January 2009. You can find it here: http://bit.ly/2xen52

Also, I should point out that my failure cost numbers are actually lower than the widely quoted Standish group Chaos report. I actually think there are flaws in the Standish analysis. Had this report not had these flaws, its numbers would have been even higher and made mine look even more conservative by comparison.

I'll be posting a blog in the next few days describing the flaws in the Chaos report. So stay tuned to my blog for this analysis: http://bit.ly/vmBZq

I hope this helps clarify my analysis.

- Roger Sessions
0 Votes
+ -
Methodology thoughts
DennisByron 1st Oct 2009
Roger

Good subject but...

1. why not count all the IT costs per your original source, the whole 6% (close to Gartner's number by the way), meaning including IT personnel and overhead costs instead of just purchased IT goods and services?
2. But why multiply times world aggregate GDP? That can't be a proxy for the aggregate expected ROI of all IT projects (otherwise, wouldn't you be saying that 100% IT project success would reduce total worldwide spending on all goods and services to zero?)

Being less serious, is the U.S. Federal government, the guys that brought us $600 toilet seats, the best source of the underlying "at risk" statistic? And what does the term "at risk" mean?

Dennis
0 Votes
+ -
"According to a report in 2008 by the Treasury Inspector General for Tax Administration, the Federal Government lost approximately $894 million in fraudulent refunds during 2006 because the system was not operational."

...then why could they not identify which refunds were fraudulent? Obviously they somehow knew the total, which indicates they calculated it somehow.

Assuming they didn't use some nebulous percentage (3% of all refunds are fraudulent (how do you know that?)) then they had to sum known fraudulent transactions. If they had done that then the information should have been sent to the IRS which could have jailed 1/3 of the population for tax fraud--thus rendering massive increases in Federal spending on prisoner mainenance costs--a true failure.

Where did I get the 1/3? I made it up--just as most ROI figures are made up. Or badly calculated. Or created using flawed logic or premises.

And that's the point. That $894 million isn't the true opportunity cost. The opportunity cost was the cost of *recovering* that $894 million in known fraud.

And that assumes the $894M figure is actually accurate--which is again my point.

Accurate calculation of opportunity cost is nearly impossible--so is getting a figure within an order of magnitude.
0 Votes
+ -
I think basing the calculations on government projects greatly overstates the cost, although they could very well be valid for government projects. As a private business owner (precision machining), we don't have a blank check for anything we need, IT related or otherwise, like the government does. We can't afford to waste money the way the government does because:

a. We need to make a profit so we can stay in business, grow, and remain competitive in the world market.

b. We can't just tell our customers "give us more money for what you're getting" the way the government does to taxpayers; our customers would buy elsewhere and give their money to someone else.
0 Votes
+ -
Contributr
@mike: have you tested the failure criteria and assessed against IT spend?
0 Votes
+ -
Most projects are doomed to fail
Chad_z 1st Oct 2009
Because they're run by people with a background in management and not IT. If they have any IT knowledge, it's 10 years out of date.

The other big cause of failure I see is out-sized overhead. A software project at the Navy, originally estimated fixed fee, fixed cost at $5 million on a 3 month delivery schedule ended up costing $29 million and a working product was never delivered.

The people responsible for that failure were promoted.

And that's why IT projects fail. The costs and delivery schedule were unrealistic. The project was being managed by people who didn't know technology. And there's no accountability built into the process.
0 Votes
+ -
I would like to thank Michael about this!
Yes, his warnings gives us, a "rough" picture about what happen in this area: IT Investment!
As a professional IT, we should take Michael warnings as a "warning signal".
0 Votes
+ -
nt
0 Votes
+ -
its like the old computer saying..
rupaa62 2nd Oct 2009
"Sorry but our computers are down, but please spend some money with us."

I would love to see how many companies are chalking up other losses, and, moving them to a IT loss. These numbers just don't come out right. As thetruth_z has said in his earlier post that amount of loss would pay 1 mill IT people 62thousand a year.

Makes you wonder also how much the TD bank mess will cost.
0 Votes
+ -
http://www.cis.gsu.edu/~mmoore/CIS3300/handouts/SciAmSept1994.html


"Company, a well-respected leader in software development that has since been purchased by Loral. FAA managers expected (but did not demand) that IBM would use state-of-the-art techniques to estimate the cost and length of the project. They assumed that IBM would screen the requirements and design drawn up for the system in order to catch mistakes early, when they can be fixed in hours rather than days. And the FAA conservatively expected to pay about $500 per line of computer code, five times the industry average for well-managed development processes. "

"According to a report on the AAS project released in May by the Center for Naval Analysis, IBM's "cost estimation and development process tracking used inappropriate data, were performed inconsistently and were routinely ignored" by project managers. As a result, the FAA has been paying $700 to $900 per line for the AAS software. One reason for the exorbitant price is that "on average every line of code developed needs to be rewritten once," bemoaned an internal FAA report. "

"Disaster will become an increasingly common and disruptive part of software development unless programming takes on more of the characteristics of an engineering discipline rooted firmly in science and mathematics [see box on page 92]. Fortunately, that trend has already begun. Over the past decade industry leaders have made significant progress toward understanding how to measure, consistently and quanhtatively, the chaos of their development processes, the density of errors in their products and the stagnation of their programmers' productivity. Researchers are already taking the next step: finding practical, repeatable solutions to these problems. "


It's 2009 now, and what has changed, how has the science and engineering disipline of "Software Engineering" progressed, and has it progressed at the same pace (or far behind) other "real" engineering disiplines, like electronics, and microprocessor design, memory, display, hardware in general, even motor cars, plains and so on.

All modern engineering disciples improve by quality assurance, and correct engineering practices, somehow big projects are allowing and ensuring their failure by hit and miss "engineering" methods.

("suck it and see", trial and error, hit and miss" techniques never work,)

It's still clear that CLEAN ROOM design, CMM and correct engineering standards are more successfull development models.

But it's not as "sexy" as just punching out the code and hoping for the best.

with this amount of loss and unnessary cost its only going to be a matter of time until this crisis reaches a point where Governments will have to ensure more control and leglislate to weed out the back yarders, and cowboys who are not willing to get certified and to correctly follow quality assurance and correct practices.

Like all other engineering disciplines are required to do.

Sooner this comes about the better, Im a qualified engineer (electronics), it's unthinkable for an engineering to create something that does not work.

If you do that, you are not an engineer, we dont just try things and see if they work, we use science, math and engineering and creativity to design something that works 100% within the defined specifications.

A great deal, (most) modern electronics also contain software, engineers tackle the software development the same way as hardware development with engineering discipline.

Resulting, it BUG FREE software and HARDWARE, it's not that hard.

Build a bridge and get your engineering wrong, a few "bugs" and the bridge falls down, you go to jail for incompetance, for NOT folling correct engineering rules.

0 Votes
+ -
Project failure = promotion
Art Royce 5th Oct 2009
Perhaps I am a "bit" of a cynic, but in over 20 years of IT I witnessed more promotions after a monumental IT failure than not. Perhaps this is just good political skills in action and always have scapegoats handy. Do the rest of you see this pattern? Is project failure really a path to career growth? Oddly, I think it is.
0 Votes
+ -
Social Problem:
Aussie_Troll 9th Oct 2009
Managers hire managers, you dont want to hire someone better than yourself. It's jus thow it is, it happens with every field.

It's also better (sometimes) to get those people involved in failed projects OUT OF projects.

It's a shame they end up in management, but it's usually better than them codeing.

The other end of the scale is when you get very competant engineers, promoted to management.

A good manager, will hire the best person for the position and the workload.
Keep hiring idiots, and you dont stay in business too long.

As soon as quality assurance and TQM in enfored on the software industry, pulling it kicking and screaming into the 21st century, where engineers are responsible for their work.

Where engineering moves from a backyard hobby industry to a professional and certified industry, like electronics engineering or accounting.

Imagine a pilot thinking that it's "OK" to make 1 to 5 mistakes every 1000 operations he does.

"Oops forgot the landing wheels, but it's ok it's 'just a bug'".

When an airplane crashes the cause is investigated in detail, great lengths are gone too to ensure they understand the problem, and they devise methods and ways to rectify the problem.

This reduces the number of failures to about zero, and you dont think a 777 Jet liner is not a complex machine with millions of seperate compents that have to work perfectly together, in all condition.

And they do that.

Same with buildings, bridges and so on.

Correct engineering practice is employed.
We designed and build and commisioned many many very large IT system, (SCADA Systems), they ALL WORK, and they are all exceedingly reliable.

We employ engineers, we develop the software and hardware for our systems, we use TQM (Total Quality Management) systems. We test thourougly, and we provide the ongoing support and maintenance as well.

It can be done, and is done on a regular basis.

The mindset of "a few bugs wont hurt", is clearly WRONG, and a "few bugs" means death to a project.

(Ubuntu has what arout 60,000 bugs on it's web page).
How can you expect secure and reliable operation when there are that many things you know are wrong with your software, yet you release it anyway !!!!

That is bordering on criminal. !
0 Votes
+ -
See the article "Health IT Project Success and Failure: Recommendations from Literature and an AMIA Workshop" on failure rates in healthcare IT.

http://www.jamia.org/cgi/content/full/16/3/291
0 Votes
+ -
Contributr
Thanks for the link
mkrigsman@... 9th Oct 2009
Looks like an interesting, and it's now on my list to study!

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix