ie8 fix
madison

IT metrics may be misleading due to 'false transparency'

By | March 14, 2011, 2:47pm PDT

Summary: A burgeoning IT cost transparency movement promises better insights into the value of systems and software. Or is it missing something?

Measuring return on investment (ROI) for IT projects has always been more of an art than a science; and I’ve frequently heard IT managers remark that the ROI numbers are often customized to what the business wants to hear, and adjusted after the implementation is underway.

ComSci’s Robert Svec suggests that IT metrics — though often seemingly airtight — may also not be providing a true picture of IT’s value, as they may miss the big picture. Scec recently weighed in with his thoughts on the budding IT cost transparency movement, which seeks to better enable organizations to take an integrated view of all direct and indirect IT costs, services and utilization rates to better understand the value of IT systems and software:

“Many firms focus on key metrics measurement programs and business intelligence communications without having adequate technology consumption tracking mechanisms or a full view into the scope of technology utilization for the business. This is often the result of a limited strategic role of IT or decentralized business practices. As a result, earnest attempts at transparency efforts can often result in ‘false transparency’ – key metric data and analysis that monitors only a part of the full technology portfolio, which leads to misrepresentation of how the business and technology assets are aligned.”

Such false transparency is even more dangerous than a lack of overall IT-spend and utilization data, Svec continues, since “it can lead to larger, more strategic decisions that management believes to be driven by sound data but that could be, ultimately, completely inconclusive and inaccurate.”

At the root of the problem, Svec believes, is the usual problem seen in many organizations: IT tends to be siloed from the mainstream business, and chargeback mechanisms fail to capture the true scale of usage.

How to achieve better metrics?  Keep your eye on the big picture, Svec advises. Look at things as the business sees them, not as IT sees them.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Joe McKendrick is an author, consultant and speaker specializing in trends and developments shaping the technology industry.

Disclosure

Joe McKendrick

Joe McKendrick is an independent consultant, editor and speaker.

Joe has performed project work (white papers, articles, blogs, research and presentations) for the following companies in the IT marketspace:

  • CBS Interactive/CNET/ZDNet (this blog)
  • ebizQ
  • Evans Data
  • Gartner
  • IBM
  • Informatica
  • IDC
  • Microsoft
  • Systinet/HP
  • Teradata
  • Unisphere Reseach, a division of Information Today, Inc.
  • WebLayers

Joe has also performed research work for the following sponsoring organizations in partnership with Unisphere Research, a division of Information Today, Inc.

  • IBM
  • Luminex
  • Noetix
  • Oracle Corp.
  • Teradata
  • Informatica
  • International Oracle Users Group
  • Oracle Applications Users Group
  • Professional Association for SQL Server
  • International DB2 Users Group
  • International Sybase Users Group
  • SHARE (IBM large systems users group)

Biography

Joe McKendrick

Joe McKendrick is an author and independent analyst who tracks the impact of information technology on management and markets. Joe is co-author, along with 16 leading industry leaders and thinkers, of the SOA Manifesto, which outlines the values and guiding principles of service orientation. He also speaks frequently on Enterprise 2.0 and SOA topics at industry events and Webcasts, and serves on the program committee for this year's SOA & Cloud Symposium in London. As an independent analyst, he has also authored numerous research reports in partnership with Unisphere Research, a division of Information Today, Inc. for user groups such as SHARE, Oracle Applications Users Group, and International DB2 Users Group. In a previous life, Joe served as director of the Administrative Management Society (AMS), an international professional association dedicated to advancing knowledge within the IT and business management fields. He is a graduate of Temple University.

4
Comments

Join the conversation!

Just In

RE: IT metrics may be misleading due to 'false transparency'
randalljames1@... 30th Mar 2011
Bob makes some good points, even if he is stating the obvious.

Sometimes we all need to just "back to basics".
0 Votes
+ -
Failing to quantify intangibles and take into account full costs, such as impacts on customers, generally are far larger sources of distorted ROI determinations. My REAL ROI? methodology takes both into account to provide right, reliable, and responsible financial analysis.
0 Votes
+ -
Truly Inspired Advice
wilhoyt 15th Mar 2011
"How to achieve better metrics? Keep your eye on the big picture, Svec advises. Look at things as the business sees them, not as IT sees them."

Next he'll tell us to think outside the box and not ignore the 800 pound gorilla in the room.
0 Votes
+ -
A geek tradition
jeverettk Updated - 15th Mar 2011
Anybody else think the phrase "false transparency" falls within the geek tradition of self referencing humor? No?

No?
0 Votes
+ -
Bob makes some good points, even if he is stating the obvious.

Sometimes we all need to just "back to basics".

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix