X
Business

Tech evolution in data storage

In most companies, data storage has long been viewed as a necessary evil. But that thinking is evolving as the type of data stored is changing
Written by Salvatore Salamone, Contributor
Specifically, three major trends are forcing companies to re-evaluate storage strategies. First, more and more static data is being stored. For example, many companies now must archive e-mail or scan in all types of documents and store them electronically. Typically, these data items never change once stored. Second, the volume of stored data is increasing exponentially thanks to the increased use of digital images, and online audio and video presentations. To put this in perspective, analysts at the storage industry consultancy The Enterprise Storage Group, have reported that the average digital photo, at 750 KB, takes as much storage as 30 pages of plain digital text with 600 words per page. So, as far as storage measurements go, "a picture is worth 18,000 words." The third data trend is that many companies want all data to be available online rather than archived offline, which creates new challenges for storage management systems. This combination of increasing amounts of fixed content data, larger data files, and the need to have instant access to all data is prompting the creation of new storage strategies. I'll examine how a couple of new solutions are helping to streamline storage management. Easing the management load
To meet the latest storage requirements, many companies have simply thrown more hardware at the problem -- adding storage capacity to keep up with the demand. But this approach is not cost-effective in the long run. If companies don't determine more efficient ways to manage storage systems, the total cost of ownership will grow out of control. "We find ourselves putting in more time managing the storage process and systems," said Alexander Richardson, IS consultant at a California electronics manufacturing company. Richardson is looking for storage systems that have management software so he can automate manual tasks that now require costly staff time. A handful of partnering agreements between storage equipment vendors, including EMC and Hitachi Data Systems, and software developers highlights a growing trend in which application data, the management of that data, and storage centers are becoming more tightly integrated. The trend is driven by the idea of having data storage applications deal with much of the data management work -- such as tracking which network drive, folder, or volume contains a specific file. This automation approach, according to experts, holds promise for simplifying storage management. "As data-placement software becomes more sophisticated, applications and end users do not need to pay as much attention to the underlying architecture of the systems used," explained David Hill, managing director of storage and storage management at Aberdeen Group. One example of this new application strategy is EMC's introduction of a new storage system called Centera. Centera's approach takes data (a file, an image, a video clip, whatever) and associates it with a unique, location-independent identifier called a Content Address. The application required to view, search, or analyse the data then uses the identifier to retrieve the relevant files or items from storage.

One of the biggest storage challenges companies will face soon is how to manage data-especially fixed-content data-over very long periods of time.

In general, across all markets (financial, manufacturing, healthcare, and so on), 75 percent of all new digital data is fixed content, according to Hal R. Varian, dean of the School of Information Management and Systems at the University of California at Berkley.

Varian's research on the growth of storage requirements reveals that the amount of storage data doubles every year, and that much of the fixed-content data needs to be retained for very long times -- think check images and medical X-ray files. And that's where the total cost of ownership for storage management comes in. Traditionally, in hierarchical storage management systems, data that is not used often is progressively migrated to lower-cost storage media. For example, data might start out being stored on a server's hard disk drive or a high-performance storage system, and if that data is not used, the files might be moved and archived to tapes and removed from the system. But now, enterprises want quick access to all information, even if it's data that won't be recalled for months -- so the trend has been to pull away from tape archives in closets to more accessible data storage containers.

"One of the biggest problems is that the [data] formats keep changing. And whenever you have a change in format, you have a big problem with data migration," explained Varian. "It's easier to have the data available on hard drives because migrating becomes a much smaller problem."

The increasing demand for quicker, faster access and more fluid migration capabilities, along with the huge data changes taking place in today's enterprises all signal a tech evolution in data storage. Tech leaders need to stay updated and informed about these important trends, as electronic data, after all, is a key element of business-both offline and online.


Have your say instantly in the Tech Update forum.

Find out what's where in the new Tech Update with our Guided Tour.

Let the editors know what you think in the Mailroom.

Editorial standards