Automation tools promise greater value for SSDs

Flash storage could be the most powerful tool yet for IT administrators who want to speed-up access to frequently used data. Yet, reaping its benefits may require automation software that has just begun to emerge from the major storage vendors.

Flash storage devices such as solid-state disks (SSDs) can bring up a given bit of data faster than hard disk drives (HDDs) because they can get to it without spinning a disk. Though much faster than HDDs at reading, they tend to offer less advantage in writing data, and all this comes at a much greater per-bit cost. So solid state is not expected to replace spinning disks, but to sit alongside them and handle only certain kinds of data.

There are two main ways to use flash, depending on an organisation's needs. Both take up less space and energy than other arrangements for fast storage, such as spreading a relatively small amount of data across several HDDs to shorten access times.

Inserted directly in a server, flash can form a second tier of data cache below DRAM. It is an arrangement that will automatically hold on to the most accessed bits, until use of those bits declines and they go down to disk storage. In the form of SSDs, flash becomes the top layer of the permanent storage system.

SSDs are worth it if they are dedicated to data that's read frequently, such as information in a database or popular multimedia content. But what's most often used and what's currently popular can change over time, and not all the data in a particular logical unit number (LUN) may qualify. So storage vendors are working on how to find the most active data and move it into the flash tier of the datacentre.

IBM officials recently disclosed some details of that company's plans in the area. IBM is developing a system called Automatic Data Relocation, which can identify the more active parts of a LUN and move them to flash storage, while assigning other data to HDDs. The software is scheduled to become available for IBM's DS8000 storage array in the first half of next year and for its Storage Virtualisation Centre platform in the second half.

EMC is developing its own automated tiering system, FAST (Fully Automated Storage Tiering), which will go on sale later this year and gain sub-LUN parsing capability in the middle of next year. Compellent Technologies was a pioneer in automating data movement and already has a system with sub-LUN capability.

Enterprises have three main options for using flash, according to analyst Andrew Reichman of Forrester Research. Using it as cache is best suited to enterprises that depend on fast performance, such as stock exchanges, he says. Basic prioritisation is automatic and most storage vendors also offer tools for "pinning" certain types of data to flash, so it doesn't automatically get purged from the cache.

Other organisations may install SSDs for their storage arrays and seek out or write better analytical tools to identify the most appropriate files to put there, Reichman says. However, not many IT departments have the spare resources to do it on their own, he says.

"Storage environments are overworked and understaffed as it is, and the likelihood of adding more things to do is slim."

One organisation that believes it has the smarts to take that path is MySpace. The company is currently using flash as cache, because speed is of the essence on the media-oriented social-networking service, according to Richard Buckingham, vice president of technical operations at the company. But it might expand that to SSDs in the future. Buckingham says MySpace has the technical expertise in-house to develop its own automated tiering software, while few other organisations do.

"Auto tiering is the way to go," says analyst Henry Baltazar of The 451 Group. "It's too much of a pain to micromanage all those different workloads." He believes applications themselves will eventually do much of the work of assigning data to different tiers, but first there need to be standards across the industry so they can talk to different vendors' infrastructure, he says. The Storage Networking Industry Association is one organisation working toward such standards. For now, it's up to individual vendors, he says.