Feeds

IBM intros Elastic Storage ... as used by human-crushing HPC brain Watson

10 billion files, 43 mins ... Where've we heard that before?

Internet Security Threat Report 2014

BM has announced Elastic Storage as a component of its software-defined storage portfolio, and it's actually a repackaging and renaming of the venerable GPFS product.

GPFS is IBM’s General Parallel File System for parallel access to massive numbers of files.

The IBM announcement says Elastic Storage “offers unprecedented performance, infinite scale, and is capable of reducing storage costs up to 90 per cent by automatically moving data onto the most economical storage device.”

That means tape, we understand.

Big Blue defines software storage thus:

Software-defined storage is a set of software capabilities that automatically manage data locally and globally, providing breakthrough speed in data access, easier administration and the ability to scale technology infrastructures quickly and more cost-effectively as data volumes expand. In addition, these advances can work with any company’s storage systems to provide automated and virtualised storage.

The announcements brings in some glamour from Watson, IBM’s Jeopardy computer system and we’re told that: “By using Elastic Storage capabilities, around five terabytes of Watson’s 'knowledge' (or 200 million pages of data) were loaded in only minutes into the computer’s memory,” and “IBM Research has demonstrated that Elastic Storage can successfully scan 10 billion files on a single cluster in just 43 minutes – a technology demonstration that translates into unequalled performance for clients analysing massive data repositories to extract business insights.”

At this point in the reading of IBM's announcement a bell went off in some brain cells: 10 million files in 43 minutes? Yes, we remember that. It was July 2011 and IBM used a Violin flash array to have GPFS scan in 10 billion files in 43 minutes.

IBM says:

Elastic Storage also exploits server-side Flash for up to six times increase in performance than with standard SAS disks … This feature recognises when a server has Flash storage and automatically uses that Flash as cache memory to improve performance.

Six times faster than standard SAS disk drives? I should hope so.

Does Elastic Storage now involve using IBM’s own FlashSystem flash array, the acquired TMS RamSan technology? Its Elastic Storage announcement mentions server-side flash is mentioned. An IBM spokesperson said: "The software can support any vendor's storage system, including IBM FlashSystem."

We’re told “Elastic Storage virtualises the storage allowing multiple systems and applications to share common pools of storage. This enables transparent global access to data without the need to modify applications and without the need for additional and often disruptive storage management applications.”

IBM says the National Center for Atmospheric Research’s Computational and Information Services Laboratory (CISL) stores and manages more than 50 petabytes of information between its Wyoming and Colorado centres and relies on Elastic Storage to give researchers fast access to vast amounts of diverse data. Last year CISL was talking about GPFS.

IBM’s announcement quotes Pamela Gillman, manager, Data Analysis Services Group, at CISL: “The IBM global file system software has enabled scalable, reliable and fast access to this information.”

Yep, GPFS it is.

We’re told: “A key component of Elastic Storage is its ability to automatically and intelligently move data to the most strategic and economic storage system available. … Elastic Storage can automatically move infrequently-used data to less expensive low cost tape drives, while storing more frequently-accessed data on high-speed Flash systems for quicker access.” That appears to be from Tivoli Storage Manager integration, with a dash of IBM Linear Tape File System (LTFS) added to the mix.

Elastic Storage supports OpenStack Cinder and Swift, and POSIX and Hadoop APIs.

To find out more about IBM's software-defined storage, go to this part of IBM’s web presence where the GPFS connection is made clear and Elastic Storage is described as a new code-name.

Elastic Storage v4.1 features:

  • Enhanced security - native encryption and secure erase, NIST SP 800-131A encryption compliance
  • Increased performance - Server-side IBM Elastic Storage Flash caches increase IO performance up to 6X
  • Improved usability - data migration; AFM, FPO, and backup/restore enhancements; reliability, availability and serviceability enhancements

This webpage notes: “When integrated with IBM Tivoli Storage Manager (TSM) or IBM Linear Tape File System (LTFS), IBM Elastic Storage can uniquely manage the full data life cycle, delivering geometrically lower cost savings through policy driven automation and tiered storage management.”

Read an introduction to IBM’s Elastic Storage here (PDF) - it is actually an introduction to GPFS v3.3 and copyrighted IBM Corporation 2010. IBM's YouTube video

IBM says: “Elastic Storage software will also be available as an IBM SoftLayer cloud service later this year,” implying you can buy the software directly from IBM or qualified partners.

There’s no pricing information provided. ®

Beginner's guide to SSL certificates

More from The Register

next story
Docker's app containers are coming to Windows Server, says Microsoft
MS chases app deployment speeds already enjoyed by Linux devs
'Hmm, why CAN'T I run a water pipe through that rack of media servers?'
Leaving Las Vegas for Armenia kludging and Dubai dune bashing
'Urika': Cray unveils new 1,500-core big data crunching monster
6TB of DRAM, 38TB of SSD flash and 120TB of disk storage
Facebook slurps 'paste sites' for STOLEN passwords, sprinkles on hash and salt
Zuck's ad empire DOESN'T see details in plain text. Phew!
SDI wars: WTF is software defined infrastructure?
This time we play for ALL the marbles
Windows 10: Forget Cloudobile, put Security and Privacy First
But - dammit - It would be insane to say 'don't collect, because NSA'
Oracle hires former SAP exec for cloudy push
'We know Larry said cloud was gibberish, and insane, and idiotic, but...'
Symantec backs out of Backup Exec: Plans to can appliance in Jan
Will still provide support to existing customers
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
Win a year’s supply of chocolate
There is no techie angle to this competition so we're not going to pretend there is, but everyone loves chocolate so who cares.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.