SPEND a little time using personal computers, and you will soon find that faster processing and more memory are the name of the game. "Bigger and faster" are bywords in the supercomputing world as well.|
As computers have become more powerful and able to perform ever more complex tasks, data files have rapidly expanded. Unfortunately, data transfer rates and storage system capacities have not kept pace with the expansion of processing and memory capabilities. When preliminary work began at several Department of Energy national laboratories on the Accelerated Strategic Computing Initiative (ASCI), improving high-speed storage became a high priority. ASCI, a major component of DOE's science-based Stockpile Stewardship and Management Program and one of the largest supercomputing projects of all time, will be used to assess the safety, security, and reliability of our nuclear stockpile.
For work in creating an entirely new approach to data storage management and transfer, Lawrence Livermore, Los Alamos, Sandia, and Oak Ridge national laboratories, together with IBM Global Government Industry, recently won an R&D 100 Award. They designed and implemented the High-Performance Storage System (HPSS), which is capable of managing the storage and data transfer needs of even the most demanding supercomputers and high-speed networks.
The collaboration is based on the premise that no single organization has the ability to confront all of the issues that must be resolved for significant advances in high-performance storage system technology. Lawrence Livermore and its sister DOE laboratories have played leadership roles in this work because of their long history of development and innovation in high-end computing in order to accomplish their national defense and scientific missions.
High-Performance Storage System|
The HPSS software is designed to manage data storage capacity into the petabyte range (a quadrillion, or 1015, bytes) and data transfer rates in the gigabyte-per-second range (a billion, or 109, bytes per second). It can move very large data files among high-performance computers, workstation clusters, and storage libraries at speeds 100 to 1,000 times faster than are possible with conventional storage software systems. These speeds support new large-scale applications in high-performance computing, data collection and analysis, and imaging. For example, high-definition digitized video in real time is now a possibility. The key breakthroughs are a network-centered design, parallel data input/output, and servers that can be distributed and replicated.
All competing products were designed at a time when terabyte (a trillion, or 1012 bytes) storage capacities and megabyte- (million-) per-second transfer rates were the target. Unlike most large-scale data storage systems preceding it, HPSS has a network-centered design. In conventional systems, general-purpose computers act as storage servers that connect to storage units such as disks and tapes. The servers act as intermediaries in passing data to client systems. As data rates increase for storage devices and communications links, the size of the server must also increase to provide the required capacity and total data throughput bandwidth. These high data rates and capacity demands tend to drive the storage server into the mainframe class, which can be expensive to purchase and maintain.
If the storage software system and storage devices are instead distributed over a network, control of the storage system can be separated from the flow of data. The bottleneck is removed, allowing more rapid data transmission and expanded performance and capacity. Workstation-class systems used as storage servers provide the high performance required and reduce the cost for storage-server hardware in the bargain.
Focus on the Network
Key Words: Accelerated Strategic Computing Initiative (ASCI), computer network, hierarchical storage management, High-Performance Storage System (HPSS), large-scale computer storage, parallel computing, R&D 100 Award, supercomputing.
For further information, contact Dick Watson (510) 422-9216 (firstname.lastname@example.org), or visit the HPSS Internet home page at http://www.sdsc.edu/hpss/.