Exploration of Parallel Storage Architectures for a Blue Gene/L on the TeraGrid

Michael Oberg, Henry M. Tufo, Matthew Woitaszek. Exploration of Parallel Storage Architectures for a Blue Gene/L on the TeraGrid. In 9th LCI International Conference on High-Performance Clustered Computing, Urbana, Illinois, USA, April 2008.

This paper examines the construction of a cost-effective storage cluster for an IBM Blue Gene/L supercomputer on the TeraGrid. The performance of storage clusters constructed using commodity Opteron servers and directly-attached fibre-channel RAID systems is analyzed utilizing the GPFS, Lustre, and PVFS file systems. In addition to traditional client scalability results, server scalability is also examined, identifying the number of servers required to saturate a 10 Gbps infrastructure network uplink. The results highlight test and system configurations that provide scalable throughput and identify configurations where the environment restricts scalability. Moreover, the Blue Gene/L's multiplexed I/O design introduces an additional point of contention that affects each file system to varying degrees.

@inproceedings{200804-lci2008-maelstrom,
      Address = {Urbana, Illinois, USA},
      Author = {Oberg, Michael and Tufo, Henry M. and Woitaszek, Matthew},
      Booktitle = {9th LCI International Conference on High-Performance Clustered Computing},
      Month = {April},
      Title = {Exploration of Parallel Storage Architectures for a {B}lue {G}ene/{L} on the {T}era{G}rid},
      Year = {2008},}