2013 · 15 citations · 7 references
ComputingComputer ScienceHigh-performance ComputingDistributed SystemsMessage PassingStorage SystemsDistributed StorageDistributed Storage SystemsTransport LayerHigh-performance Computing NetworksHigh-performance Computing SystemsMessage Passing ArchitecturesMessage Passing InterfaceMessage-passing AlgorithmsPortabilityProgramming ModelsSockets
The Message Passing Interface (MPI) is one of the most portable high-performance computing (HPC) programming models, with platform-optimized implementations typically delivered with new HPC systems. Therefore, for distributed services requiring portable, high-performance, user-level network access, MPI promises to be an attractive alternative to custom network portability layers, platform-specific methods, or portable but less performant interfaces such as BSD sockets. In this paper, we present our experiences in using MPI as a network transport for a large-scale, distributed storage system. We discuss the features of MPI that facilitate adoption as well as challenges and recommendations.
7
Can MPI Benefit Hadoop and MapReduce Applications?