Small Files Problem in Parallel File System

Abstract

Parallel file systems suffer performance degradation of small files generated by many workloads. We provide the systematic analysis of the small files problem from aspects of both parallel file system architecture and workload characteristics. Based on the analysis, we discuss the deficiencies of current optimizations and propose several open questions and possible research directions to address the problem.