A transparently-scalable metadata service for the Ursa Minor storage system

Abstract

The metadata service of the Ursa Minor distributed storage system scales metadata throughput as metadata servers are added. While doing so, it correctly handles metadata operations that involve items served by different metadata servers, consistently and atomically updating the items. Unlike previous systems, it does so by reusing existing metadata migration functionality to avoid complex distributed transaction protocols. It also assigns item IDs to minimize the occurrence of multiserver operations. Ursa Minor’s approach allows one to implement a desired feature with less complexity than alternative methods and with minimal performance penalty (under 1 % in non-pathological cases). 1