A Comprehensive Survey on Mamba: Architectures, Challenges, and Opportunities

Abstract

We comprehensively review a preliminary understanding of Mamba and its evolution. We present a taxonomy and provide a detailed architecture description, diving into reviews of existing architecture variants. We also highlight the challenges and open issues confronted by Mamba to inspire future research agendas.