TelaMalloc: Efficient On-Chip Memory Allocation for Production Machine Learning Accelerators

Abstract

Memory buffer allocation for on-chip memories is a major challenge in modern machine learning systems that target ML accelerators.