2019 · 38 citations · 42 references
ComputingComputer EngineeringComputer ScienceEmbedded SystemsHeterogeneous ComputingMachine LearningDeep LearningEmbedded Software DesignEnergy-efficient Embedded SystemsEnergy-efficient Mobile ComputingHeterogeneous System ArchitecturePerformance ModelingDeep InferenceEnergy-efficient Machine Learning On Mobile DevicesExecution Plan SelectionHeterogeneityHeterogeneous Embedded PlatformsResource-constrained ComputingSlicing AlgorithmsSystems Heterogeneity
Heterogeneous embedded systems have surfaced as a promising solution for accurate and efficient deep-learning inference on mobile devices. Despite extensive prior works, it still remains unexplored to investigate the system-software support that efficiently executes inference workloads by judiciously considering their performance and energy heterogeneity, communication overheads, and constraints. To bridge this gap, we propose MOSAIC, heterogeneity-, communication-, and constraint-aware model slicing and execution for accurate and efficient inference on heterogeneous embedded systems. MOSAIC generates the efficient model slicing and execution plan for the target inference workload through dynamic programming. MOSAIC significantly reduces inference latency and energy, exhibits high estimation accuracy, and incurs small overheads.
42
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Mark Sandler, Andrew Howard, Menglong Zhu et al. · 2018 · 25.4K citations
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke et al. · 2017 · 12.6K citations · Full text