IEEE Transactions on Computers · 2021 · 53 citations · 28 references
ComputingComputer ScienceComputer SystemsDistributed SystemsInternet Of ThingsMachine LearningDeep LearningIot ArchitectureLatency OptimizationConvolutional Neural NetworksData GatheringDeep Learning For IotDesign MethodologyDistributed Iot ApplicationsDistributed Iot SystemsIot System DesignMemory Optimization
Severe constraints on memory and computation characterizing the Internet-of-Things (IoT) units may prevent the execution of Deep Learning (DL)-based solutions, which typically demand large memory and high processing load. In order to support a real-time execution of the considered DL model at the IoT unit level, DL solutions must be designed having in mind constraints on memory and processing capability exposed by the chosen IoT technology. In this article, we introduce a design methodology aiming at allocating the execution of Convolutional Neural Networks (CNNs) on a distributed IoT application. Such a methodology is formalized as an optimization problem where the latency between the data-gathering phase and the subsequent decision-making one is minimized, within the given constraints on memory and processing load at the units level. The methodology supports multiple sources of data as well as multiple CNNs in execution on the same IoT system allowing the design of CNN-based applications demanding autonomy, low decision-latency, and high Quality-of-Service.
28
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia et al. · 2015 · 46.8K citations
Channel Pruning for Accelerating Very Deep Neural Networks
Yihui He, Xiangyu Zhang, Jian Sun · 2017 · 2.5K citations
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Chen Zhang, Peng Li, Guangyu Sun et al. · 2015 · 2.1K citations
Convolutional neural networks at constrained time cost
Kaiming He, Jian Sun · 2015 · 1.5K citations