IEEE Transactions on Emerging Topics in Computing · 2023 · 14 citations · 25 references
ComputingComputer EngineeringComputer ScienceComputer ArchitectureEdge ComputingHardware-software Co-designAccelerator ArchitectureEdge ArchitectureEdge Artificial IntelligenceHardware AccelerationMemory Hierarchy OptimizationParallel ArchitecturesCompressionEdge Ai InferenceEdge Hardware AccelerationEdge IntelligenceEnergy-efficient Edge ComputingHardware-software IntegrationMemory ArraysModel Compression
By supporting the access of multiple memory words at the same time, Bit-line Computing (BC) architectures allow the parallel execution of bit-wise operations in-memory. At the array periphery, arithmetic operations are then derived with little additional overhead. Such a paradigm opens novel opportunities for Artificial Intelligence (AI) at the edge, thanks to the massive parallelism inherent in memory arrays and the extreme energy efficiency of computing in-situ, hence avoiding data transfers. Previous works have shown that BC brings disruptive efficiency gains when targeting AI workloads, a key metric in the context of emerging edge AI scenarios. This manuscript builds on these findings by proposing an end-to-end framework that leverages BC-specific optimizations to enable high parallelism and aggressive compression of AI models. Our approach is supported by a novel hardware module performing real-time decoding, as well as new algorithms to enable BC-friendly model compression. Our hardware/software approach results in a 91% energy savings (for a 1% accuracy degradation constraint) regarding state-of-the-art BC computing approaches.
25
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Xception: Deep Learning with Depthwise Separable Convolutions
François Chollet · 2017 · 19K citations