2017 · 28 citations · 20 references
EngineeringComputer EngineeringComputer ScienceComputer ArchitectureField-programmable Gate ArraysSystem-on-chip DesignAccelerator ArchitectureDeep LearningFpga ArchitectureHardware AccelerationParallel ArchitecturesThroughput OptimizationAcceleratorsConvolutional Neural NetworksDeep Learning AccelerationDeep Learning AcceleratorsLayer PruningMemory BandwidthMemory Bandwidth OptimizationPruning
Convolutional neural networks(CNNs) have been widely applied in various applications because of their ability to achieve accuracy close to or even better than human level perception. However, for large-scale CNN, the computation-intensive convolutional layers and memory-intensive fully connected layers have brought many challenges to the implementation of CNN on FPGA platform. In the existing implementations, the same parallelism strategy is used for the entire CNN model, such a "one size fits all" approach may result in resource utilization problem. To overcome this problem, this work proposes an FPGA-based accelerator, which consists of multiple processing elements(PEs), each is responsible for the computation of one layer in the network model. All the PEs are mapped on one chip so that different layers can work concurrently in a pipelined style. A methodology is proposed to maximize the throughput of the accelerator. In the fully connected layers, a pruning method is used to decrease the number of weights, which can save a lot of storage and computation. Moreover, a batch-based computing method is applied to the compressed data in order to reduce the required memory bandwidth. As a case study, we implement a large-scale CNN model, AlexNet, on VC707 Board which has a Xilinx FPGA chip Virtex-7 485T. The proposed accelerator can achieve a peak performance of 498.6 GOP/s and the power efficiency with the value of 21.3 GOP/s/W under 100MHz clock frequency, which outperforms previous approaches.
20
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Chen Zhang, Peng Li, Guangyu Sun et al. · 2015 · 2.1K citations
Song Han, Xingyu Liu, Huizi Mao et al. · ACM SIGARCH Computer Architecture News · 2016 · 2K citations