IEEE Transactions on Instrumentation and Measurement · 2023 · 27 citations · 34 references
EngineeringComputer EngineeringComputer ScienceField-programmable Gate ArraysMachine LearningParallel ComputingDeep LearningFault DetectionField-programmable Gate Array ArchitectureFpga ArchitectureHardware AccelerationReconfigurable AcceleratorsBearing Fault DiagnosisConvolutional Neural NetworksField-programmable Gate Array AccelerationField-programmable Gate Array AcceleratorsField-programmable Gate Arrays (Fpgas)Knowledge DistillationMachine Fault DiagnosisModel-based Fault Diagnosis
Deep learning has achieved remarkable success in the field of bearing fault diagnosis. However, this success comes with larger models and more complex computations, which cannot be transferred into industrial fields requiring models to be of high speed, strong portability, and low-power consumption. In this article, we propose a lightweight and deployable model for bearing fault diagnosis, referred to as BearingPGA-Net, to address these challenges. First, aided by a well-trained large model, we train BearingPGA-Net via decoupled knowledge distillation (DKD). Despite its small size, our model demonstrates excellent fault diagnosis performance compared with other lightweight state-of-the-art methods. Second, we design a field-programmable gate array (FPGA) acceleration scheme for BearingPGA-Net using Verilog. This scheme involves the customized quantization and designing programmable logic gates for each layer of BearingPGA-Net on the FPGA, with an emphasis on parallel computing and module reuse to enhance the computational speed. To the best of our knowledge, this is the first instance of deploying a convolutional neural network (CNN)-based bearing fault diagnosis model on an FPGA. Experimental results reveal that our deployment scheme achieves over <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$200\times $ </tex-math></inline-formula> faster diagnosis speed compared with CPU, while achieving a lower than 0.4% performance drop in terms of F1, recall, and precision score on our independently collected bearing dataset. Our code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/asdvfghg/BearingPGA-Net</uri> .
34
Karl R. Weiss, Taghi M. Khoshgoftaar, Dingding Wang · Journal Of Big Data · 2016 · 6.2K citations · Full text
Knowledge Distillation: A Survey
Jianping Gou, Baosheng Yu, Stephen J. Maybank et al. · International Journal of Computer Vision · 2021 · 3.5K citations · Full text
Computing, Chemical Engineering, Knowledge Representation +2
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Chen Zhang, Peng Li, Guangyu Sun et al. · 2015 · 2.1K citations