IEEE Transactions on Instrumentation and Measurement · 2023 · 23 citations · 26 references
Fault DiagnosisConvolutional Neural NetworkEngineeringMachine LearningEdge DeviceComputer ArchitectureNetwork ComputingHardware SecuritySparse Neural NetworkSystems EngineeringEmbedded Machine LearningInternet Of ThingsLightweight ArchitectureAdvanced NetworkingComputer EngineeringComputer ScienceDeep LearningNeural Architecture SearchEdge ArchitectureModel CompressionEdge Computing ScenariosFault-tolerant NetworkEdge ComputingNovel Lightweight NetworkCloud ComputingCheap Ghost Network
In recent years, deep learning (DL)-based fault diagnosis methods have witnessed significant advancements and successful applications in engineering practice. However, the increasing complexity of network structures demands higher computational resources in terms of floating point operations per second (FLOPS) and parameters, which poses challenges when deploying diagnostic models in edge computing scenarios with limited run resources. To address this issue, this study proposes a novel lightweight network, namely a cheap ghost network (CGhostNet), incorporating fine-grained feature knowledge distillation (FFKD). FFKD-CGhostNet leverages CGhostNet, a lightweight architecture, and transfers diagnostic knowledge from ResNet, a complex yet high-performing network, through FFKD. Extensive experiments are conducted on two test benches to demonstrate that FFKD-CGhostNet achieves comparable diagnostic performance to ResNet while significantly reducing parameter count by nearly 88 times and computational requirements by almost 14 times. These findings highlight the effectiveness of FFKD-CGhostNet in achieving superior diagnostic performance in resource-constrained edge computing scenarios.
26
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Mark Sandler, Andrew Howard, Menglong Zhu et al. · 2018 · 24.2K citations
Convolutional Neural Network, Scene Analysis, Engineering +17
GhostNet: More Features From Cheap Operations
Kai Han, Yunhe Wang, Qi Tian et al. · 2020 · 4.2K citations
Convolutional Neural Network, Engineering, Machine Learning +20
Knowledge Distillation: A Survey
Jianping Gou, Baosheng Yu, Stephen J. Maybank et al. · International Journal of Computer Vision · 2021 · 3.1K citations · Full text