IEEE Transactions on Industrial Informatics · 2024 · 13 citations · 18 references
ComputingComputer ScienceIndustrial EngineeringArtificial IntelligenceInternet Of ThingsMachine LearningDeep LearningFault DetectionFederated LearningIndustrial AutomationIndustrial Internet Of ThingsRepresentation LearningFault Detection Using Deep LearningFederated Training ArchitectureIndustrial Internet Of Things ArchitectureKnowledge DistillationMachine Learning For IotMachine Learning-based Fault DiagnosisTrainingVibration Data Analysis
The lack of complete labels and data heterogeneity are obstacles to the application of artificial intelligence-based methods in industrial scenarios, such as machinery fault diagnosis. To address these challenges, this article proposes a federated learning (FL) framework for the industrial Internet of Things based on bidirectional knowledge distillation (KD) and hard sample selection. In the framework, the cloud server provides a pretrained deep learning (DL) model based on the cross-domain public dataset to facilitate the cold start in real-world applications. Then during the training process, each participating factory trains its heterogeneous local DL model according to local data volume and computing resources. Bidirectional KD with feature maps and hard sample selection is then carried out on a shared dataset between the server and factories to share knowledge efficiently. Moreover, all the DL models used in the application of the proposed framework are designed based on expertise and attention mechanism to diagnose multiple types of machinery and faults. Case studies using the vibration data collected from multiple factories show that the proposed framework improves the fault diagnosis accuracy compared to other FL methods while significantly reducing communication overhead.
18
Qiang Yang, Yang Liu, Tianjian Chen et al. · ACM Transactions on Intelligent Systems and Technology · 2019 · 5.9K citations
Knowledge Distillation: A Survey
Jianping Gou, Baosheng Yu, Stephen J. Maybank et al. · International Journal of Computer Vision · 2021 · 3.5K citations · Full text
Computing, Chemical Engineering, Knowledge Representation +2
The future of digital health with federated learning
npj Digital Medicine · 2020 · 2.5K citations · Full text
Sequence-Level Knowledge Distillation
Yoon Kim, Alexander M. Rush · 2016 · 775 citations · Full text