IEEE Access · 2019 · 67 citations · 37 references
ComputingComputational EngineeringComputer ScienceData MiningMachine LearningMaintenance EngineeringDeep LearningFault DetectionFault DiagnosisOverfittingPattern RecognitionTransfer LearningBearing Fault DiagnosisBearing FaultsFine-tuningFreezingMachine Learning-based Fault DiagnosisParameter TransferParameter TuningTarget Domain Adaptation
Transfer learning is a promising deep learning approach that can be used in applications that suffer from insufficient training data. Parameter transfer, which is a method of improving the accuracy and training speed by training the target network using the parameters of the source network, selects two conventional parameter repurposing methods, such as parameter freezing and fine-tuning depending on the amount of target data and network size. In this paper, we propose a novel method to increase the performance in the target domain in an intermediate approach of both methods. The proposed method, selective parameter freezing (SPF), freezes only a portion of parameters not freeze or fine-tunes all parameters within a layer by choosing output-sensitive parameters from the source network. Freezing only sensitive parameters while training is to reduce the amount of trainable parameter and protect informative parameters from overfitting to a small number of target data. Using two sets of the source-target domain, artificial faults with different fault size and artificial faults-natural faults of rolling element bearing, the proposed SPF allows adaptation to the target domain by choosing the best degree of freezing with various amounts of target data and size of networks compared to conventional approaches.
37
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
Sinno Jialin Pan, Qiang Yang · IEEE Transactions on Knowledge and Data Engineering · 2009 · 23.2K citations
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke et al. · 2017 · 12.6K citations · Full text