IEEE Transactions on Instrumentation and Measurement · 2023 · 27 citations · 47 references
ComputingComputer ScienceHealth InformaticsElectrophysiologyMachine LearningSleep MedicineCardiac AssessmentDeep LearningElectrocardiogram InterpretationElectrocardiographyRepresentation LearningVital SignsAccuracyConvolutional Neural Network DetectionConvolutional Neural NetworksDeep Learning DetectionElectrocardiogram DiagnosisSleep Apnea DetectionSleep Apnea MonitoringTransformer Models
Objective: Automatic sleep apnea (SA) detection based on deep learning (DL) and single-lead electrocardiogram (ECG) has been extensively studied. We aim to explore the impact of different DL model structures and label mapping length (LML) on personalized transfer learning (TL), providing personalized TL applicability conditions based on the proposed hybrid transformer model (HTM). Methods: Two DL models, a pure convolutional neural network (CNN)-based model (PCM) and a proposed HTM, are included in the study. Eight different LMLs are considered. Furthermore, various personalized TL strategies are introduced to thoroughly explore the impact. Finally, two-sided t-tests are utilized to evaluate the significance. Results: In the same database, the average accuracy and AUC for the personalized PCM are 0.8412 and 0.9002, respectively, with <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p < 0.001$ </tex-math></inline-formula> , while the hybrid transformer-based personalized model achieves an average accuracy of 0.8537 and an average AUC of 0.9147 with <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p < 0.001$ </tex-math></inline-formula> . Across databases, the accuracy and AUC of personalized HTM reach 0.8271 and 0.8724, respectively, and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p < 0.001$ </tex-math></inline-formula> . Conclusion: The increase in LML has a beneficial impact on the general model (GM) and personalized model for different model structures. The HTM exhibits better performance in both GM and personalized TL compared to the PCM. Additionally, personalized TL achieves significant improvement when utilizing only positive samples within the same database. However, it is more advantageous to utilize only negative samples when performing cross-database personalized TL. Significance: This article provides guidance for personalized TL in SA detection and provides an HTM-based personalized TL method.
47
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
Focal Loss for Dense Object Detection
Tsung-Yi Lin, Priya Goyal, Ross Girshick et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2018 · 9.6K citations