IEEE Transactions on Big Data · 2025 · 30 citations · 111 references
ComputingComputer ScienceInformation TechnologyDistributed SystemsMachine LearningPrivacy EngineeringData PrivacyDifferential PrivacyDistributed LearningFederated LearningFederated Learning PrivacyFederated Training ArchitectureHeterogeneityHeterogeneous EnvironmentsState-of-the-art ReviewTraining
In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational capabilities, and communication resources. This diversity leads to significant heterogeneity, which increases the complexity of model training. In this paper, we first outline the basic concepts of heterogeneous FL and summarize the research challenges in FL in terms of five aspects: data, model, task, device and communication. In addition, we explore how existing state-of-the-art approaches cope with the heterogeneity of FL, and categorize and review these approaches at three different levels: data-level, model-level, and architecture-level. Subsequently, the paper extensively discusses privacy-preserving strategies in heterogeneous FL environments. Finally, the paper discusses current open issues and directions for future research, aiming to promote the further development of heterogeneous FL.
111
Adi Shamir · Communications of the ACM · 1979 · 13.5K citations · Full text
Bitcoin: A Peer-to-Peer Electronic Cash System
Spongebob Squarepants · SSRN Electronic Journal · 2008 · 11.2K citations · Full text
Deep Learning with Differential Privacy
Martı́n Abadi, Andy Chu, Ian Goodfellow et al. · 2016 · 5.9K citations · Full text
Practical Secure Aggregation for Privacy-Preserving Machine Learning
Keith Bonawitz, Vladimir Ivanov, Ben Kreuter et al. · 2017 · 3.4K citations