Mathematics · 2025 · 11 citations · 87 references
ComputingComputer ScienceArtificial IntelligenceComputer VisionMachine LearningDeep LearningOverfittingRepresentation LearningUnderfittingCross-domain GeneralizationData AugmentationDomain GeneralizationModel Performance AnalysisModel Performance EvaluationModel Robustness AnalysisModel Robustness AssessmentRobustness
Domain generalization (DG) has become a pivotal research area in machine learning, focusing on equipping models with the ability to generalize effectively to unseen test domains that differ from the training distribution. This capability is crucial, as real-world data frequently exhibit domain shifts that violate the assumption of independent and identically distributed (i.i.d.) data, resulting in significant declines in model performance. Among the various strategies to address domain generalization, data augmentation has garnered substantial attention as an effective approach for mitigating domain shifts and improving model robustness. In this survey, we examine the role of data augmentation in domain generalization, offering a comprehensive overview of its methods, applications, and challenges. We present a detailed taxonomy of data augmentation techniques, categorized along three dimensions: scope, nature, and training dependency. Additionally, we provide a comparative analysis of key methods, highlighting their strengths and limitations. Finally, we explore the domain-specific applications of data augmentation and analyze their effectiveness in enhancing generalization across various real-world tasks, including computer vision, NLP, speech, and robotics. We conclude by examining key challenges—such as computational cost and augmentation overfitting—and outline promising research directions, with a focus on advancing cross-modal augmentation techniques and developing standardized evaluation benchmarks.
87
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, Taesung Park, Phillip Isola et al. · 2017 · 21.9K citations · Full text
Generative adversarial networks
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza et al. · Communications of the ACM · 2020 · 13.6K citations · Full text
A survey on Image Data Augmentation for Deep Learning
Connor Shorten, Taghi M. Khoshgoftaar · Journal Of Big Data · 2019 · 12.4K citations · Full text