2023 · 21 citations · 39 references
ComputingComputer ScienceKnowledge RepresentationMachine LearningNatural Language ProcessingDeep LearningDomain AnalysisDomain ModelingGenerative ModelingRepresentation LearningCross EntropyCross-domain GeneralizationDomain AdaptationDomain GeneralizationEntropy MaximizationEntropy MinimizationExpansion
Single domain generalization challenges model generalizability to unseen target domains when only one source domain is provided for training. To tackle this problem, domain expansion is adopted to learn domain-invariant information by exposing the model to more domain variations, which is still under-explored in previous work. In this paper, we propose a new and simplified objective for learning the desirable domain expansions by generating unconfident samples through the combination of entropy maximization and cross-entropy minimization. We further devise a novel framework that trains a pair of generators from different views by switching the guidance from the dual classifiers. In this way, the resulting method called Simple Domain Expansion (SimDE) can learn diverse domain expansions effectively and efficiently. Extensive experiments on prevalent single domain generalization benchmarks demonstrate the superiority of our method by offering improved results over the state-of-the-arts methods.
39
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
Karl R. Weiss, Taghi M. Khoshgoftaar, Dingding Wang · Journal Of Big Data · 2016 · 6.2K citations · Full text
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever et al. · arXiv (Cornell University) · 2013 · 5.7K citations · Full text