2023 · 17 citations · 33 references
ComputingComputer ScienceData ScienceData EngineeringData MiningMachine LearningContinual LearningData SecurityDeep LearningMachine Learning For Big DataNeural NetworksOptimization For Machine LearningArchitecture SearchData Privacy ProtectionInformation DensityNeural Architecture SearchPrivacy-preserving LearningPrivacy-preserving Machine LearningPrivacy-preserving Model TrainingPrivate Machine Learning
Dataset distillation is attracting more attention in machine learning as training sets continue to grow and the cost of training state-of-the-art models becomes increasingly high. By synthesizing datasets with high information density, dataset distillation offers a range of potential applications, including support for continual learning, neural architecture search, and privacy protection. Despite recent advances, we lack a holistic understanding of the approaches and applications. Our survey aims to bridge this gap by first proposing a taxonomy of dataset distillation, characterizing existing approaches, and then systematically reviewing the data modalities, and related applications. In addition, we summarize the challenges and discuss future directions for this field of research.
33
Membership Inference Attacks Against Machine Learning Models
Reza Shokri, Marco Stronati, Congzheng Song et al. · 2017 · 4.2K citations
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, R. Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 2.9K citations