Proceedings of the VLDB Endowment · 2021 · 18 citations · 16 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingDeep LearningReinforcement LearningRepresentation LearningAutomated Machine LearningAutomlAutoml For Large-scale DataData AugmentationData Repository ManagementDeep Reinforcement LearningTrainingWeak Supervision
Deep learning (DL) has widespread applications and has revolutionized many industries. Although automated machine learning (AutoML) can help us away from coding for DL models, the acquisition of lots of high-quality data for model training remains a main bottleneck for many DL projects, simply because it requires high human cost. Despite many works on weak supervision ( i.e. , adding weak labels to seen data) and data augmentation ( i.e. , generating more data based on seen data), automatically acquiring training data, via smartly searching a pool of training data collected from open ML benchmarks and data markets, is not explored. In this demonstration, we demonstrate a new system, automatic data acquisition (AutoData), which automatically searches training data from a heterogeneous data repository and interacts with AutoML. It faces two main challenges. (1) How to search high-quality data from a large repository for a given DL task? (2) How does AutoData interact with AutoML to guide the search? To address these challenges, we propose a reinforcement learning (RL)-based framework in AutoData to guide the iterative search process. AutoData encodes current training data and feedbacks of AutoML, learns a policy to search fresh data, and trains in iterations. We demonstrate with two real-life scenarios, image classification and relational data prediction, showing that AutoData can select high-quality data to improve the model.
16
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Understanding Black-box Predictions via Influence Functions
Pang Wei Koh, Percy Liang · arXiv (Cornell University) · 2017 · 1.2K citations · Full text
Alexander Ratner, Stephen H. Bach, Henry R. Ehrenberg et al. · Proceedings of the VLDB Endowment · 2017 · 761 citations · Full text
Snorkel: rapid training data creation with weak supervision.