arXiv (Cornell University) · 2017 · 25 citations · 16 references
ComputingComputer ScienceComputer SecurityComputer VisionMachine LearningAdversary TechniquesDeep LearningNeural NetworksRepresentation LearningAdversarial ExamplesAdversarial RobustnessMachine-learning AttacksTargeted Attacks
Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the attacker is limited to query access without access to gradients. Previous methods --- substitute networks and coordinate-based finite-difference methods --- are either unreliable or query-inefficient, making these methods impractical for certain problems. We introduce a new method for reliably generating adversarial examples under more restricted, practical black-box threat models. First, we apply natural evolution strategies to perform black-box attacks using two to three orders of magnitude fewer queries than previous methods. Second, we introduce a new algorithm to perform targeted adversarial attacks in the partial-information setting, where the attacker only has access to a limited number of target classes. Using these techniques, we successfully perform the first targeted adversarial attack against a commercially deployed machine learning system, the Google Cloud Vision API, in the partial information setting.
16
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever et al. · arXiv (Cornell University) · 2013 · 5.7K citations · Full text
Practical Black-Box Attacks against Machine Learning
Nicolas Papernot, Patrick McDaniel, Ian Goodfellow et al. · 2017 · 3.5K citations
Adversarial Examples in the Physical World
Alexey Kurakin, Ian Goodfellow, Samy Bengio · 2018 · 1.9K citations · Full text
Pin‐Yu Chen, Huan Zhang, Yash Sharma et al. · 2017 · 1.7K citations · Full text
Towards Deep Learning Models Resistant to Adversarial Attacks
Aleksander Mądry, Aleksandar Makelov, Ludwig Schmidt et al. · arXiv (Cornell University) · 2017 · 1.5K citations · Full text