2018 · 55 citations · 13 references
ComputingComputer ScienceCybersecurityComputer SecurityMarkov Decision ProcessesPenetration TestingExploitability AssessmentExploration-exploitation TradeoffPolicy LearningReinforcement LearningAutomated Penetration TestingMarkov Decision ModelsPenetration Testing MethodologyPomdp Solvers
Penetration testing (PT) is an active method for assessing and evaluating the security of digital assets by planning, generating and executing all possible attacks that can exploit existing vulnerabilities. Current PT practice is becoming repetitive, complex and resource consuming despite the use of automated tools. The goal of this paper is to design an intelligent PT approach using reinforcement learning (RL) that will allow regular and systematic testing, saving human resources. The system is modelled as a partially observed Markov decision process (POMDP), and tested using an external POMDP-solver with different algorithms. Although this paper is limited to only the planning phase and not the entire PT process, the results support the hypothesis that reinforcement learning can enhance PT beyond the capabilities of any human expert in terms of accurate and reliable outputs.
13
PEGASUS: A Policy Search Method for Large MDPs and POMDPs
Andrew Y. Ng, Michael I. Jordan · arXiv (Cornell University) · 2013 · 369 citations · Full text
AI^2: Training a Big Data Machine to Defend
Kalyan Veeramachaneni, Ignacio Arnaldo, Vamsi Korrapati et al. · 2016 · 240 citations
Solving POMDPs by Searching the Space of Finite Policies
Nicolas Meuleau, Kee-Eung Kim, Leslie Pack Kaelbling et al. · arXiv (Cornell University) · 2013 · 148 citations · Full text
Intelligent, automated red team emulation
Andy Applebaum, D. Miller, Blake E. Strom et al. · 2016 · 96 citations