Proceedings of the 17th International Conference on Availability, Reliability and Security · 2022 · 21 citations · 8 references
ComputingComputer ScienceCybersecurityFeature EngineeringMachine LearningVulnerability AnalysisExplainable Machine LearningSoftware Vulnerability DiscoveryVulnerability AssessmentAutomated Vulnerability DetectionExplainabilityMachine Learning For Vulnerability DetectionModel DebuggingModel-based DebuggingSpurious CorrelationVulnerability DetectionVulnerability Discovery
Machine learning has been successfully used for increasingly complex and critical tasks, achieving high performance and efficiency that would not be possible for human operators. Unfortunately, recent studies have shown that, despite its power, this technology tends to learn spurious correlations from data, making it weak and susceptible to manipulation. Explainability techniques are often used to identify the most relevant features contributing to the decision. However, this is often done by taking examples one by one and trying to show the problem locally. To mitigate this issue, we propose in this paper a systematic method to leverage explainability techniques and build on their results to highlight problems in the model design and training. With an empirical analysis on the Devign dataset, we validate the proposed methodology with a CodeBERT model trained for vulnerability discovery, showing that, despite its impressive performances, spurious correlations consistently steer its decision.
8
Marco Túlio Ribeiro, Sameer Singh, Carlos Guestrin · 2016 · 15.2K citations
Wenbo Guo, Dongliang Mu, Jun Xu et al. · 2018 · 289 citations · Full text
GraphCodeBERT: Pre-training Code Representations with Data Flow
Daya Guo, Shuo Ren, Shuai Lu et al. · arXiv (Cornell University) · 2020 · 155 citations · Full text