2024 · 16 citations · 12 references
ComputingComputer ScienceMachine LearningNatural Language ProcessingSoftware EngineeringAutomated Feedback GenerationSupervised LearningAutomated Comment GenerationAutomated Machine LearningCode ReviewCode Review WorkflowsComment ReviewReviewer CommentsSoftware Process AutomationSource Code Review
Code reviews are a critical part of the software development process, taking a significant amount of the code authors' and the code reviewers' time. As part of this process, the reviewer inspects the proposed code and asks the author for code changes through comments written in natural language. At Google, we see millions of reviewer comments per year, and authors require an average of ~60 minutes active shepherding time between sending changes for review and finally submitting the change. In our measurements, the required active work time that the code author must devote to address reviewer comments grows almost linearly with the number of comments. However, with machine learning (ML), we have an opportunity to automate and streamline the code-review process, e.g., by proposing code changes based on a comment's text.
12
Evaluating Large Language Models Trained on Code
arXiv (Cornell University) · 2021 · 1.4K citations · Full text
Yue Wang, Weishi Wang, Shafiq Joty et al. · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · 2021 · 1.3K citations · Full text