2023 · 83 citations · 5 references
ComputingComputer ScienceEducational AssessmentNatural Language ProcessingProgramming LanguagesSoftware EngineeringEducational Software DesignEducational Software EvaluationLanguage ModelingNatural Language GenerationNatural Language Processing In EducationNatural Language UnderstandingCode ComprehensionCoding InstructionNatural Language Processing EducationProgram ComprehensionProgram-to-text GenerationReadability
In this study, we assess the efficacy of employing the ChatGPT language model to generate solutions for coding exercises within an undergraduate Java programming course. ChatGPT, a large-scale, deep learning-driven natural language processing model, is capable of producing programming code based on textual input. Our evaluation involves analyzing ChatGPT-generated solutions for 80 diverse programming exercises and comparing them to the correct solutions. Our findings indicate that ChatGPT accurately generates Java programming solutions, which are characterized by high readability and well-structured organization. Additionally, the model can produce alternative, memory-efficient solutions. However, as a natural language processing model, ChatGPT struggles with coding exercises containing non-textual descriptions or class files, leading to invalid solutions. In conclusion, ChatGPT holds potential as a valuable tool for students seeking to overcome programming challenges and explore alternative approaches to solving coding problems. By understanding its limitations, educators can design coding exercises that minimize the potential for misuse as a cheating aid while maintaining their validity as assessment tools.
5
Toward automatic program synthesis
Zohar Manna, Richard Waldinger · Communications of the ACM · 1971 · 297 citations · Full text
A Pedagogical Analysis of Online Coding Tutorials
Ada S. Kim, Amy J. Ko · 2017 · 99 citations · Full text
How Teachers Would Help Students to Improve Their Code
Hieke Keuning, Bastiaan Heeren, Johan Jeuring · 2019 · 44 citations · Full text
Education, Instruction, Teaching +13