How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study

Fadel M. Megahed, Ying‐Ju Chen, Joshua A. Ferris, Sven Knoth, L. Allison Jones‐Farmer

Quality Engineering · 2023 · 170 citations · 35 references

Concepts

TL;DR

Generative AI models such as ChatGPT could transform SPC practice, learning, and research, yet their early development stage makes them prone to misuse and misunderstanding. The study reviews Generative AI development and examines ChatGPT’s capacity to supply code, explain concepts, and generate SPC‑related knowledge. The authors evaluated ChatGPT by issuing structured prompts to assess its code generation, concept explanation, and knowledge creation for SPC, thereby highlighting its strengths and limitations. ChatGPT excels at structured tasks such as code translation and explaining familiar concepts but falters on nuanced terms and code creation from scratch; while it can boost efficiency for practitioners, educators, and researchers, its outputs can be misleading, underscoring the need for validation alongside other methods.

Abstract

Generative Artificial Intelligence (AI) models such as OpenAI's ChatGPT have the potential to revolutionize Statistical Process Control (SPC) practice, learning, and research. However, these tools are in the early stages of development and can be easily misused or misunderstood. In this paper, we give an overview of the development of Generative AI. Specifically, we explore ChatGPT's ability to provide code, explain basic concepts, and create knowledge related to SPC practice, learning, and research. By investigating responses to structured prompts, we highlight the benefits and limitations of the results. Our study indicates that the current version of ChatGPT performs well for structured tasks, such as translating code from one language to another and explaining well-known concepts but struggles with more nuanced tasks, such as explaining less widely known terms and creating code from scratch. We find that using new AI tools may help practitioners, educators, and researchers to be more efficient and productive. However, in their current stages of development, some results are misleading and wrong. Overall, the use of generative AI models in SPC must be properly validated and used in conjunction with other methods to ensure accurate results.

References

35