2024 · 20 citations · 10 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingAnnotationDeep LearningGenerative ModelingLanguage ModelingLanguage ModelsPlagiarism DetectionAnnotation Scheme DevelopmentEssay Plagiarism DetectionHuman DetectionLarge Language ModelsMachine Learning Approaches To Plagiarism DetectionMachine-generated Text DetectionResearch With Human SubjectsWritten Text
A large language model (LLM) is a trained deep-learning model that understands and generates text in a human-like fashion. Due to the significant advancements of LLM, it becomes a challenging task to distinguish human-written content from artificial intelligence (AI) generated content. In this work, we leverage the machine learning (ML) models to reliably identify whether an essay is authored by a human being or by an LLM. Concerns about LLMs replacing human tasks, especially in education persist. However, optimism remains for their potential as tools to enhance writing skills. An academic worry is LLMs facilitating plagiarism due to their extensive training in text and code datasets. Using diverse texts and unknown generative models, we replicate typical scenarios to encourage feature learning across models. In a study involving human subjects, we demonstrate that the annotation scheme offered by generative textual likelihood ratio (GLTR) enhances the human detection rate of fake text from 74% to 99% without requiring any previous training. GLTR is open source and publicly deployed, already finding widespread use in detecting generated outputs.
10
GPT-3: Its Nature, Scope, Limits, and Consequences
Luciano Floridi, Massimo Chiriatti · Minds and Machines · 2020 · 2.2K citations · Full text
ELI5: Long Form Question Answering
Angela Fan, Yacine Jernite, Ethan Perez et al. · 2019 · 304 citations · Full text
How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection
Biyang Guo, Xin Zhang, Ziyuan Wang et al. · arXiv (Cornell University) · 2023 · 293 citations · Full text