2023 · 12 citations · 10 references
ComputingComputer ScienceCybersecurityArtificial IntelligenceComputer SecurityNatural Language ProcessingAdversary TechniquesBotnet AnalysisLarge Language ModelsPromptingSecurity Of Ai Systems
The security vulnerabilities inherent in large language models (LLMs), such as OpenAI's ChatGPT-3.5 and ChatGPT -4, Bing Bot, and Google's Bard, are explored in this paper. The focus is on the susceptibility of these models to malicious prompting and the potential for generating unethical content. An investigation is conducted into the responses these models provide when tasked with completing a movie script involving a character disseminating information about murder, weapons, and drugs. The analysis reveals that, despite the presence of filters designed to prevent the generation of unethical or harmful content, these models can be manipulated through malicious prompts to produce inappropriate and even illegal responses. This discovery underscores the urgent need for a comprehensive understanding of these vulnerabilities, as well as the development of effective measures to enhance the security and reliability of LLMs. This paper offers valuable insights into the security vulnerabilities that arise when these models are prompted to generate malicious content.
10
On the Dangers of Stochastic Parrots
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major et al. · 2021 · 5.6K citations · Full text
Computing, Computer Science, English +12
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Thomas Wolf, Lysandre Debut, Victor Sanh et al. · arXiv (Cornell University) · 2019 · 3.1K citations · Full text
Harry E. Chandler, William Giesecke · IEEE Transactions on Professional Communication · 1983 · 2.7K citations
Arts, Design, Documentation +10
LaMDA: Language Models for Dialog Applications
Romal Thoppilan, Daniel De Freitas, Jamie Hall et al. · arXiv (Cornell University) · 2022 · 706 citations · Full text