Frontiers in Digital Health · 2023 · 158 citations · 12 references
ComputingComputer ScienceHealth InformaticsArtificial IntelligenceClinical Decision SupportNatural Language ProcessingConversational InterfacesDialogue SystemsLanguage ModelingNatural Language GenerationQuestion AnsweringText GenerationChatbot SystemsChatbotsClinical Question AnsweringClinical Text GenerationConversational AgentsLarge Language ModelsQuestion Answering In HealthTransformer Language Models
As large language models (LLMs) expand and become more advanced, so do the natural language processing capabilities of conversational AI, or "chatbots". OpenAI's recent release, ChatGPT, uses a transformer-based model to enable human-like text generation and question-answering on general domain knowledge, while a healthcare-specific Large Language Model (LLM) such as GatorTron has focused on the real-world healthcare domain knowledge. As LLMs advance to achieve near human-level performances on medical question and answering benchmarks, it is probable that Conversational AI will soon be developed for use in healthcare. In this article we discuss the potential and compare the performance of two different approaches to generative pretrained transformers-ChatGPT, the most widely used general conversational LLM, and Foresight, a GPT (generative pretrained transformer) based model focused on modelling patients and disorders. The comparison is conducted on the task of forecasting relevant diagnoses based on clinical vignettes. We also discuss important considerations and limitations of transformer-based chatbots for clinical use.
12
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Large language models encode clinical knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu et al. · Nature · 2023 · 3.2K citations · Full text
Computing, Health Informatics, Computational Linguistics +16
BEHRT: Transformer for Electronic Health Records
Yikuan Li, Shishir Rao, José Roberto Ayala Solares et al. · Scientific Reports · 2020 · 528 citations · Full text