PLOS Digital Health · 2024 · 27 citations · 32 references
EducationBehavioral SciencesPsychologyMetacognitionNonverbal CommunicationSport PsychologyBehavioral SkillsCoaching PsychologyConversation AnalysisHealth CoachingLanguage ModelingBehavioral CoachingLarge Language ModelsMotivation In Coaching ContextsPhysical Activity CoachingRe-rankingSustained Behavior ChangeTask-oriented DialogueTask-oriented Dialogue Systems
Large language models (LLMs) have shown promise for task-oriented dialogue across a range of domains. The use of LLMs in health and fitness coaching is under-explored. Behavior science frameworks such as COM-B, which conceptualizes behavior change in terms of capability (C), Opportunity (O) and Motivation (M), can be used to architect coaching interventions in a way that promotes sustained change. Here we aim to incorporate behavior science principles into an LLM using two knowledge infusion techniques: coach message priming (where exemplar coach responses are provided as context to the LLM), and dialogue re-ranking (where the COM-B category of the LLM output is matched to the inferred user need). Simulated conversations were conducted between the primed or unprimed LLM and a member of the research team, and then evaluated by 8 human raters. Ratings for the primed conversations were significantly higher in terms of empathy and actionability. The same raters also compared a single response generated by the unprimed, primed and re-ranked models, finding a significant uplift in actionability and empathy from the re-ranking technique. This is a proof of concept of how behavior science frameworks can be infused into automated conversational agents for a more principled coaching experience.
32
Regina Guthold, Gretchen A Stevens, Leanne M Riley et al. · The Lancet Global Health · 2018 · 4.9K citations · Full text
Public Health, Health Sciences, Population Health Sciences +15
Large language models encode clinical knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu et al. · Nature · 2023 · 3.2K citations · Full text
Computing, Health Informatics, Computational Linguistics +16
Transfer Learning in Natural Language Processing
Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta et al. · 2019 · 579 citations · Full text