Annals of Otology Rhinology & Laryngology · 2020 · 15 citations · 41 references
Health ProfessionsOtolaryngologySpeech-language PathologyDysphagiaLaryngologyPediatric Speech-language PathologyClinical Swallowing EvaluationClinical Swallowing ExaminationDysphagia AssessmentInstrumental Swallowing AssessmentSwallowing AssessmentSwallowing DisordersDiagnostic Swallowing EvaluationInter-rater ReliabilityInter-rater Reliability AssessmentLaryngeal Adductor Reflex MonitoringLaryngeal Endoscopy FindingsLaryngeal SensationLaryngoscopic ExaminationTouch Sensors
OBJECTIVES: Sensation is an integral component of laryngeal control for breathing, swallowing, and vocalization. Laryngeal sensation is assessed by elicitation of the laryngeal adductor reflex (LAR), a brainstem-mediated adduction of the true vocal folds. During Flexible Endoscopic Evaluations of Swallowing (FEES), the touch method can be used to elicit the LAR to judge laryngeal sensation. Despite the prevalence of this method in clinical practice and research, prior studies have yet to examine inter- and intra-rater reliability. METHODS: Four speech-language pathologists rated 125 randomized video clips for the presence, absence, or inability to rate the LAR. Fifty percent of video clips were re-randomized and re-rated 1 week later. Raters then created guidelines and participated in formal consensus training sessions on a separate set of videos. Ratings were repeated post-training. RESULTS: < .001), though agreement did not reach prespecified acceptable levels (κ ≥ 0.80). Post-training intra-rater reliability ranged from moderate (κ = 0.49) to almost perfect (κ = 0.85). CONCLUSION: Adequate inter-rater reliability was not achieved when rating isolated attempts to elicit the LAR. Acceptable within-rater reliability was observed in some raters 1 week after initial ratings, suggesting that ratings may remain consistent within raters over a short period of time. Limitations and considerations for future research using the touch method are discussed.
41
R: A Language and Environment for Statistical Computing
R Core Team · 2000 · 353K citations · Full text
Natural Sciences, Computer Science, Statistical Computing +10
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Paul A. Harris, Robert Taylor, Robert J. Thielke et al. · Journal of Biomedical Informatics · 2008 · 51.7K citations · Full text
A penetration-aspiration scale
John C. Rosenbek, Jo Anne Robbins, Ellen B. Roecker et al. · Dysphagia · 1996 · 2.8K citations