Assessment of knowledge retention and the value of proctored ultrasound exams after the introduction of an emergency ultrasound curriculum

TLDR

Optimal training for bedside ultrasound proficiency is unknown, and the value of proctored training has never been quantified. The study compares training regimens for attending physicians and first‑year residents to assess knowledge retention six months after an introductory ultrasound course. The study assessed 18 physicians and 12 interns with a standardized image‑based test before and six months after an introductory course, and randomized the interns to receive additional proctored hands‑on instruction or no instruction to evaluate its effect. Residents who received proctored ultrasound training improved their test scores by a median of 3.0 points more than those who did not, and overall knowledge retention remained significant six months after the introductory course, suggesting that proctored training enhances retention.

Abstract

Optimal training required for proficiency in bedside ultrasound is unknown. In addition, the value of proctored training is often assumed but has never been quantified.To compare different training regimens for both attending physicians and first year residents (interns), a prospective study was undertaken to assess knowledge retention six months after an introductory ultrasound course. Eighteen emergency physicians and twelve emergency medicine interns were assessed before and 6 months after an introductory ultrasound course using a standardized, image-based ultrasound test. In addition, the twelve emergency medicine interns were randomized to a group which received additional proctored ultrasound hands-on instruction from qualified faculty or to a control group with no hands-on instruction to determine if proctored exam training impacts ultrasound knowledge. Paired and unpaired estimates of the median shift in test scores between groups were made with the Hodges-Lehmann extension of the Wilcoxon-Mann-Whitney test.Six months after the introductory course, test scores (out of a 24 point test) were a median of 2.0 (95% CI 1.0 to 3.0) points higher for residents in the control group, 5.0 (95% CI 3.0 to 6.0) points higher for residents in the proctored group, and 2.5 (95% CI 1.0 to 4.0) points higher for the faculty group. Residents randomized to undergo proctored ultrasound examinations exhibited a higher score improvement than their cohorts who were not with a median difference of 3.0 (95% CI 1.0 to 5.0) points.We conclude that significant improvement in knowledge persists six months after a standard introductory ultrasound course, and incorporating proctored ultrasound training into an emergency ultrasound curriculum may yield even higher knowledge retention.