The Ultrasound Journal · 2021 · 14 citations · 24 references
MedicineCardiologyMedical EducationCardiothoracic RadiologyUltrasonographyUltrasoundCardiac AssessmentCardiac UltrasonographyCardiac UltrasoundCardiovascular AssessmentCompetency ValidationPoint-of-care UltrasoundConstruct ValidityInter-rater AgreementInter-rater ReliabilityInter-rater Reliability AssessmentInternal Consistency ReliabilityPoint-of-care Cardiac UltrasoundPoint-of-care Ultrasound Competency AssessmentSimulated Environments
Abstract Background Point-of-care ultrasound (POCUS) has been recognized as an essential skill across medicine. However, a lack of reliable and streamlined POCUS assessment tools with demonstrated validity remains a significant barrier to widespread clinical integration. The ultrasound competency assessment tool (UCAT) was derived to be a simple, entrustment-based competency assessment tool applicable to multiple POCUS applications. When used to assess a FAST, the UCAT demonstrated high internal consistency and moderate-to-excellent inter-rater reliability. The objective of this study was to validate the UCAT for assessment of a four-view transthoracic cardiac POCUS. Results Twenty-two trainees performed a four-view transthoracic cardiac POCUS in a simulated environment while being assessed by two observers. When used to assess a four-view cardiac POCUS the UCAT retained its high internal consistency ( $$\alpha =0.90)$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mi>α</mml:mi> <mml:mo>=</mml:mo> <mml:mn>0.90</mml:mn> <mml:mo>)</mml:mo> </mml:mrow> </mml:math> and moderate-to-excellent inter-rater reliability (ICCs = 0.61–0.91; p ’s ≤ 0.01) across all domains. The regression analysis suggestion that level of training, previous number of focused cardiac ultrasound, previous number of total scans, self-rated entrustment, and intent to pursue certification statistically significantly predicted UCAT entrustment scores [F (5,16) = 4.06, p = 0.01; R 2 = 0.56]. Conclusion This study confirms the UCAT is a valid assessment tool for four-view transthoracic cardiac POCUS. The findings from this work and previous studies on the UCAT demonstrate the utility and flexibility of the UCAT tool across multiple POCUS applications and present a promising way forward for POCUS competency assessment.
24
Core principles of assessment in competency-based medical education
Jocelyn Lockyer, Carol Carraccio, Ming‐Ka Chan et al. · Medical Teacher · 2017 · 477 citations
The Ottawa Surgical Competency Operating Room Evaluation (O-SCORE)
Wade Gofton, Nancy Dudek, Timothy J. Wood et al. · Academic Medicine · 2012 · 314 citations