Veterinary Record · 2015 · 12 citations · 21 references
EducationEducational AssessmentVeterinary Clinical SciencesAnimal AnatomyCompetency-based EducationFormative AssessmentCompetency ValidationCompetency-based TrainingRubric DesignRubric DevelopmentScoring RubricsTest ValidityAbdominal Organ PalpationClinical Skills TrainingContent Validity EvidenceFeline ModelsInternal Consistency ReliabilityInternal Structure EvidenceSkills PracticeVeterinary Palpation Training
Simulation in veterinary education enables clinical skills practice without animal use. A feline abdominal palpation model was created that allows practice in this fractious species. This study assessed the model and rubric using a validation framework of content evidence, internal structure and relationship with level of training. Content Evidence: Veterinarians accepted this model as a helpful training tool for students (median=4 on five-point Likert scale). Internal Structure Evidence: G-coefficients were low for first- and second-year students (0.28 and 0.23), but were acceptable for veterinarians (0.61). Internal consistency values (0.24, 0.42 and 0.67) followed a similar pattern. Thus, scores were more reliable for veterinarians than for the students. Evidence of Relationship with Level of Training: Although level of training impacted reliability, its effect on performance scores was inconsistent. Analysis of variance (ANOVA) identified no differences among the groups of students and veterinarians. However, effect size between first- and third-year students was medium to large (0.62). Effect sizes between the veterinarians and student groups were small. Although the model and rubric appeared valid for experts, modifications would be necessary to generate reliable scores for students. These results allow greater understanding of the needs of students utilising a low-fidelity model.
21
Statistical Power Analysis for the Behavioral Sciences
Keith E. Muller, Jacob Cohen · Technometrics · 1989 · 83.9K citations