Journal of the American College of Surgeons · 2012 · 52 citations · 22 references
EducationEducational AssessmentInstructionFormative AssessmentOnline TeachingPedagogyEducational Game DesignGame-based LearningOnline AssessmentOnline Course DesignOnline InstructionOnline LearningDigital Game-based LearningOnline Learning CurriculumOnline PedagogySpaced Learning
BACKGROUND: While games are frequently used in resident education, there is little evidence supporting their efficacy. We investigated whether a spaced-education (SE) game can be both a reliable and valid method of assessing residents' knowledge and an effective means of teaching core content. STUDY DESIGN: The SE game consisted of 100 validated multiple-choice questions and explanations on core urology content. Residents were sent 2 questions each day via email. Adaptive game mechanics re-sent the questions in 2 or 6 weeks if answered incorrectly and correctly, respectively. Questions expired if not answered on time (appointment dynamic). Residents retired questions by answering each correctly twice in a row (progression dynamic). Competition was fostered by posting relative performance among residents. Main outcomes measures were baseline scores (percentage of questions answered correctly on initial presentation) and completion scores (percentage of questions retired). RESULTS: Nine hundred thirty-one US and Canadian residents enrolled in the 45-week trial. Cronbach alpha reliability for the SE baseline scores was 0.87. Baseline scores (median 62%, interquartile range [IQR] 17%) correlated with scores on the 2008 American Urological Association in-service examination (ISE08), 2009 American Board of Urology qualifying examination (QE09), and ISE09 (r = 0.76, 0.46, and 0.64, respectively; all p < 0.001). Baseline scores varied by sex, country, medical degree, and year of training (all p ≤ 0.001). Completion scores (median 100%, IQR 2%) correlated with ISE08 and ISE09 scores (r = 0.35, p < 0.001 for both). Seventy-two percent of enrollees (667 of 931) requested to participate in future SE games. CONCLUSIONS: An SE game is a reliable and valid means to assess residents' knowledge and is a well-accepted method by which residents can master core content.
22
Coefficient Alpha and the Internal Structure of Tests
Lee J. Cronbach · Psychometrika · 1951 · 43.2K citations · Full text
Social Sciences, Educational Assessment, Educational Measurement +14
The assessment of clinical skills/competence/performance
George E. Miller · Academic Medicine · 1990 · 4.8K citations
Financial Incentive–Based Approaches for Weight Loss
Kevin G. Volpp, Leslie K. John, Andrea B. Troxel et al. · JAMA · 2008 · 920 citations · Full text