The Journal of Physician Assistant Education · 2011 · 23 citations · 7 references
EducationBehavioral SciencesPsychologyFormative AssessmentIndividual DifferencesPsychometricsBehavioral AssessmentClinical InterviewingLatent Trait ModelingPsychological AssessmentHomogeneous GroupsInterview Rating ScalesInterviewer-administered QuestionnairesPast BehaviorRasch Rating Scale ModelRating Scale AnalysisTest Score Distributions
PURPOSE: The interview remains a widely used tool in health professions program admissions. The purpose of this study was to compare the use of a behavioral interview format with the multiple mini-interview format in measuring desired noncognitive behaviors. METHODS: This dual cohort, observational, comparative study used a polytomous rating-scale model to analyze the results from two homogeneous groups of physician assistant (PA) program applicants (total N = 176). One group (n = 93) participated in two 20-minute behavioral interviews conducted by two raters per interviewee. The behavioral format included questions related to past behaviors and performance as a way to identify latent professionalism characteristics. The second group (n = 83) completed ten separate 7-minute stations with one rater per station. Each of the mini-stations assigned a specific topic and/or task to be completed. The score distributions related to applicant performance and station difficulty were plotted using Rasch analysis software. RESULTS: The behavioral interview format and multiple mini-interview had similar model fit. The behavioral interview did not adequately measure differences in applicant characteristics. In contrast, the multiple mini-interview measured more variation in noncognitive traits and identified better matching of station difficulty and person ability. CONCLUSIONS: In this study the multiple mini-interview format was a more reliable admissions tool in detecting latent professionalism attributes among PA program applicants. The multiple mini-interview format appeared to measure professional potential and organizational fit better than the behavioral interview format. A larger study across several programs may provide additional support for these findings.
7
An admissions OSCE: the multiple mini‐interview
Kevin W. Eva, Jack Rosenfeld, Harold Reiter et al. · Medical Education · 2004 · 626 citations
Education, Educational Assessment, Educational Measurement +12
Rasch fit statistics and sample size considerations for polytomous data
Adam B. Smith, Robert Rush, Lesley Fallowfield et al. · BMC Medical Research Methodology · 2008 · 377 citations · Full text