Assessment of a training project of English as a media of instruction(EMI) using Kirkpatrick model

Abstract

BACKGROUND: English as a Media of Instruction (EMI) teacher development project is based upon the framework for teacher Continuing Professional Development (CPD) and aims to effectively improve both the confidence and overall capacity of EMI lecturers. Kunming Medical University(KMU) conducted the EMI training project to improve teachers' competence for MBBS education. This study aimed to assess teachers' changes following the implementation of this training project, via the Kirkpatrick evaluation model. METHODS: A total of trainees (n = 84) were invited as the research objects. The effects of the EMI training project implemented in KMU were evaluated in terms of the reaction, learning, and behavior dimensions based on the Kirkpatrick model. The self-administered online anonymous questionnaires and observations of participants' EMI lectures were administered to all participants to collect the data. Furthermore, to understand participants' perceptions of the management and trainers of the training project, some open-ended questions were required to answer. RESULTS: Based on 1-3 level of the Kirkpatrick model, all participants were highly satisfied with the EMI training implementation on the reaction level, and expressed positive comments about the management of the training and trainers. On the learning level, participants' scores on awareness of EMI teaching techniques increased significantly(t = 7.122, P < 0.001)with the training process. Concerning the behavior level, the participant's confidence as an EMI instructor increased dramatically at end of the whole training(p < 0.001). Moreover, trainees had applied some EMI skills in class and would like to make some commitment to implement learner-centered learning, to do more practice on EMI techniques. CONCLUSION: The findings of this study confirm that EMI training has an effective impact on the competence and confidence of participants as EMI instructors at levels 1-3 of the Kirkpatrick evaluation model. This training may be a potentially beneficial effect on the teaching quality of MBBS education.