Building implementation capacity (BIC): a longitudinal mixed methods evaluation of a team intervention

Abstract

BACKGROUND: Managers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers. METHODS: A non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support. RESULTS: Overall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level). CONCLUSIONS: The intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.