The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers

TLDR

Appraising the quality of studies in systematic reviews that combine qualitative and quantitative evidence is challenging. The paper presents enhancements to the Mixed Methods Appraisal Tool (MMAT) to address these appraisal challenges. The MMAT was developed in 2006, refined through pilot testing and reliability studies, and revised in 2018 using literature reviews and an e‑Delphi study; it evaluates qualitative, randomized, nonrandomized, descriptive, and mixed‑methods studies with five core criteria per design. The MMAT uniquely appraises diverse study designs and, by focusing on core criteria, offers a more efficient appraisal process.

Abstract

INTRODUCTION: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods Appraisal Tool (MMAT). The aim of this paper is to present the enhance ments made to the MMAT. DEVELOPMENT: The MMAT was initially developed in 2006 based on a literature review on systematic reviews combining qualitative and quantitative evidence. It was subject to pilot and interrater reliability testing. A revised version of the MMAT was developed in 2018 based on the results from usefulness testing, a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts to identify core criteria. TOOL DESCRIPTION: The MMAT assesses the quality of qualitative, quantitative, and mixed methods studies. It focuses on methodological criteria and includes five core quality criteria for each of the following five categories of study designs: (a) qualitative, (b) randomized controlled, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods. CONCLUSION: The MMAT is a unique tool that can be used to appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more efficient appraisal.