A Comparative Study of Online Remote Proctored Versus Onsite Proctored High-stakes Exams

Abstract

Advances in technology have spurred innovations in secure assessment delivery. One such innovation, remote online proctoring, has become increasingly sophisticated and is gaining wider consideration for high-stakes testing. However, there is an absence of published research examining remote online proctoring and its effects on test scores and the examine experience. This paper describes a quasi-experimental field study carried out with three professional licensing examinations administered concurrently at different test sites that offered either onsite proctoring in testing centers or remote online proctoring in computer kiosks where the testing was proctored via Internet-connected video communication and surveillance. Results using both classical test theory and item response theory methods revealed substantial reliability and a strong degree of measurement equivalence across proctoring conditions. Candidates revealed slightly less positive reactions to some of the remote proctored testing conditions, but reactions were positive overall and had virtually no relation to test performance. Overall, the results of this study support the equivalence of kiosk-based remote online proctored exams and exams proctored onsite in test centers.