Evaluating Collaborative Learning Processes Using System-Based Measurement.

TLDR

Research on collaborative work has largely focused on outcome quality, leaving the collaboration process underexplored, yet a fine‑grained analysis of group interaction within learning goals is essential to improve both process and outcomes. This paper proposes a set of measures to evaluate the collaborative learning process by accounting for relationships among tasks, products, and collaboration. The authors develop direct system‑based measures derived from data generated by a collaborative learning system, and propose augmenting them with participants’ perceptions of the process. The study demonstrates that direct system‑based measures can be improved by incorporating participants’ perceptions of the collaboration process.

Abstract

Much of the research on collaborative work focuses on the quality of the group outcome as a measure of success. There is less research on the collaboration process itself, but an understanding of the process should help to improve both the process and the outcomes of collaboration. Understanding and analyzing collaborative learning processes requires a fine-grained analysis of group interaction in the context of learning goals. Taking into account the relationships among tasks, products and collaboration this paper presents a set of measures designed to evaluate the collaborative learning process. We emphaisise: direct system-based measures based on data produced by a collaborative learning system during the collaboration process, and suggest that these measures can be enhanced by also considering participants’ perceptions of the process.