Galvanic skin response (GSR) as an index of cognitive load

TLDR

Multimodal user interfaces enable speech and gesture control, potentially reducing cognitive load during complex tasks. The study aims to use Galvanic Skin Response to objectively assess user cognitive load. GSR was recorded while users interacted with both unimodal and multimodal interface versions. GSR increased with higher task load, was lower for multimodal interfaces, and its peaks aligned with sub‑task events, confirming GSR as a fine‑grained real‑time indicator of cognitive load.

Abstract

Multimodal user interfaces (MMUI) allow users to control computers using speech and gesture, and have the potential to minimise users. experienced cognitive load, especially when performing complex tasks. In this paper, we describe our attempt to use a physiological measure, namely Galvanic Skin Response (GSR), to objectively evaluate users. stress and arousal levels while using unimodal and multimodal versions of the same interface. Preliminary results show that users. GSR readings significantly increase when task cognitive load level increases. Moreover, users. GSR readings are found to be lower when using a multimodal interface, instead of a unimodal interface. Cross-examination of GSR data with multimodal data annotation showed promising results in explaining the peaks in the GSR data, which are found to correlate with sub-task user events. This interesting result verifies that GSR can be used to serve as an objective indicator of user cognitive load level in real time, with a very fine granularity.