An experimental study on the role of touch in shared virtual environments

TLDR

Investigating virtual environments is an increasingly popular research area for engineers, computer and cognitive scientists, and psychologists, yet little attention has been given to human‑human and human‑machine interactions in shared virtual environments, especially the contribution of haptic communication. The study aims to evaluate how force feedback influences task performance, haptic communication in human‑human interactions, the subjective sense of collaboration, and the effect of user characteristics such as gender, personality, and emotions. The experiment involved two remote participants collaborating on a joint task within a multimodal shared virtual environment that provided force feedback. The findings indicate that integrating touch and force feedback into internet protocols and collaborative teleoperation systems could substantially improve human‑computer interfaces and operations such as hazardous material removal and space station maintenance.

Abstract

Investigating virtual environments has become an increasingly interesting research topic for engineers, computer and cognitive scientists, and psychologists. Although there have been several recent studies focused on the development of multimodal virtual environments (VEs) to study human-machine interactions, less attention has been paid to human-human and human-machine interactions in shared virtual environments (SVEs), and to our knowledge, no attention paid at all to what extent the addition of haptic communication between people would contribute to the shared experience. We have developed a multimodal shared virtual environment and performed a set of experiments with human subjects to study the role of haptic feedback in collaborative tasks and whether haptic communication through force feedback can facilitate a sense of being and collaborating with a remote partner. The study concerns a scenario where two participants at remote sites must cooperate to perform a joint task in an SVE. The goals of the study are (1) to assess the impact of force feedback on task performance, (2) to better understand the role of haptic communication in human-human interactions, (3) to study the impact of touch on the subjective sense of collaborating with a human as reported by the participants based on what they could see and feel, and (4) to investigate if gender, personality, or emotional experiences of users can affect haptic communication in SVEs. The outcomes of this research can have a powerful impact on the development of next-generation human-computer interfaces and network protocols that integrate touch and force feedback technology into the internet, development of protocols and techniques for collaborative teleoperation such as hazardous material removal, space station.