Nature Communications · 2022 · 506 citations · 67 references
EngineeringMechanical EngineeringMechatronics EngineeringMicroelectromechanical SystemsSensorsVirtual Reality DesignAugmented RealityHapticsMultimodal InteractionTactile PerceptionTactile SensingVirtual RealityHaptic FeedbackHaptic SensingMultimodal SensingMultimodal Tactile SensingPyroelectric SensorsSomatosensory FeedbackVirtual Reality PlatformsWearable Devices
Virtual reality advances enable wearable devices that provide somatosensory sensation, enhancing perception and feedback in metaverse environments. The study proposes augmented tactile‑perception and haptic‑feedback rings that deliver multimodal sensing and feedback. The ring integrates triboelectric and pyroelectric sensors with vibrators and nichrome heaters, all powered by a low‑power custom wireless platform. Voltage‑integrated processing yields high‑resolution finger motion tracking and improves gesture/object recognition, while multimodal sensing and feedback create an interactive metaverse platform that delivers face‑to‑face immersive social experiences.
Abstract Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in the metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of triboelectric and pyroelectric sensors for tactile and temperature perception, and vibrators and nichrome heaters for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. With voltage integration processing, high-resolution continuous finger motion tracking is achieved via the triboelectric tactile sensor, which also contributes to superior performance in gesture/object recognition with artificial intelligence analysis. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.
67
Conductive Fiber‐Based Ultrasensitive Textile Pressure Sensor for Wearable Electronics
Jaehong Lee, Hyukho Kwon, Jungmok Seo et al. · Advanced Materials · 2015 · 1.2K citations · Full text
Learning the signatures of the human grasp using a scalable tactile glove
Subramanian Sundaram, Petr Kellnhofer, Yunzhu Li et al. · Nature · 2019 · 1.1K citations
Skin-integrated wireless haptic interfaces for virtual and augmented reality
Xinge Yu, Zhaoqian Xie, Yang Yu et al. · Nature · 2019 · 1K citations
Engineering, Mechatronics Engineering, Assistive Technology +13