2021 · 21 citations · 53 references
ArtsPerforming ArtsTheatre StudiesCinematographyInteractive MediaUser Experience DesignHapticsImmersive MediaVirtual RealityVirtual WorldsContextual CuesHaptic InputHaptic RenderingHaptic User ExperienceMultimodal Haptic FeedbackUser Study EvaluationVirtual Reality Haptics
The application of haptic technology in entertainment systems, such as Virtual Reality and 4D cinema, enables novel experiences for users and drives the demand for efficient haptic authoring systems. Here, we propose an automatic multimodal vibrotactile content creation pipeline that substantially improves the overall hapto-audiovisual (HAV) experience based on contextual audio and visual content from movies. Our algorithm is implemented on a low-cost system with nine actuators attached to a viewing chair and extracts significant features from video files to generate corresponding haptic stimuli. We implemented this pipeline and used the resulting system in a user study (n = 16), quantifying user experience according to the sense of immersion, preference, harmony, and discomfort. The results indicate that the haptic patterns generated by our algorithm complement the movie content and provide an immersive and enjoyable HAV user experience. This further suggests that the pipeline can facilitate the efficient creation of 4D effects and could therefore be applied to improve the viewing experience in home theatre environments.
53
Learning Deconvolution Network for Semantic Segmentation
Hyeonwoo Noh, Seunghoon Hong, Bohyung Han · 2015 · 4K citations
Deep Learning for Generic Object Detection: A Survey
Li Liu, Wanli Ouyang, Xiaogang Wang et al. · International Journal of Computer Vision · 2019 · 2.8K citations · Full text
Context Encoding for Semantic Segmentation
Hang Zhang, Kristin Dana, Jianping Shi et al. · 2018 · 1.5K citations
Learning to Detect Salient Objects with Image-Level Supervision
Lijun Wang, Huchuan Lu, Yifan Wang et al. · 2017 · 1.3K citations