2017 · 221 citations · 21 references
ComputingVisualizationComputer VisionMachine VisionVirtual Reality DesignHead-mounted Display SystemsImmersive MediaVirtual Reality360-Degree VideoBufferingDead ReckoningDesign Alternatives EvaluationOptimal Parameter TuningSaliency MappingStreaming Of 360-Degree VideoTrace-driven Modeling
We study the problem of predicting the Field-of-Views (FoVs) of viewers watching 360° videos using commodity Head-Mounted Displays (HMDs). Existing solutions either use the viewer's current orientation to approximate the FoVs in the future, or extrapolate future FoVs using the historical orientations and dead-reckoning algorithms. In this paper, we develop fixation prediction networks that concurrently leverage sensor- and content-related features to predict the viewer fixation in the future, which is quite different from the solutions in the literature. The sensor-related features include HMD orientations, while the content-related features include image saliency maps and motion maps. We build a 360° video streaming testbed to HMDs, and recruit twenty-five viewers to watch ten 360° videos. We then train and validate two design alternatives of our proposed networks, which allows us to identify the better-performing design with the optimal parameter settings. Trace-driven simulation results show the merits of our proposed fixation prediction networks compared to the existing solutions, including: (i) lower consumed bandwidth, (ii) shorter initial buffering time, and (iii) short running time.
21
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Learning to predict where humans look
Tilke Judd, Krista A. Ehinger, Frédo Durand et al. · 2009 · 2K citations · Full text
The MPEG-DASH Standard for Multimedia Streaming Over the Internet
Iraj Sodagar · IEEE Multimedia · 2011 · 1.1K citations
A Framework to Evaluate Omnidirectional Video Coding Schemes
Matt Yu, Haricharan Lakshman, Bernd Girod · 2015 · 439 citations