IEEE Transactions on Network and Service Management · 2021 · 43 citations · 45 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningFrame Rate OptimizationLive Streaming PerformanceNetwork Capacity PlanningStream ProcessingVideo Analysis360-Degree VideoBandwidthGreedy HeuristicsKnapsack ApproximationNetwork CapacityNetwork Capacity AllocationStreaming Of 360-Degree VideoViewport Prediction
Conventional streaming solutions for streaming 360-degree panoramic videos are inefficient in that they download the entire 360-degree panoramic scene, while the user views only a small sub-part of the scene called the viewport. This can waste over 80% of the network bandwidth. We develop a comprehensive approach called Mosaic that combines a powerful neural network-based viewport prediction with a rate control mechanism that assigns rates to different tiles in the 360-degree frame such that the video quality of experience is optimized subject to a given network capacity. We model the optimization as a multi-choice knapsack problem and solve it using a greedy approach. We also develop an end-to-end testbed using standards-compliant components and provide a comprehensive performance evaluation of Mosaic along with five other streaming techniques - two for conventional adaptive video streaming and three for 360-degree tile-based video streaming. Mosaic outperforms the best of the competitions by as much as 47-191% in terms of average video quality of experience. Simulation-based evaluation as well as subjective user studies further confirm the superiority of the proposed approach.
45
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Neural Adaptive Video Streaming with Pensieve
Hongzi Mao, Ravi Netravali, Mohammad Alizadeh · 2017 · 1.3K citations · Full text
The MPEG-DASH Standard for Multimedia Streaming Over the Internet
Iraj Sodagar · IEEE Multimedia · 2011 · 1.1K citations
A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP
Xiaoqi Yin, Abhishek Jindal, Vyas Sekar et al. · 2015 · 995 citations · Full text
A buffer-based approach to rate adaptation
Te-Yuan Huang, Ramesh Johari, Nick McKeown et al. · 2014 · 987 citations · Full text