Frame accurate media synchronization of heterogeneous media sources in an HBB context

Abstract

Next generation HbbTV applications promise exciting new possibilities with respect to heterogeneous content sources synchronization, like multi-angle picture-in-picture video rendering and . Frame accurate synchronization is required in order to achieve these new possibilities. In this study, as part of the ongoing European FP7 Next Generation Hybrid Broadcast Broadband (Hbb-Next) project, we investigated the use of content agnostic timestamp information for media synchronization. We demonstrate that frame accurate synchronization on a single device can be achieved between local transport streams and a remote MPEG-DASH stream using a customized GStreamer based test bed. In future research, we will extend our test bed for inter device and inter destination synchronization.