2012 · 41 citations · 2 references
ComputingCloud ComputingGeographic Information SystemsInformation RetrievalMobile ComputingContext-aware ComputingMobile Cloud ComputingMobile Multimedia SystemsMobile SensingMultimedia RetrievalMusic Information RetrievalBandwidthBandwidth OptimizationContext-aware MappingContext-aware MultimediaMobile ContextMobile Media SharingSensor Data IntegrationVideo Generation
We present a system to automatically generate soundtracks for user-generated outdoor videos (UGV) based on concurrently captured contextual sensor information with mobile apps for the ACM Multimedia 2012 Google challenge: Automatic Music Video Generation. Our method addresses the use case of making "a video much more attractive for sharing by adding a matching soundtrack to it." Our system correlates viewable scene information from sensors with geographic contextual tags from OpenStreetMap. The co-occurance of geo-tags and mood tags are investigated from a set of categories of the web site Foursquare.com and a mapping from geo-tags to mood tags is obtained. Finally, a music retrieval component returns music based on matching mood tags. The experimental results show that our system can successfully create soundtracks that are related to the mood and situation of UGVs and therefore enhance the enjoyment of viewers. Our system sends only sensor data to a cloud service and is therefore bandwidth efficient since video data does not need to be transmitted for analysis.
2
Viewable scene modeling for geospatial video search
Sakire Arslan Ay, Roger Zimmermann, Seon Ho Kim · 2008 · 101 citations
Automatic tag generation and ranking for sensor-rich outdoor videos
Zhijie Shen, Sakire Arslan Ay, Seon Ho Kim et al. · 2011 · 44 citations