2019 · 14 citations · 23 references
ComputingComputer ScienceMachine LearningNatural Language ProcessingTime Series AnalysisDeep LearningNeural NetworksPattern RecognitionRepresentation LearningSelf-supervised LearningTime Series PredictionAcoustic Sensor NetworksAudio Self-supervised LearningAudio-visual RepresentationSelf-supervised PretrainingSelf-supervised Representation LearningSequence Representation LearningSound-visual Correspondence
Self-supervised representation learning with deep neural networks is a powerful tool for machine learning tasks with limited labeled data but extensive unlabeled data. To learn representations, self-supervised models are typically trained on a pretext task to predict structure in the data (e.g. audio-visual correspondence, short-term temporal sequence, word sequence) that is indicative of higher-level concepts relevant to a target, downstream task. Sensor networks are promising yet unexplored sources of data for self-supervised learning—they collect large amounts of unlabeled yet timestamped data over extended periods of time and typically exhibit long-term temporal structure (e.g., over hours, months, years) not observable at the short time scales previously explored in self-supervised learning (e.g., seconds). This structure can be present even in single-modal data and therefore could be exploited for self-supervision in many types of sensor networks. In this work, we present a model for learning audio representations by predicting the long-term, cyclic temporal structure in audio data collected from an urban acoustic sensor network. We then demonstrate the utility of the learned audio representation in an urban sound event detection task with limited labeled data.
23
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Big data, smart cities and city planning
Michael Batty · Dialogues in Human Geography · 2013 · 1.1K citations · Full text