2017 · 209 citations · 29 references
Language StudiesData ScienceAcousticsPhoneticsPsychoacousticsSound SynthesisSpeech SynthesisAcoustic Event DetectionEnvironmental Sound RecordingLabelingLabelsMachine ListeningNoise MonitoringPitch ShiftingTransformations
Sound event detection in environmental recordings is a key research area, but strong labeling is scarce because manual annotation of onset, offset, and source for every event is time‑consuming. Scaper is introduced as an open‑source library to synthesize and augment soundscapes, thereby alleviating the labeling bottleneck. Scaper functions as a high‑level sequencer that generates diverse soundscapes from isolated events using a probabilistic specification and applies per‑event transformations such as pitch shifting and time stretching. Using Scaper, the authors created a 10,000‑soundscape dataset to benchmark two state‑of‑the‑art algorithms, demonstrated its utility in a crowdsourced labeling study, and outlined its limitations and future applications.
Sound event detection (SED) in environmental recordings is a key topic of research in machine listening, with applications in noise monitoring for smart cities, self-driving cars, surveillance, bioa-coustic monitoring, and indexing of large multimedia collections. Developing new solutions for SED often relies on the availability of strongly labeled audio recordings, where the annotation includes the onset, offset and source of every event. Generating such precise annotations manually is very time consuming, and as a result existing datasets for SED with strong labels are scarce and limited in size. To address this issue, we present Scaper, an open-source library for soundscape synthesis and augmentation. Given a collection of iso-lated sound events, Scaper acts as a high-level sequencer that can generate multiple soundscapes from a single, probabilistically defined, "specification". To increase the variability of the output, Scaper supports the application of audio transformations such as pitch shifting and time stretching individually to every event. To illustrate the potential of the library, we generate a dataset of 10,000 sound-scapes and use it to compare the performance of two state-of-the-art algorithms, including a breakdown by soundscape characteristics. We also describe how Scaper was used to generate audio stimuli for an audio labeling crowdsourcing experiment, and conclude with a discussion of Scaper's limitations and potential applications.
29
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text