Breathy, Resonant, Pressed – Automatic Detection of Phonation Mode from Audio Recordings of Singing

Abstract

Abstract In this paper we present an experiment on automatic detection of phonation modes from recordings of sustained sung vowels. We created an open dataset specifically for this experiment, containing recordings of nine vowels from multiple languages, sung by a female singer on all pitches in her vocal range in phonation modes breathy, neutral, flow (resonant) and pressed. The dataset is available under a Creative Commons license at http://www.proutskova.de/phonation-modes. First, glottal flow waveform is estimated via inverse filtering (IAIF) from audio recordings. Then six parameters of the glottal flow waveform are calculated. A 4-class Support Vector Machine classifier is constructed to separate these features into phonation mode classes. We automated the IAIF approach by computing the values of the input arguments – lip radiation and formant count – leading to the best-performing SVM classifiers (average classification accuracy over 60%), yielding a physical model for the articulation of the vowels. We examine the steps needed to generalize and extend the experimental work presented in this paper in order to apply this method in ethnomusicological investigations. Acknowledgments We would like to sincerely thank Victor Grauer, the co-inventor of Cantometrics, for suggesting to focus on the subordination of women hypothesis, which gave us the inspiration and the motivation for the current work. We are grateful to prof. Johan Sundberg for his recommendations, e.g. on the recordings set up and his general support. Our special thanks go to the peer reviewers for their balanced, insightful and fair reviews, which helped us to substantially revise the text. Notes http://www.youtube.com/watch?v=MLU0jndUGg4 (last accessed on 30/10/2012) http://www.youtube.com/watch?v=k4SLSlSmW74 (last accessed on 30/10/2012) http://www.youtube.com/watch?v=7iQQGBfbB0k (last accessed on 30/10/2012) http://www.youtube.com/watch?v=hRyDB4RWJdw (last accessed on 30/10/2012) http://www.youtube.com/watch?v=rgusCINe260 (last accessed on 30/10/2012) http://www.youtube.com/watch?v=XgDrJ5Z2rKw (last accessed on 30/10/2012)