Collecting Voices from the Cloud

Abstract

The collection and transcription of speech data is typically an expensive and time-consuming task. Voice over IP and cloud computing are poised to eliminate this impediment to research on spoken language interfaces in many domains. This paper documents our efforts to deploy speech-enabled web interfaces to large audiences over the Internet via Amazon Mechanical Turk, an online marketplace for work. Using the open source WAMI Toolkit, we collected corpora in two different domains which collectively constitute over 113 hours of speech. The first corpus contains 100,000 utterances of read speech, and was collected by asking workers to record street addresses in the United States. For the second task, we collected conversations with Flight Browser, a multimodal spoken dialogue system. The Flight Browser corpus obtained contains 10,651 utterances composing 1,113 individual dialogue sessions from around 100 distinct users. The aggregate time spent collecting the data for both corpora was just under two weeks. At times, our servers were logging audio from workers at rates faster than real-time. We describe the process of collection and transcription of these corpora while providing an analysis of the advantages and limitations to this data collection method. 1.