Constructing Japanese test collections for spoken term detection

TLDR

Spoken Document Retrieval and Spoken Term Detection have been major research areas, with test collections established by TREC and NIST. The paper establishes a working group and outlines policies, schedule, and objectives for developing Japanese SDR and STD test collections. The authors constructed a Japanese SDR test collection, are building STD collections, and compare them with the NIST STD test collections. The working group has released a Japanese SDR test collection and is developing STD collections for public use. Index terms: spoken term detection, test collection.

Abstract

Spoken Document Retrieval (SDR) and Spoken Term Detection (STD) have been two of the most intensively investigated topics in spoken document processing research according to the establishment of the SDR and STD test collections by the Text REtrieval Conference (TREC) and NIST. Because Japanese spoken document processing researchers also requires such test collections for SDR and STD, we have established a working group to develop these collections in Special Interest Group -Spoken Language Processing (SIG-SLP) of the Information Processing Society of Japan. The working group has constructed and made available a test collection for SDR, and is now constructing new test collections for STD that will be open to researchers. The present paper introduces the policies, outline, and schedule of the new test collections. Then, the new test collections are compared with the NIST STD test collections. Index Terms: spoken term detection, test collection