1999 · 21 citations · 2 references
Language StudiesComputer ScienceLinguisticsComputational LinguisticsCorpus LinguisticsNatural Language ProcessingAnnotationCorpus AnnotationCorpus RetrievalDialogue AnalysisDialogue SystemsSpoken CorporaAnnotated Text CorporaAnnotation Scheme ComparisonAnnotation Scheme DevelopmentCorpus Annotation RetrievalCorpus Annotation SchemesDialogue Corpus ConstructionDialogue TaggingSpeech Act Annotation
This paper describes the state of the art of coding schemes for dialogue acts and the efforts to establish a standard in this field. We present a review and comparison of currently available schemes and outline the comparison problems we had due to domain, task, and language dependencies of schemes. We discuss solution strategies which have in mind the reusability of corpora. Reusability is a crucial point because production and annotation of corpora is very time and cost consuming but the current broad variety of schemes makes reusability of annotated corpora very hard. The work of this paper takes place in the framework of the Euro- pean Union funded MATE project. MATE aims to develop general methodological guidelines for the creation, annotation, retrieval and analysis of annotated corpora.
2
Assessing agreement on classification tasks: the kappa statistic
Jean Carletta · ArXiv.org · 1996 · 2.1K citations · Full text
Laila Dybkjær, Niels Ole Bernsen · 2000 · 27 citations · Full text