Linguistic Annotation Workshop · 2010 · 35 citations · 12 references
Language StudiesLinguisticsCorpus LinguisticsDiscourse AnalysisNatural Language ProcessingAnnotationCorpus AnnotationCorpus-based Discourse AnalysisDiachronic Corpus AnalysisDiscourse ProcessingSyntactic AnnotationAnnotation AgreementAnnotation Scheme DevelopmentAnnotator AgreementCorpus Annotation SchemesDiachronic Discourse AnalysisInter-coder ReliabilityInter-rater ReliabilityTurkish Linguistics
In this paper, we report on the annotation procedures we developed for annotating the Turkish Discourse Bank (TDB), an effort that extends the Penn Discourse Tree Bank (PDTB) annotation style by using it for annotating Turkish discourse. After a brief introduction to the TDB, we describe the annotation cycle and the annotation scheme we developed, defining which parts of the scheme are an extension of the PDTB and which parts are different. We provide inter-coder reliability calculations on the first and second arguments of some connectives and discuss the most important sources of disagreement among annotators.
12
Inter-Coder Agreement for Computational Linguistics
Ron Artstein, Massimo Poesio · Computational Linguistics · 2008 · 1.6K citations · Full text
Strengthening the case for pair programming
Laurie Williams, Robert R. Kessler, Ward Cunningham et al. · IEEE Software · 2000 · 782 citations
The Kappa Statistic: A Second Look
Barbara Di Eugenio, Michael Glass · Computational Linguistics · 2004 · 498 citations · Full text