2020 · 71 citations · 8 references
ComputingComputer ScienceEnglishComputational LinguisticsNatural Language ProcessingText AnalyticsCorpus AnalysisCorpus AnnotationCorpus CompilationInformation ExtractionLanguage ModelingNamed Entity RecognitionF1 Score OptimizationHigh PerformanceLanguage Model Fine-tuning
In this paper, we provide an overview of the WNUT-2020 shared task on the identification of informative COVID-19 English Tweets. We describe how we construct a corpus of 10K Tweets and organize the development and evaluation phases for this task. In addition, we also present a brief summary of results obtained from the final system evaluation submissions of 55 teams, finding that (i) many systems obtain very high performance, up to 0.91 F 1 score, (ii) the majority of the submissions achieve substantially higher results than the baseline fastText
8
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text