2013 · 111 citations · 8 references
EngineeringSpeech CorpusCorpus LinguisticsLanguage ProcessingText MiningApplied LinguisticsNatural Language ProcessingLanguage DocumentationInformation RetrievalGeneral LanguageComputational LinguisticsHistorical LinguisticsCorpus AnalysisLanguage StudiesLexiconMachine TranslationLearner Corpus LinguisticsTenten Corpus FamilyWeb CorporaNew FamilyLexical ResourceLanguage CorpusLinguistics
Researchers in computational linguistics seek larger, cleaner, duplicate‑free corpora with richer metadata, a goal supported by prior web‑corpus initiatives such as those by Baroni, Kilgarriff, and Sharoff. The paper outlines a programme to construct larger, cleaner, metadata‑rich corpora for all major languages and describes its current progress and future maintenance plans. The authors build the corpora by incrementally adding metadata attributes and expanding coverage across major languages. TenTen corpora comprise roughly 10 billion words and are publicly available for research at sketchengine.co.uk.
Everyone working on general language would like their corpus to be bigger, wider-coverage, cleaner, duplicate-free, and with richer metadata. In this paper we describe out programme to build ever better corpora along these lines for all of the world’s major languages (plus some others). Baroni and Kilgarriff (2006), Sharoff (2006), Baroni et al (2009), and Kilgarriff et al (2010) present the case for web corpora and programmes in which a number of them have been developed. TenTens are a development from them -- a new family of corpora of the order of 10 billion words. We describe how we are building them, what we have built so far, and how we shall continue maintaining them and keeping them up to date in the years ahead. While, as yet, they have very little metadata, we are working out how to gather and add metadata attribute by attribute. The corpora are all available for research at http://www.sketchengine.co.uk.
8
Adam Kilgarriff, Pavel Rychlý, Pavel Smrž et al. · 2004 · 528 citations
Computer Animation, Macmillan English Dictionary, Sketch-based Modeling +20
Adam Kilgarriff, Pavel Rychlý, Pavel Smrž et al. · Proceedings of the 11th EURALEX International Congress · 2004 · 342 citations