2005 · 16 citations · 2 references
EngineeringSpeech CorpusCorpus LinguisticsText MiningApplied LinguisticsNatural Language ProcessingData Collecting EngineLanguage DocumentationInformation RetrievalData ScienceComputational LinguisticsLanguage EngineeringLanguage StudiesInteractive CollaborationMachine TranslationLanguage Observatory ProjectLanguage TechnologyLanguage RecognitionLanguage CorpusLinguistics
The first part of the paper provides a brief description of the Language Observatory Project (LOP) and highlights the major technical difficulties to be challenged. The latter part gives how we responded to these difficulties by adopting UbiCrawler as a data collecting engine for the project. An interactive collaboration between the two groups is producing quite satisfactory results.
2
UbiCrawler: a scalable fully distributed Web crawler
Paolo Boldi, Bruno Codenotti, Massimo Santini et al. · Software Practice and Experience · 2004 · 559 citations