ACM SIGMOD Record · 2016 · 61 citations · 30 references
ComputingComputer ScienceData ManagementDatabasesMachine LearningData IntegrationData PreprocessingDeep LearningExtract, Transform, LoadInformation ExtractionKnowledge ExtractionExtract, Transform, Load (Etl)Extract-transform-load PipelinesKnowledge Base ConstructionRelational Database SystemsText Base ConstructionUnstructured Data Extraction
The dark data extraction or knowledge base construction (KBC) problem is to populate a SQL database with information from unstructured data sources including emails, webpages, and pdf reports. KBC is a long-standing problem in industry and research that encompasses problems of data extraction, cleaning, and integration. We describe DeepDive, a system that combines database and machine learning ideas to help develop KBC systems. The key idea in DeepDive is that statistical inference and machine learning are key tools to attack classical data problems in extraction, cleaning, and integration in a unified and more effective manner. DeepDive programs are declarative in that one cannot write probabilistic inference algorithms; instead, one interacts by defining features or rules about the domain. A key reason for this design choice is to enable domain experts to build their own KBC systems. We present the applications, abstractions, and techniques of DeepDive employed to accelerate construction of KBC systems.
30
Automatic acquisition of hyponyms from large text corpora
Marti A. Hearst · 1992 · 3.3K citations · Full text
Web-scale information extraction in knowitall
Oren Etzioni, Michael Cafarella, Doug Downey et al. · 2004 · 753 citations
Monte Carlo Statistical Methods
Technometrics · 2005 · 727 citations · Full text
Ravi Jampani, Fei Xu, Mingxi Wu et al. · 2008 · 274 citations