Probase

Wentao Wu, Hongsong Li, Haixun Wang, Kenny Q. Zhu

2012 · 782 citations · 26 references

Concepts

TL;DR

The rapid growth of digital information demands machine comprehension, yet current ontologies lack the depth and breadth needed for universal understanding. This work introduces a universal, probabilistic taxonomy that surpasses existing ontologies in comprehensiveness. The taxonomy, built from 2.7 million concepts extracted automatically from 1.68 billion web pages, employs probabilistic modeling to capture inconsistent, ambiguous, and uncertain knowledge. The authors detail the construction process, probabilistic framework, and demonstrate its applicability to text understanding tasks.

Abstract

Knowledge is indispensable to understanding. The ongoing information explosion highlights the need to enable machines to better understand electronic text in human language. Much work has been devoted to creating universal ontologies or taxonomies for this purpose. However, none of the existing ontologies has the needed depth and breadth for universal understanding. In this paper, we present a universal, probabilistic taxonomy that is more comprehensive than any existing ones. It contains 2.7 million concepts harnessed automatically from a corpus of 1.68 billion web pages. Unlike traditional taxonomies that treat knowledge as black and white, it uses probabilities to model inconsistent, ambiguous and uncertain information it contains. We present details of how the taxonomy is constructed, its probabilistic modeling, and its potential applications in text understanding.

References

26