2009 · 149 citations · 18 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingGraph-based LearningInformation ExtractionKnowledge GraphsSemantic NetworksText MiningText Similarity AnalysisDocument SimilarityDocument Similarity AssessmentDomain Knowledge IntegrationGraph-based Text SimilarityInformation Retrieval EvaluationSemantic RelatednessSemantic RetrievalSimilarity Learning
Computing semantic relatedness of natural language texts is a key component of tasks such as information retrieval and summarization, and often depends on knowledge of a broad range of real-world concepts and relationships. We address this knowledge integration issue by computing semantic relatedness using personalized PageRank (random walks) on a graph derived from Wikipedia. This paper evaluates methods for building the graph, including link selection strategies, and two methods for representing input texts as distributions over the graph nodes: one based on a dictionary lookup, the other based on Explicit Semantic Analysis. We evaluate our techniques on standard word relatedness and text similarity datasets, finding that they capture similarity information complementary to existing Wikipedia-based relatedness measures, resulting in small improvements on a state-of-the-art measure.
18
An introduction to latent semantic analysis
Thomas K. Landauer, Peter W. Foltz, Darrell Laham · Discourse Processes · 1998 · 4.9K citations