2009 · 400 citations · 17 references
ComputingComputer ScienceNatural Language ProcessingRecommender SystemsText AnalyticsEvaluation Of Recommender SystemsKnowledge-based RecommendationOpinion MiningRecommendation EvaluationRecommendation SystemsSentiment AnalysisRating PredictionRating Prediction AccuracyRecommender Evaluation MetricsReviewsText-based RecommendationUser FeedbackUser Feedback ModelingUser Reviews
Online reviews are valuable but free‑text format hampers computer understanding, making search frustrating; incorporating structure and sentiment could greatly improve user experience. The study aims to extract structural and sentiment cues from free‑form reviews to enhance recommendation accuracy and user experience. We developed ad‑hoc and regression‑based recommendation metrics that incorporate textual content in a restaurant review setting. Using textual information yields more accurate general and personalized review score predictions than relying solely on star ratings.
Online reviews are an important asset for users deciding to buy a product, see a movie, or go to a restaurant, as well as for businesses tracking user feedback. However, most reviews are written in a free-text format, and are therefore difficult for computer systems to understand, analyze, and aggregate. One consequence of this lack of structure is that searching text reviews is often frustrating for users. User experience would be greatly improved if the structure and sentiment conveyed in the content of the reviews were taken into account. Our work focuses on identifying this information from free-form text reviews, and using the knowledge to improve user experience in accessing reviews. Specifically, we focused on improving recommendation accuracy in a restaurant review scenario. In this paper, we report on our classification effort, and on the insight on user-reviewing behavior that we gained in the process. We propose new ad-hoc and regression-based recommendation measures, that both take into account the textual component of user reviews. Our results show that using textual information results in better general or personalized review score predictions than those derived from the numerical star ratings given by the users.
17
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Ron Kohavi · 1995 · 10.7K citations · Full text
Mining and summarizing customer reviews
Minqing Hu, Bing Liu · 2004 · 7.7K citations
Bo Pang, Lillian Lee, Shivakumar Vaithyanathan · 2002 · 7K citations · Full text