2006 · 32 citations · 13 references
BusinessData ScienceData AnalyticsDecision AnalysisPublic OpinionBiasOpinion ComparisonOpinion MiningPeer ReviewBias DetectionBias EvaluationBias RecognitionData EvaluationFace ValueMutual DependencyReinforcementSubjectivity Detection
In this paper, we investigate how deviation in evaluation activities may reveal bias on the part of reviewers and controversy on the part of evaluated objects. We focus on a 'data-centric approach' where the evaluation data is assumed to represent the 'ground truth'. The standard statistical approaches take evaluation and deviation at face value. We argue that attention should be paid to the subjectivity of evaluation, judging the evaluation score not just on 'what is being said' (deviation), but also on 'who says it' (reviewer) as well as on 'whom it is said about' (object). Furthermore, we observe that bias and controversy are mutually dependent, as there is more bias if there is higher deviation on a less controversial object. To address this mutual dependency, we propose a reinforcement model to identify bias and controversy. We test our model on real-life data to verify its applicability.
13
The PageRank Citation Ranking : Bringing Order to the Web
Lawrence M. Page, Sergey Brin, Rajeev Motwani et al. · 1999 · 12.7K citations
Authoritative sources in a hyperlinked environment
Jon Kleinberg · Journal of the ACM · 1999 · 9.1K citations · Full text
Maximizing the spread of influence through a social network
David Kempe, Jon Kleinberg, Éva Tardos · 2003 · 7.3K citations
Inferring Web communities from link topology
David Gibson, Jon Kleinberg, Prabhakar Raghavan · 1998 · 773 citations
Ronald Fagin, Ravi Kumar, D. Sivakumar · 2003 · 768 citations