2013 · 158 citations · 77 references
ComputingLiteratureInformation RetrievalRecommender SystemsText AnalyticsEvaluation Of Recommender SystemsLiterature Review MethodsRecommendation EvaluationEvaluation BenchmarksRecommender Evaluation MetricsResearch ArticlesResearch Paper RecommendationState-of-the-art Review
Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.
77
Introduction to information retrieval
Choice Reviews Online · 2009 · 12.6K citations
Studies in Fuzziness and Soft Computing
M.K. Luhandjula · 2013 · 1.1K citations