2014 · 11 citations · 11 references
ComputingComputer ScienceMachine LearningNatural Language ProcessingRecommender SystemsDimensionality ReductionMultimedia RetrievalPrincipal Component AnalysisRepresentation LearningSex DistributionSupport Vector MachinesBelief-based LearningBelief-based ModelsData SparsityEvaluation MetricsImbalanceLogistic RegressionSparsity ProblemWord Segmentation
In online video systems, viewer demographic information (gender, age, etc.) is of huge commercial value for delivering targeted advertising and video recommendations, but generally not available directly. This paper targets inferring viewers' gender based on implicit watching history in the large-scale online video systems. To tackle the sparsity problem without filtering out any cold users or videos, we not only introduce video tags as features, but also use an efficient Chinese word segmentation method to extract hot key-words from video titles as features. Moreover, users' viewing behavior distribute lognormally, hence we apply a logarithmic transformation on the inference matrixes and further find key features via principal components analysis (PCA). We then solve the gender inference as a classification problem and define some modified evaluation metrics adapt to the imbalance classification problem. We compare a set of classifiers including Class prior, EM, SVM, Logistic regression, Partially supervised soft-label and belief-based mixture and find that Logistic regression is the best. The inference results show that our algorithms can obtain high F̃ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> values for all classes. The highest value of PPTV dataset can reach nearly 0.75. And inference based on key-words results in a 14.63% increase of F̃ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> contrast to the ratings of MovieLens.
11
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
The Balanced Accuracy and Its Posterior Distribution
Kay H. Brodersen, Cheng Soon Ong, Klaas Ε. Stephan et al. · 2010 · 1.7K citations
Robust PCA and classification in biosciences
Mia Hubert, Sanne Engelen · Bioinformatics · 2004 · 191 citations · Full text
Udi Weinsberg, Smriti Bhagat, Stratis Ioannidis et al. · 2012 · 174 citations
Computing, Data Science, Advertising +16