Emotion recognition using mobile phones

Abstract

The availability of built-in sensors in mobile phones has enabled a host of innovative applications. One class of applications deals with detecting a user's emotions. Previous applications have primarily relied on recording and displaying self-reported emotions. This paper presents an intelligent emotion detection system for mobile phones implemented as a smart keyboard. The smart keyboard independently infers a user's emotional state using machine learning techniques. The system uses accelerometer readings and various aspect of typing behavior like speed, number of backspaces, and time delay between letters to train a classifier to predict emotions. Naïve Bayes, J48, IBK, Multi-response linear regression and SVM were evaluated and J48 was found to be the best classifier with over 90% accuracy and precision. In addition to providing emotive feedback to individual users, the system also uses geo-tagged data to collect and display emotional states of regions or countries through a website.