Analyzing reviews and code of mobile apps for better release planning

Adelina Ciurumelea, Andreas Schaufelbuhl, Sebastiano Panichella, Harald C. Gall

2017 · 155 citations · 44 references

DOIFull text

Open access

Concepts

TL;DR

The mobile app industry grows rapidly, driving fierce competition and a need for rapid feature and bug fixes, while successful apps receive thousands of daily reviews that are too time‑consuming to analyze manually. The study aims to enable developers to monitor and analyze user reviews to guide maintenance and evolution planning. We created a taxonomy of mobile‑specific review categories, built the User Request Referencer prototype using machine learning and information retrieval to classify reviews and link them to relevant source‑code files, and evaluated it on 39 apps. The prototype achieved high precision and recall in organizing reviews according to the taxonomy.

Abstract

The mobile applications industry experiences an unprecedented high growth, developers working in this context face a fierce competition in acquiring and retaining users. They have to quickly implement new features and fix bugs, or risks losing their users to the competition. To achieve this goal they must closely monitor and analyze the user feedback they receive in form of reviews. However, successful apps can receive up to several thousands of reviews per day, manually analysing each of them is a time consuming task. To help developers deal with the large amount of available data, we manually analyzed the text of 1566 user reviews and defined a high and low level taxonomy containing mobile specific categories (e.g. performance, resources, battery, memory, etc.) highly relevant for developers during the planning of maintenance and evolution activities. Then we built the User Request Referencer (URR) prototype, using Machine Learning and Information Retrieval techniques, to automatically classify reviews according to our taxonomy and recommend for a particular review what are the source code files that need to be modified to handle the issue described in the user review. We evaluated our approach through an empirical study involving the reviews and code of 39 mobile applications. Our results show a high precision and recall of URR in organising reviews according to the defined taxonomy.

References

44