Functional and Contextual Attention-Based LSTM for Service Recommendation in Mashup Creation

Abstract

Service recommendation is a fundamental task in many application environments (e.g., Mashup creation and cloud computing). In the past, various methods have been proposed to facilitate the service selection process based on the original functional descriptions. However, the mined features from the descriptions are usually too sparse for training a well-performed model. In addition, most methods neglect to differentiate the weights of various features, while words included in descriptions usually exhibit different intentions (e.g., functional or non-functional). To address these challenges, in this paper we propose a text expansion and deep model-based approach for service recommendation. Specifically, we first expand the description of services at sentence level based on a novel probabilistic topic model that learns topics of words, sentences and descriptions in a stratified fashion. The expansion process can bridge the vocabulary gap between services and user queries with the collective semantic similarity of sentences and descriptions. Then, we propose a Long Short-Term Memory-based model to recommend services with two attention mechanisms - a functional attention mechanism that takes tags as functional prior to mine the function-related features of services and Mashups, and a contextual attention mechanism that considers Mashup requirements as application scenario to help select the most appropriate services. We evaluate the proposed approach on a real-world dataset and the results show it has an improvement of 34 percent in F-measure over the basic LSTM model.