2017 · 28 citations · 16 references
BusinessBusiness AnalyticsMarketingFeature EngineeringMachine LearningPredictive AnalyticsConversion AnalysisDigital AdvertisingMobile AdvertisingPersonalizationScalable Machine LearningTransfer LearningAd Performance MeasurementConversion Rate ModelingCustomer Response ModelingModel Performance AnalysisModel Performance EvaluationPredictive Conversion ModelingPredictive Model PerformancePredictive Sales Analytics
Predicting the probability of users clicking on app install ads and installing those apps comes with its own specific challenges. In this paper, we describe (a) how we built a scalable machine learning pipeline from scratch to predict the probability of users clicking and installing apps in response to ad impressions, (b) the novel features we developed to improve our model performance, (c) the training and scoring pipelines that were put into production, (d) our A/B testing process along with the metrics used to determine significant improvements, and (e) the results of our experiments. Our algorithmic improvements resulted in a 3X improvement in satisfaction for app install advertisers on our ad platform. In addition, we dive into how sequential model training, deep learning, and transfer learning resulted in a further 7% lift in conversion rate and 11% lift in revenue. Finally, we share the scientific, data-related, and product-related challenges that we encountered -- we expect others across the industry would greatly benefit from these considerations and our experiences when they kick-start similar efforts.
16
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Martı́n Abadi, Ashish Agarwal, Paul Barham et al. · arXiv (Cornell University) · 2016 · 9.8K citations · Full text
How transferable are features in deep neural networks?
Jason Yosinski, Jeff Clune, Yoshua Bengio et al. · arXiv (Cornell University) · 2014 · 3.5K citations · Full text
Steffen Rendle · 2010 · 3.1K citations