2018 · 25 citations · 10 references
ArchitectureDesignDesign AutomationMachine LearningUser Experience DesignDeep LearningDesign ResearchDesign SynthesisMobile Application DevelopmentAutomated Design Space ExplorationDesign PatternsDesign Representation LearningGenerative Adversarial NetworksMachine Learning-based Design SynthesisNatural Language InferenceNatural Language InterfacesRecurrent Neural Networks
User interface (UI) is one of the most important components of a mobile app and strongly influences users' perception of the app. However, UI design tasks are typically manual and time-consuming. This paper proposes a novel approach to (semi)-automate those tasks. Our key idea is to develop and deploy advanced deep learning models based on recurrent neural networks (RNN) and generative adversarial networks (GAN) to learn UI design patterns from millions of currently available mobile apps. Once trained, those models can be used to search for UI design samples given user-provided descriptions written in natural language and generate professional-looking UI designs from simpler, less elegant design drafts.
10
Recurrent neural network based language model
Tomáš Mikolov, Martin Karafiát, Lukáš Burget et al. · 2010 · 5.4K citations
Extensions of recurrent neural network language model
Tomáš Mikolov, Stefan Kombrink, Lukáš Burget et al. · 2011 · 1.6K citations
Parsing Natural Scenes and Natural Language with Recursive Neural Networks
Richard Socher, Cliff Chiung-Yu Lin, Christopher D. Manning et al. · 2011 · 1.2K citations