2023 · 15 citations · 7 references
ArtsDesignHuman-centered DesignInteraction DesignUser Experience DesignAutomated Feedback GenerationHeuristic EvaluationInterface DesignUsability EngineeringUsability EvaluationUser-centered DesignExpert JudgmentFeedback DesignHeuristic Evaluation MethodologyHuman Feedback AnalysisUsability Problems Identification
Feedback on user interface (UI) mockups is crucial for the design process, and designers often seek and leverage feedback to improve their UIs. However, human feedback is not always readily available. Given the recent emergence of LLMs, which have been shown to be proficient in rule-based reasoning, we explore the potential of LLMs to provide feedback automatically. In particular, we investigate automating heuristic evaluation, which currently entails a human expert assessing how well a UI adheres to a given set of design guidelines. We build an LLM-based heuristic evaluation plugin for Figma, which designers can use to evaluate their UI mockups. The plugin queries the LLM with the guidelines and a JSON representation of the UI mockup and then renders the identified guideline violations as constructive suggestions for design improvements. Future work is needed to study what types of usability problems can be successfully identified by LLM-driven heuristic evaluation.
7
GUI testing using computer vision
Tsung-Hsiang Chang, Tom Yeh, Robert C. Miller · 2010 · 205 citations · Full text
Learning Visual Importance for Graphic Designs and Data Visualizations
Zoya Bylinskii, Nam Wook Kim, Peter O’Donovan et al. · 2017 · 168 citations · Full text
Computing, Design, Visualization +13
Automated reporting of GUI design violations for mobile apps
Kevin Moran, Boyang Li, Carlos Bernal-Cárdenas et al. · 2018 · 102 citations · Full text
Computing, Computer Science, Design +14
GUIComp: A GUI Design Assistant with Real-Time, Multi-Faceted Feedback
Chunggi Lee, Sang-Hoon Kim, Dongyun Han et al. · 2020 · 59 citations
Arts, Computer Science, Design +15