2024 · 43 citations · 52 references
ArtsDesignCreativityInformation RetrievalUser Experience DesignIdea GenerationInteractive Generative SystemsInteractive Information RetrievalInterface DesignGenerative Design ExplorationGenerative InterfacesInteractive SearchInteractive Search SystemsSimilarity SearchUser Study EvaluationVisual Search ModelsVisual Similarity Search
Designers rely on visual search to explore and develop ideas in early design stages. However, designers can struggle to identify suitable text queries to initiate a search or to discover images for similarity-based search that can adequately express their intent. We propose GenQuery, a novel system that integrates generative models into the visual search process. GenQuery can automatically elaborate on users’ queries and surface concrete search directions when users only have abstract ideas. To support precise expression of search intents, the system enables users to generatively modify images and use these in similarity-based search. In a comparative user study (N=16), designers felt that they could more accurately express their intents and find more satisfactory outcomes with GenQuery compared to a tool without generative features. Furthermore, the unpredictability of generations allowed participants to uncover more diverse outcomes. By supporting both convergence and divergence, GenQuery led to a more creative experience.
52
Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang, Anyi Rao, Maneesh Agrawala · 2023 · 3.6K citations
Palette: Image-to-Image Diffusion Models
Chitwan Saharia, William Chan, Huiwen Chang et al. · 2022 · 1.5K citations · Full text
David G. Jansson, Steven M. Smith · Design Studies · 1991 · 979 citations
Null-text Inversion for Editing Real Images using Guided Diffusion Models
Ron Mokady, Amir Hertz, Kfir Aberman et al. · 2023 · 609 citations