2023 · 160 citations · 16 references
ComputingVisualizationInteractive VisualizationNatural Language ProcessingVisual DesignImage EditingInteractive Generative SystemsInteractive GraphicsMultimodal InteractionText GenerationFeedback-driven GenerationGenerative InterfacesInteractive ExplorationLarge Language ModelsPrompt-based GenerationText-to-image GenerationUser-generated ImagesUser-guided Generation
Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user’s creative intent remains challenging. It often involves laborious trial-and-error procedures to ensure that the model interprets the prompts in alignment with the user’s intention. To address these challenges, we present Promptify, an interactive system that supports prompt exploration and refinement for text-to-image generative models. Promptify utilizes a suggestion engine powered by large language models to help users quickly explore and craft diverse prompts. Our interface allows users to organize the generated images flexibly, and based on their preferences, Promptify suggests potential changes to the original prompt. This feedback loop enables users to iteratively refine their prompts and enhance desired features while avoiding unwanted ones. Our user study shows that Promptify effectively facilitates the text-to-image workflow, allowing users to create visually appealing images on their first attempt while requiring significantly less cognitive load than a widely-used baseline tool.
16
Clustering by Passing Messages Between Data Points
Brendan J. Frey, Delbert Dueck · Science · 2007 · 6.9K citations
Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang, Anyi Rao, Maneesh Agrawala · 2023 · 3.6K citations
Joe Marks, Wheeler Ruml, Kathy Ryall et al. · 1997 · 556 citations
Arts, Design, Visualization +10