AI in Civil Engineering · 2023 · 111 citations · 13 references
ArtsArchitectural DesignDesignComputational ArtKnowledge RepresentationNatural Language ProcessingAlgorithmic ArtArchitectural ModelingArtificial Intelligence ArtVisual ArtsDesign Ideation ModelsDiffusion ModelsUse Cases
Abstract Recent diffusion-based AI art platforms can create impressive images from simple text descriptions. This makes them powerful tools for concept design in any discipline that requires creativity in visual design tasks. This is also true for early stages of architectural design with multiple stages of ideation, sketching and modelling. In this paper, we investigate how applicable diffusion-based models already are to these tasks. We research the applicability of the platforms Midjourney, DALL $$\cdot$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mo>·</mml:mo> </mml:math> E 2 and Stable Diffusion to a series of common use cases in architectural design to determine which are already solvable or might soon be. Our novel contributions are: (i) a comparison of the capabilities of public AI art platforms; (ii) a specification of the requirements for AI art platforms in supporting common use cases in civil engineering and architecture; (iii) an analysis of 85 million Midjourney queries with Natural Language Processing (NLP) methods to extract common usage patterns. From this we derived (iv) a workflow for creating images for interior designs and (v) a workflow for creating views for exterior design that combines the strengths of the individual platforms.
13
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Learning Transferable Visual Models From Natural Language Supervision
Alec Radford, Jong Wook Kim, Chris Hallacy et al. · arXiv (Cornell University) · 2021 · 5.3K citations · Full text
Image Super-Resolution Via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022 · 1.6K citations · Full text
Palette: Image-to-Image Diffusion Models
Chitwan Saharia, William Chan, Huiwen Chang et al. · 2022 · 1.5K citations · Full text