English
Related papers

Related papers: Rethinking Layered Graphic Design Generation with …

200 papers

3D scene generation plays a crucial role in gaming, artistic creation, virtual reality, and many other domains. However, current 3D scene design still relies heavily on extensive manual effort from creators, and existing automated methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Zixuan Bian , Ruohan Ren , Yue Yang , Chris Callison-Burch

Traditional visualisation designers often start with sketches before implementation. With generative AI, these sketches can be turned into AI-generated visualisations using specific prompts. However, guiding AI to create compelling visuals…

Human-Computer Interaction · Computer Science 2024-09-04 Aron E. Owen , Jonathan C. Roberts

Graphic design forms the cornerstone of modern visual communication, serving as a vital medium for promoting cultural and commercial events. Recent advances have explored automating this process using Large Multimodal Models (LMMs), yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Jiazhe Wei , Ken Li , Tianyu Lao , Haofan Wang , Liang Wang , Caifeng Shan , Chenyang Si

Humans paint images incrementally: they plan a global layout, sketch a coarse draft, inspect, and refine details, and most importantly, each step is grounded in the evolving visual states. However, can unified multimodal models trained on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Lei Zhang , Junjiao Tian , Zhipeng Fan , Kunpeng Li , Jialiang Wang , Weifeng Chen , Markos Georgopoulos , Felix Juefei-Xu , Yuxiang Bao , Julian McAuley , Manling Li , Zecheng He

Text-based prompting remains the predominant interaction paradigm in generative AI, yet it often introduces friction for novice users such as small business owners (SBOs), who struggle to articulate creative goals in domain-specific…

Human-Computer Interaction · Computer Science 2025-04-23 Nimisha Karnatak , Adrien Baranes , Rob Marchant , Huinan Zeng , Tríona Butler , Kristen Olson

Deep learning has recently been applied to various research areas of design optimization. This study presents the need and effectiveness of adopting deep learning for generative design (or design exploration) research area. This work…

Machine Learning · Computer Science 2020-05-27 Sangeun Oh , Yongsu Jung , Seongsin Kim , Ikjin Lee , Namwoo Kang

Generative AI, specifically text-to-image models, have revolutionized interior architectural design by enabling the rapid translation of conceptual ideas into visual representations from simple text prompts. While generative AI can produce…

Human-Computer Interaction · Computer Science 2025-06-19 Richa Gupta , Alexander Htet Kyaw

AI technologies are moving rapidly from research to production. With the popularity of Foundation Models (FMs) that generate text, images, and video, AI-based systems are increasing their complexity. Compared to traditional AI-based…

Software Engineering · Computer Science 2024-12-03 Orlando Marquez Ayala , Patrice Béchard

Generative AI (GenAI) models excel in their ability to recognize patterns in existing data and generate new and unexpected content. Recent advances have motivated applications of GenAI tools (e.g., Stable Diffusion, ChatGPT) to professional…

Human-Computer Interaction · Computer Science 2023-06-05 Matthew K. Hong , Shabnam Hakimi , Yan-Ying Chen , Heishiro Toyoda , Charlene Wu , Matt Klenk

The emergence of 3D artificial intelligence-generated content (3D-AIGC) has enabled rapid synthesis of intricate geometries. However, a fundamental disconnect persists between AI-generated content and human-centric design paradigms, rooted…

Graphics · Computer Science 2025-08-29 Xiaoyang Huang , Bingbing Ni , Wenjun Zhang

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

Generative artificial intelligence (GenAI) can rapidly produce large and diverse volumes of content. This lends to it a quality of creativity which can be empowering in the early stages of design. In seeking to understand how creative ways…

Human-Computer Interaction · Computer Science 2024-03-20 Gionnieve Lim , Simon T. Perrault

In this paper, we present DesignDiffusion, a simple yet effective framework for the novel task of synthesizing design images from textual descriptions. A primary challenge lies in generating accurate and style-consistent textual and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zhendong Wang , Jianmin Bao , Shuyang Gu , Dong Chen , Wengang Zhou , Houqiang Li

Professional designers work from client briefs that specify goals and constraints but often lack concrete design details. Translating these abstract requirements into visual designs poses a central challenge, yet existing tools address…

Human-Computer Interaction · Computer Science 2026-04-14 Kotaro Kikuchi , Nami Ogawa

Unified Vision-Language Models (UVLMs) aim to advance multimodal learning by supporting both understanding and generation within a single framework. However, existing approaches largely focus on architectural unification while overlooking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Shengqiong Wu , Bobo Li , Xinkai Wang , Xiangtai Li , Lei Cui , Furu Wei , Shuicheng Yan , Hao Fei , Tat-seng Chua

We present Thinking with Generated Images, a novel paradigm that fundamentally transforms how large multimodal models (LMMs) engage with visual reasoning by enabling them to natively think across text and vision modalities through…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Ethan Chern , Zhulin Hu , Steffi Chern , Siqi Kou , Jiadi Su , Yan Ma , Zhijie Deng , Pengfei Liu

Modeling layout is an important first step for graphic design. Recently, methods for generating graphic layouts have progressed, particularly with Generative Adversarial Networks (GANs). However, the problem of specifying the locations and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jianan Li , Jimei Yang , Jianming Zhang , Chang Liu , Christina Wang , Tingfa Xu

Creating large-scale interactive 3D environments is essential for the development of Robotics and Embodied AI research. Current methods, including manual design, procedural generation, diffusion-based scene generation, and large language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yian Wang , Xiaowen Qiu , Jiageng Liu , Zhehuan Chen , Jiting Cai , Yufei Wang , Tsun-Hsuan Wang , Zhou Xian , Chuang Gan

The efficiency of multi-agent systems driven by large language models (LLMs) largely hinges on their communication topology. However, designing an optimal topology is a non-trivial challenge, as it requires balancing competing objectives…

Computation and Language · Computer Science 2026-05-19 Eric Hanchen Jiang , Mengting Li , Guancheng Wan , Sophia Yin , Yuchen Wu , Xiao Liang , Xinfeng Li , Yizhou Sun , Wei Wang , Kai-Wei Chang , Ying Nian Wu

Graphic design is essential for visual communication with layouts being fundamental to composing attractive designs. Layout generation differs from pixel-level image synthesis and is unique in terms of the requirement of mutual relations…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Hsin-Ying Lee , Lu Jiang , Irfan Essa , Phuong B Le , Haifeng Gong , Ming-Hsuan Yang , Weilong Yang