English
Related papers

Related papers: MagicCraft: Natural Language-Driven Generation of …

200 papers

Generating artistic and coherent 3D scene layouts is crucial in digital content creation. Traditional optimization-based methods are often constrained by cumbersome manual rules, while deep generative models face challenges in producing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xiaoming Zhu , Xu Huang , Qinghongbing Xie , Zhi Deng , Junsheng Yu , Yirui Guan , Zhongyuan Liu , Lin Zhu , Qijun Zhao , Ligang Liu , Long Zeng

Text-to-image generation model is able to generate images across a diverse range of subjects and styles based on a single prompt. Recent works have proposed a variety of interaction methods that help users understand the capabilities of…

Human-Computer Interaction · Computer Science 2023-07-19 Seungho Baek , Hyerin Im , Jiseung Ryu , Juhyeong Park , Takyeon Lee

Text-guided 3D object generation aims to generate 3D objects described by user-defined captions, which paves a flexible way to visualize what we imagined. Although some works have been devoted to solving this challenging task, these works…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zutao Jiang , Guansong Lu , Xiaodan Liang , Jihua Zhu , Wei Zhang , Xiaojun Chang , Hang Xu

Generative language models (LMs) such as GPT-2/3 can be prompted to generate text with remarkable quality. While they are designed for text-prompted generation, it remains an open question how the generation process could be guided by…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yixuan Su , Tian Lan , Yahui Liu , Fangyu Liu , Dani Yogatama , Yan Wang , Lingpeng Kong , Nigel Collier

This paper presents 3Description, an experimental human-AI collaborative approach for intuitive 3D modeling. 3Description aims to address accessibility and usability challenges in traditional 3D modeling by enabling non-professional…

Human-Computer Interaction · Computer Science 2025-06-30 Zhuodi Cai

Despite recent advancements in text-to-image generation, most existing methods struggle to create images with multiple objects and complex spatial relationships in the 3D world. To tackle this limitation, we introduce a generic AI system,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yanbo Ding , Shaobin Zhuang , Kunchang Li , Zhengrong Yue , Yu Qiao , Yali Wang

Generative AI has made image creation more accessible, yet aligning outputs with nuanced creative intent remains challenging, particularly for non-experts. Existing tools often require users to externalize ideas through prompts or…

Human-Computer Interaction · Computer Science 2025-08-11 Daniel Lee , Nikhil Sharma , Donghoon Shin , DaEun Choi , Harsh Sharma , Jeonghwan Kim , Heng Ji

Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image…

Human-Computer Interaction · Computer Science 2023-08-28 Hai Dang , Frederik Brudy , George Fitzmaurice , Fraser Anderson

Existing 3D scene generation methods often struggle to model the complex logical dependencies and physical constraints between objects, limiting their ability to adapt to dynamic and realistic environments. We propose CausalStruct, a novel…

Graphics · Computer Science 2025-09-22 Shen Chen , Ruiyu Zhao , Jiale Zhou , Zongkai Wu , Jenq-Neng Hwang , Lei Li

Advances in Generative AI tools have allowed designers to manipulate existing 3D models using text or image-based prompts, enabling creators to explore different design goals. Photochromic color-changing systems, on the other hand, allow…

Human-Computer Interaction · Computer Science 2024-04-29 Yunyi Zhu , Faraz Faruqi , Stefanie Mueller

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be…

Artificial Intelligence · Computer Science 2023-11-02 Yingchaojie Feng , Xingbo Wang , Kam Kwai Wong , Sijia Wang , Yuhong Lu , Minfeng Zhu , Baicheng Wang , Wei Chen

3D objects (artefacts) are made to fulfill functions. Designing an object often starts with defining a list of functionalities that it should provide, also known as functional requirements. Today, the design of 3D object models is still a…

Artificial Intelligence · Computer Science 2018-10-18 Mihai Andries , Atabak Dehban , José Santos-Victor

A hallmark of human intelligence is the ability to create complex artifacts through structured multi-step processes. Generating procedural tutorials with AI is a longstanding but challenging goal, facing three key obstacles: (1) scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Yiren Song , Cheng Liu , Mike Zheng Shou

Interactive 3D simulated objects are crucial in AR/VR, animations, and robotics, driving immersive experiences and advanced automation. However, creating these articulated objects requires extensive human effort and expertise, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Long Le , Jason Xie , William Liang , Hung-Ju Wang , Yue Yang , Yecheng Jason Ma , Kyle Vedder , Arjun Krishna , Dinesh Jayaraman , Eric Eaton

We introduce CinemaWorld, a generative augmented reality system that augments the viewer's physical surroundings with automatically generated mixed reality 3D content extracted from and synchronized with 2D movie scenes. Our system…

Human-Computer Interaction · Computer Science 2026-03-10 Keiichi Ihara , DaeHo Lee , Manato Abe , Hye-Young Jo , Ryo Suzuki

Although 3D generated content (3DGC) offers advantages in reducing production costs and accelerating design timelines, its quality often falls short when compared to 3D professionally generated content. Common quality issues frequently…

Image and Video Processing · Electrical Eng. & Systems 2024-09-13 Yingjie Zhou , Zicheng Zhang , Farong Wen , Jun Jia , Yanwei Jiang , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

Generative art unlocks boundless creative possibilities, yet its full potential remains untapped due to the technical expertise required for advanced architectural concepts and computational workflows. To bridge this gap, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Duc-Hung Nguyen , Huu-Phuc Huynh , Minh-Triet Tran , Trung-Nghia Le

Amid the surge in generic text-to-video generation, the field of personalized human video generation has witnessed notable advancements, primarily concentrated on single-person scenarios. However, to our knowledge, the domain of two-person…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiancheng Huang , Mingfu Yan , Songyan Chen , Yi Huang , Shifeng Chen

Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets. However, generating 3D compositional objects from single images--particularly under occlusions--remains challenging. Existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hui Shan , Keyang Luo , Ming Li , Sizhe Zheng , Yanwei Fu , Zhen Chen , Xiangru Huang

Image-generation models are changing how we express ourselves in visual art. However, what people think of AI-generated art is still largely unexplored, especially compared to traditional art. In this paper, we present the design of an…

Human-Computer Interaction · Computer Science 2024-05-06 Peter Kun , Matthias Freiberger , Anders Sundnes Løvlie , Sebastian Risi