English
Related papers

Related papers: Text-to-3D Shape Generation

200 papers

The recent progress of text-to-image generation has been recognized in architectural design. Our study is the first to investigate the potential of text-to-image generators in supporting creativity during the early stages of the…

Human-Computer Interaction · Computer Science 2024-01-17 Ville Paananen , Jonas Oppenlaender , Aku Visuri

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jaeseok Lee , Jaekoo Lee

The field of deep generative modeling has grown rapidly in the last few years. With the availability of massive amounts of training data coupled with advances in scalable unsupervised learning paradigms, recent large-scale generative models…

This review surveys the state-of-the-art in text-to-image and image-to-image generation within the scope of generative AI. We provide a comparative analysis of three prominent architectures: Variational Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zineb Sordo , Eric Chagnon , Daniela Ushizima

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

Users interact with text, image, code, or other editors on a daily basis. However, machine learning models are rarely trained in the settings that reflect the interactivity between users and their editor. This is understandable as training…

Computation and Language · Computer Science 2023-11-14 Felix Faltings , Michel Galley , Baolin Peng , Kianté Brantley , Weixin Cai , Yizhe Zhang , Jianfeng Gao , Bill Dolan

We present a method for generating colored 3D shapes from natural language. To this end, we first learn joint embeddings of freeform text descriptions and colored 3D shapes. Our model combines and extends learning by association and metric…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Kevin Chen , Christopher B. Choy , Manolis Savva , Angel X. Chang , Thomas Funkhouser , Silvio Savarese

Text generation system has made massive promising progress contributed by deep learning techniques and has been widely applied in our life. However, existing end-to-end neural models suffer from the problem of tending to generate…

Artificial Intelligence · Computer Science 2020-03-03 Hao Wang , Bin Guo , Wei Wu , Zhiwen Yu

The rapid progress of large, pretrained models for both visual content generation and 3D reconstruction opens up new possibilities for text-to-3D generation. Intuitively, one could obtain a formidable 3D scene generator if one were able to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hyojun Go , Dominik Narnhofer , Goutam Bhat , Prune Truong , Federico Tombari , Konrad Schindler

Designing 3D scenes is traditionally a challenging task that demands both artistic expertise and proficiency with complex software. Recent advances in text-to-3D generation have greatly simplified this process by letting users create scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zeqi Gu , Yin Cui , Zhaoshuo Li , Fangyin Wei , Yunhao Ge , Jinwei Gu , Ming-Yu Liu , Abe Davis , Yifan Ding

The demand for efficient 3D model generation techniques has grown exponentially, as manual creation of 3D models is time-consuming and requires specialized expertise. While generative models have shown potential in creating 3D textured…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Fanghua Yu , Xintao Wang , Zheyuan Li , Yan-Pei Cao , Ying Shan , Chao Dong

With the rapid advancement of intelligent transportation systems, text-driven image generation and editing techniques have demonstrated significant potential in providing rich, controllable visual scene data for applications such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Feng Lv , Haoxuan Feng , Zilu Zhang , Chunlong Xia , Yanfeng Li

Text-to-3D generation from a single-view image is a popular but challenging task in 3D vision. Although numerous methods have been proposed, existing works still suffer from the inconsistency issues, including 1) semantic inconsistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yichen Ouyang , Wenhao Chai , Jiayi Ye , Dapeng Tao , Yibing Zhan , Gaoang Wang

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

Humankind is entering a novel creative era in which anybody can synthesize digital information using generative artificial intelligence (AI). Text-to-image generation, in particular, has become vastly popular and millions of practitioners…

Computers and Society · Computer Science 2024-09-04 Jonas Oppenlaender

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruihe Wang , Yukang Cao , Kai Han , Kwan-Yee K. Wong

In the world of technology and AI, digital models play an important role in our lives and are an essential part of the digital twins of real-world objects. They can be created by designers, artists, or game developers using spline curves…

Graphics · Computer Science 2025-05-20 Rushan Ziatdinov , Rifkat Nabiyev

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler