English
Related papers

Related papers: CLAY: A Controllable Large-scale Generative Model …

200 papers

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. In this work, we propose \textbf{ViewCrafter}, a novel method for synthesizing high-fidelity novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Wangbo Yu , Jinbo Xing , Li Yuan , Wenbo Hu , Xiaoyu Li , Zhipeng Huang , Xiangjun Gao , Tien-Tsin Wong , Ying Shan , Yonghong Tian

Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Rundi Wu , Chang Xiao , Changxi Zheng

Recent years have seen substantial improvements in the ability to generate synthetic 3D objects using AI. However, generating complex 3D objects, such as plants, remains a considerable challenge. Current generative 3D models struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Zane K J Hartley , Lewis A G Stuart , Andrew P French , Michael P Pound

Generative AI has made rapid progress in text, image, and video synthesis, yet text-to-3D modeling for scientific design remains particularly challenging due to limited controllability and high computational cost. Most existing 3D…

Graphics · Computer Science 2026-04-01 Rachel K. Luu , Markus J. Buehler

While recent works have achieved great success on image-to-3D object generation, high quality and fidelity 3D head generation from a single image remains a great challenge. Previous text-based methods for generating 3D heads were limited by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jinkun Hao , Junshu Tang , Jiangning Zhang , Ran Yi , Yijia Hong , Moran Li , Weijian Cao , Yating Wang , Chengjie Wang , Lizhuang Ma

Recent advances in 3D AIGC have shown promise in directly creating 3D objects from text and images, offering significant cost savings in animation and product design. However, detailed edit and customization of 3D assets remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhangyang Qi , Yunhan Yang , Mengchen Zhang , Long Xing , Xiaoyang Wu , Tong Wu , Dahua Lin , Xihui Liu , Jiaqi Wang , Hengshuang Zhao

Despite the remarkable developments achieved by recent 3D generation works, scaling these methods to geographic extents, such as modeling thousands of square kilometers of Earth's surface, remains an open challenge. We address this through…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Shang Liu , Chenjie Cao , Chaohui Yu , Wen Qian , Jing Wang , Fan Wang

We present Density-Sampled Gaussians (DeG), a novel 3D representation designed to bridge the gap between adaptive rendering primitives and scalable generative modeling. Unlike existing approaches that constrain 3D Gaussians to fixed voxel…

Graphics · Computer Science 2026-05-19 Runjie Yan , Yan-Pei Cao , Peng Wang , Ding Liang , Yuan-Chen Guo

Production-level workflows for producing convincing 3D dynamic human faces have long relied on an assortment of labor-intensive tools for geometry and texture generation, motion capture and rigging, and expression synthesis. Recent neural…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Longwen Zhang , Chuxiao Zeng , Qixuan Zhang , Hongyang Lin , Ruixiang Cao , Wei Yang , Lan Xu , Jingyi Yu

Spatial intelligence is foundational to AI systems that interact with the physical world, particularly in 3D scene generation and spatial comprehension. Current methodologies for 3D scene generation often rely heavily on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Libin Liu , Shen Chen , Sen Jia , Jingzhe Shi , Zhongyu Jiang , Can Jin , Wu Zongkai , Jenq-Neng Hwang , Lei Li

We present a significant breakthrough in 3D shape generation by scaling it to unprecedented dimensions. Through the adaptation of the Auto-Regressive model and the utilization of large language models, we have developed a remarkable model…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yu Wang , Xuelin Qian , Jingyang Huo , Tiejun Huang , Bo Zhao , Yanwei Fu

Generating high-quality 3D content from text, single images, or sparse view images remains a challenging task with broad applications. Existing methods typically employ multi-view diffusion models to synthesize multi-view images, followed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junlin Han , Jianyuan Wang , Andrea Vedaldi , Philip Torr , Filippos Kokkinos

In this paper we explore the richness of information captured by the latent space of a vision-based generative model. The model combines unsupervised generative learning with a task-based performance predictor to learn and to exploit…

Machine Learning · Computer Science 2020-10-08 Yizhe Wu , Sudhanshu Kasewa , Oliver Groth , Sasha Salter , Li Sun , Oiwi Parker Jones , Ingmar Posner

Authoring 3D scenes is a central task for spatial computing applications. Competing visions for lowering existing barriers are (1) focus on immersive, direct manipulation of 3D content or (2) leverage AI techniques that capture real scenes…

Human-Computer Interaction · Computer Science 2025-12-29 Cyrus Vachha , Yixiao Kang , Zach Dive , Ashwat Chidambaram , Anik Gupta , Eunice Jun , Bjoern Hartmann

3D animation is central to modern visual media, yet traditional production pipelines remain labor-intensive, expertise-demanding, and computationally expensive. Recent AIGC-based approaches partially automate asset creation and rigging, but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yupeng Zhu , Xiongzhen Zhang , Ye Chen , Bingbing Ni

Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yiqian Wu , Hao Xu , Xiangjun Tang , Xien Chen , Siyu Tang , Zhebin Zhang , Chen Li , Xiaogang Jin

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

The demand for efficient 3D model generation techniques has grown exponentially, as manual creation of 3D models is time-consuming and requires specialized expertise. While generative models have shown potential in creating 3D textured…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Fanghua Yu , Xintao Wang , Zheyuan Li , Yan-Pei Cao , Ying Shan , Chao Dong

3D scene generation has long been dominated by 2D multi-view or video diffusion models. This is due not only to the lack of scene-level 3D latent representation, but also to the fact that most scene-level 3D visual data exists in the form…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dongxu Wei , Qi Xu , Zhiqi Li , Hangning Zhou , Cong Qiu , Hailong Qin , Mu Yang , Zhaopeng Cui , Peidong Liu

Advances in Generative AI tools have allowed designers to manipulate existing 3D models using text or image-based prompts, enabling creators to explore different design goals. Photochromic color-changing systems, on the other hand, allow…

Human-Computer Interaction · Computer Science 2024-04-29 Yunyi Zhu , Faraz Faruqi , Stefanie Mueller