English
Related papers

Related papers: GaussianAnything: Interactive Point Cloud Flow Mat…

200 papers

Text-driven 3D scene generation has seen significant advancements recently. However, most existing methods generate single-view images using generative models and then stitch them together in 3D space. This independent generation for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Wenrui Li , Fucheng Cai , Yapeng Mi , Zhe Yang , Wangmeng Zuo , Xingtao Wang , Xiaopeng Fan

In this paper, we focus on latent modification and generation of 3D point cloud object models with respect to their semantic parts. Different to the existing methods which use separate networks for part generation and assembly, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Cihan Öngün , Alptekin Temizel

Most 3D scene generation methods are limited to only generating object bounding box parameters while newer diffusion methods also generate class labels and latent features. Using object size or latent feature, they then retrieve objects…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Dasith de Silva Edirimuni , Ajmal Saeed Mian

Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used…

Machine Learning · Computer Science 2019-05-03 Maciej Zamorski , Maciej Zięba , Piotr Klukowski , Rafał Nowak , Karol Kurach , Wojciech Stokowiec , Tomasz Trzciński

Creating 4D fields of Gaussian Splatting from images or videos is a challenging task due to its under-constrained nature. While the optimization can draw photometric reference from the input videos or be regulated by generative models,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Quankai Gao , Qiangeng Xu , Zhe Cao , Ben Mildenhall , Wenchao Ma , Le Chen , Danhang Tang , Ulrich Neumann

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiaxiang Tang , Jiawei Ren , Hang Zhou , Ziwei Liu , Gang Zeng

Generating 3D scenes from natural language holds great promise for applications in gaming, film, and design. However, existing methods struggle with automation, 3D consistency, and fine-grained control. We present DreamScene, an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Haoran Li , Yuli Tian , Kun Lan , Yong Liao , Lin Wang , Pan Hui , Peng Yuan Zhou

In this work, we introduce Prometheus, a 3D-aware latent diffusion model for text-to-3D generation at both object and scene levels in seconds. We formulate 3D scene generation as multi-view, feed-forward, pixel-aligned 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yuanbo Yang , Jiahao Shao , Xinyang Li , Yujun Shen , Andreas Geiger , Yiyi Liao

In recent years, 3D Gaussian splatting has emerged as a powerful technique for 3D reconstruction and generation, known for its fast and high-quality rendering capabilities. To address these shortcomings, this paper introduces a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xianglong He , Junyi Chen , Sida Peng , Di Huang , Yangguang Li , Xiaoshui Huang , Chun Yuan , Wanli Ouyang , Tong He

With the widespread use of virtual reality applications, 3D scene generation has become a new challenging research frontier. 3D scenes have highly complex structures and need to ensure that the output is dense, coherent, and contains all…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xiaolu Hou , Mingcheng Li , Dingkang Yang , Jiawei Chen , Ziyun Qian , Xiao Zhao , Yue Jiang , Jinjie Wei , Qingyao Xu , Lihua Zhang

3D Gaussian Splatting (3DGS) has emerged as a prominent 3D representation for high-fidelity and real-time rendering. Prior work has coupled physics simulation with Gaussians, but predominantly targets soft, deformable materials, leaving…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Bei Huang , Yixin Chen , Ruijie Lu , Gang Zeng , Hongbin Zha , Yuru Pei , Siyuan Huang

Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. However, existing methods primarily focus on embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xihan Wang , Dianyi Yang , Yu Gao , Yufeng Yue , Yi Yang , Mengyin Fu

Image-based 3D generation has vast applications in robotics and gaming, where high-quality, diverse outputs and consistent 3D representations are crucial. However, existing methods have limitations: 3D diffusion models are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ye Tao , Jiawei Zhang , Yahao Shi , Dongqing Zou , Bin Zhou

We propose a novel 3D deepfake generation framework based on 3D Gaussian Splatting that enables realistic, identity-preserving face swapping and reenactment in a fully controllable 3D space. Compared to conventional 2D deepfake approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Wending Liu , Siyun Liang , Huy H. Nguyen , Isao Echizen

This paper investigates an open research task of reconstructing and generating 3D point clouds. Most existing works of 3D generative models directly take the Gaussian prior as input for the decoder to generate 3D point clouds, which fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yunfan Zhang , Hao Wang , Guosheng Lin , Vun Chan Hua Nicholas , Zhiqi Shen , Chunyan Miao

Most recent advances in 3D generative modeling rely on diffusion or flow-matching formulations. We instead explore a fully autoregressive alternative and introduce GaussianGPT, a transformer-based model that directly generates 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Nicolas von Lützow , Barbara Rössle , Katharina Schmid , Matthias Nießner

This paper aims to introduce 3D Gaussian for efficient, expressive, and editable digital avatar generation. This task faces two major challenges: (1) The unstructured nature of 3D Gaussian makes it incompatible with current generation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Weitian Zhang , Yichao Yan , Yunhui Liu , Xingdong Sheng , Xiaokang Yang

The creation of 3D scenes has traditionally been both labor-intensive and costly, requiring designers to meticulously configure 3D assets and environments. Recent advancements in generative AI, including text-to-3D and image-to-3D methods,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Ziyang Yan , Yihua Shao , Minwen Liao , Siyu Chen , Nan Wang , Muyuan Lin , Jenq-Neng Hwang , Hao Zhao , Fabio Remondino , Lei Li

Recently, image-to-3D approaches have significantly advanced the generation quality and speed of 3D assets based on large reconstruction models, particularly 3D Gaussian reconstruction models. Existing large 3D Gaussian models directly map…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Longfei Lu , Huachen Gao , Tao Dai , Yaohua Zha , Zhi Hou , Junta Wu , Shu-Tao Xia