English
Related papers

Related papers: GaussianGPT: Towards Autoregressive 3D Gaussian Sc…

200 papers

We present DirectTriGS, a novel framework designed for 3D object generation with Gaussian Splatting (GS). GS-based rendering for 3D content has gained considerable attention recently. However, there has been limited exploration in directly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaoliang Ju , Hongsheng Li

3D city generation with NeRF-based methods shows promising generation results but is computationally inefficient. Recently 3D Gaussian Splatting (3D-GS) has emerged as a highly efficient alternative for object-level 3D generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

The advent of 3D Gaussian Splatting (3DGS) has recently brought about a revolution in the field of neural rendering, facilitating high-quality renderings at real-time speed. However, 3DGS heavily depends on the initialized point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Kai Cheng , Xiaoxiao Long , Kaizhi Yang , Yao Yao , Wei Yin , Yuexin Ma , Wenping Wang , Xuejin Chen

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for novel view synthesis. However, existing methods struggle to adaptively optimize the distribution of Gaussian primitives based on scene characteristics, making it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Hongbi Zhou , Zhangkai Ni

Conventional wisdom holds that autoregressive models for image generation are typically accompanied by vector-quantized tokens. We observe that while a discrete-valued space can facilitate representing a categorical distribution, it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Tianhong Li , Yonglong Tian , He Li , Mingyang Deng , Kaiming He

3D Gaussian Splatting (3DGS) demonstrates unparalleled superior performance in 3D scene reconstruction. However, 3DGS heavily relies on the sharp images. Fulfilling this requirement can be challenging in real-world scenarios especially when…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yijia Guo , Liwen Hu , Yuanxi Bai , Jiawei Yao , Lei Ma , Tiejun Huang

Modern Generative Adversarial Networks are capable of creating artificial, photorealistic images from latent vectors living in a low-dimensional learned latent space. It has been shown that a wide range of images can be projected into this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Jonas Wulff , Antonio Torralba

The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis. Unlike neural implicit representations like Neural Radiance Fields (NeRF) that represent a 3D scene with position and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Tong Wu , Yu-Jie Yuan , Ling-Xiao Zhang , Jie Yang , Yan-Pei Cao , Ling-Qi Yan , Lin Gao

High-fidelity reconstruction of driving scenes is crucial for autonomous driving. While recent feedforward 3D Gaussian Splatting (3DGS) methods enable fast reconstruction, their per-pixel Gaussian prediction paradigm often suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Cheng Chi , Xianqi Wang , Hongcheng Luo , Mingfei Tu , Gangwei Xu , Zehan Zhang , Bing Wang , Guang Chen , Hangjun Ye , Sida Peng , Xin Yang , Haiyang Sun

Most advances in 3D Generative Adversarial Networks (3D GANs) largely depend on ray casting-based volume rendering, which incurs demanding rendering costs. One promising alternative is rasterization-based 3D Gaussian Splatting (3D-GS),…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Sangeek Hyun , Jae-Pil Heo

Large pretrained diffusion models have significantly enhanced the quality of generated videos, and yet their use in real-time streaming remains limited. Autoregressive models offer a natural framework for sequential frame synthesis but…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jinxiu Liu , Xuanming Liu , Kangfu Mei , Yandong Wen , Ming-Hsuan Yang , Weiyang Liu

We introduce a radiance representation that is both structured and fully explicit and thus greatly facilitates 3D generative modeling. Existing radiance representations either require an implicit feature decoder, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Bowen Zhang , Yiji Cheng , Jiaolong Yang , Chunyu Wang , Feng Zhao , Yansong Tang , Dong Chen , Baining Guo

Autoregressive models excel in efficiency and plug directly into the transformer ecosystem, delivering robust generalization, predictable scalability, and seamless workflows such as fine-tuning and parallelized training. However, they…

Machine Learning · Computer Science 2025-06-13 Samuel Belkadi , Steve Hong , Marian Chen , Miruna Cretu , Charles Harris , Pietro Lio

3D Gaussian Splatting (3DGS) has recently emerged as a pioneering approach in explicit scene rendering and computer graphics. Unlike traditional neural radiance field (NeRF) methods, which typically rely on implicit, coordinate-based models…

3D Gaussian Splatting represents a breakthrough in the field of novel view synthesis. It establishes Gaussians as core rendering primitives for highly accurate real-world environment reconstruction. Recent advances have drastically…

Graphics · Computer Science 2025-06-25 Jonathan Haberl , Philipp Fleck , Clemens Arth

The recent success of 3D Gaussian Splatting (3DGS) has reshaped novel view synthesis by enabling fast optimization and real-time rendering of high-quality radiance fields. However, it relies on simplified, order-dependent alpha blending and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jan U. Müller , Robin Tim Landsgesell , Leif Van Holland , Patrick Stotko , Reinhard Klein

Automatically generating a complete 3D scene from a text description, a reference image, or both has significant applications in fields like virtual reality and gaming. However, current methods often generate low-quality textures and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhexiao Xiong , Zhang Chen , Zhong Li , Yi Xu , Nathan Jacobs

3D Gaussian splatting (3DGS) has recently emerged as an alternative representation that leverages a 3D Gaussian-based representation and introduces an approximated volumetric rendering, achieving very fast rendering speed and promising…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Joo Chan Lee , Daniel Rho , Xiangyu Sun , Jong Hwan Ko , Eunbyung Park

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

The creation of high-quality 3D assets is paramount for applications in digital heritage preservation, entertainment, and robotics. Traditionally, this process necessitates skilled professionals and specialized software for the modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shen Chen , Jiale Zhou , Zhongyu Jiang , Tianfang Zhang , Zongkai Wu , Jenq-Neng Hwang , Lei Li