English
Related papers

Related papers: 4-LEGS: 4D Language Embedded Gaussian Splatting

200 papers

The modeling and manipulation of 3D scenes captured from the real world are pivotal in various applications, attracting growing research interest. While previous works on editing have achieved interesting results through manipulating 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Guan Luo , Tian-Xing Xu , Ying-Tian Liu , Xiao-Xiong Fan , Fang-Lue Zhang , Song-Hai Zhang

Recently, 3D Gaussian splatting has gained attention for its capability to generate high-fidelity rendering results. At the same time, most applications such as games, animation, and AR/VR use mesh-based representations to represent and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jaehoon Choi , Yonghan Lee , Hyungtae Lee , Heesung Kwon , Dinesh Manocha

3D Gaussian Splatting (3DGS) has recently emerged as an innovative and efficient 3D representation technique. While its potential for extended reality (XR) applications is frequently highlighted, its practical effectiveness remains…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Shi Qiu , Binzhu Xie , Qixuan Liu , Pheng-Ann Heng

Dynamic scene rendering has taken a leap forward with the rise of 4D Gaussian Splatting, but there's still one elusive challenge: how to make 3D Gaussians move through time as naturally as they would in the real world, all while keeping the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Junli Deng , Yihao Luo

Latent scene representation plays a significant role in training reinforcement learning (RL) agents. To obtain good latent vectors describing the scenes, recent works incorporate the 3D-aware latent-conditioned NeRF pipeline into scene…

Robotics · Computer Science 2024-09-30 Jiaxu Wang , Ziyi Zhang , Qiang Zhang , Jia Li , Jingkai Sun , Mingyuan Sun , Junhao He , Renjing Xu

Human activities are inherently complex, often involving numerous object interactions. To better understand these activities, it is crucial to model their interactions with the environment captured through dynamic changes. The recent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Daiwei Zhang , Gengyan Li , Jiajie Li , Mickaël Bressieux , Otmar Hilliges , Marc Pollefeys , Luc Van Gool , Xi Wang

Recent advances in Gaussian Splatting have enabled fast, high-fidelity 3D scene generation, yet these methods remain purely visual and lack an understanding of how shapes behave in the physical world. We introduce Physics-Guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zachary Lee , Maxwell Jacobson , Yexiang Xue

Reconstructing a 3D scene from images is challenging due to the different ways light interacts with surfaces depending on the viewer's position and the surface's material. In classical computer graphics, materials can be classified as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Mateusz Nowak , Wojciech Jarosz , Peter Chin

Gaussian Splatting (GS) has become one of the most important neural rendering algorithms. GS represents 3D scenes using Gaussian components with trainable color and opacity. This representation achieves high-quality renderings with fast…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Krzysztof Byrski , Grzegorz Wilczyński , Weronika Smolak-Dyżewska , Piotr Borycki , Dawid Baran , Sławomir Tadeja , Przemysław Spurek

Differentiable rendering techniques have recently shown promising results for free-viewpoint video synthesis of characters. However, such methods, either Gaussian Splatting or neural implicit rendering, typically necessitate per-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Boyao Zhou , Shunyuan Zheng , Hanzhang Tu , Ruizhi Shao , Boning Liu , Shengping Zhang , Liqiang Nie , Yebin Liu

This paper presents Planar Gaussian Splatting (PGS), a novel neural rendering approach to learn the 3D geometry and parse the 3D planes of a scene, directly from multiple RGB images. The PGS leverages Gaussian primitives to model the scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Farhad G. Zanjani , Hong Cai , Hanno Ackermann , Leila Mirvakhabova , Fatih Porikli

Gaussian Splatting (GS) has recently emerged as an efficient representation for rendering 3D scenes from 2D images and has been extended to images, videos, and dynamic 4D content. However, applying style transfer to GS-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Kornel Howil , Joanna Waczyńska , Piotr Borycki , Tadeusz Dziarmaga , Marcin Mazur , Przemysław Spurek

Recently, 3D Gaussian splatting (3D-GS) has gained popularity in novel-view scene synthesis. It addresses the challenges of lengthy training times and slow rendering speeds associated with Neural Radiance Fields (NeRFs). Through rapid,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Sharath Girish , Kamal Gupta , Abhinav Shrivastava

Modeling 3D language fields with Gaussian Splatting for open-ended language queries has recently garnered increasing attention. However, recent 3DGS-based models leverage view-dependent 2D foundation models to refine 3D semantics but lack a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Chenlu Zhan , Yufei Zhang , Gaoang Wang , Hongwei Wang

3D Gaussian splatting (3D-GS) has recently revolutionized novel view synthesis in the simultaneous localization and mapping (SLAM) problem. However, most existing algorithms fail to fully capture the underlying structure, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Tianci Wen , Zhiang Liu , Yongchun Fang

3D Gaussian Splatting (3DGS) has emerged as a prominent technique with the potential to become a mainstream method for 3D representations. It can effectively transform multi-view images into explicit 3D Gaussian through efficient training,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Yanqi Bao , Tianyu Ding , Jing Huo , Yaoli Liu , Yuxin Li , Wenbin Li , Yang Gao , Jiebo Luo

Generating high-quality novel view renderings of 3D Gaussian Splatting (3DGS) in scenes featuring transient objects is challenging. We propose a novel hybrid representation, termed as HybridGS, using 2D Gaussians for transient objects per…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jingyu Lin , Jiaqi Gu , Lubin Fan , Bojian Wu , Yujing Lou , Renjie Chen , Ligang Liu , Jieping Ye

3D Gaussian Splatting (3DGS) has become horsepower in high-quality, real-time rendering for novel view synthesis of 3D scenes. However, existing methods focus primarily on geometric and appearance modeling, lacking deeper scene…

Graphics · Computer Science 2025-07-01 Minchao Jiang , Shunyu Jia , Jiaming Gu , Xiaoyuan Lu , Guangming Zhu , Anqi Dong , Liang Zhang

We introduce GaussianCut, a new method for interactive multiview segmentation of scenes represented as 3D Gaussians. Our approach allows for selecting the objects to be segmented by interacting with a single view. It accepts intuitive user…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Umangi Jain , Ashkan Mirzaei , Igor Gilitschenski

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu