English
Related papers

Related papers: LangSplat: 3D Language Gaussian Splatting

200 papers

Simultaneous Localization and Mapping (SLAM) based on 3D Gaussian Splats (3DGS) has recently shown promise towards more accurate, dense 3D scene maps. However, existing 3DGS-based methods fail to address the global consistency of the scene…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Liyuan Zhu , Yue Li , Erik Sandström , Shengyu Huang , Konrad Schindler , Iro Armeni

We introduce GenSync, a novel framework for multi-identity lip-synced video synthesis using 3D Gaussian Splatting. Unlike most existing 3D methods that require training a new model for each identity , GenSync learns a unified network that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Anushka Agarwal , Muhammad Yusuf Hassan , Talha Chafekar

Simultaneous Localization and Mapping (SLAM) with 3D Gaussian Splatting (3DGS) enables fast, differentiable rendering and high-fidelity reconstruction across diverse real-world scenes. However, existing 3DGS-SLAM approaches handle…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Anh Thuan Tran , Jana Kosecka

Recent advancements in 3D Gaussian Splatting (3DGS) have demonstrated its potential for efficient and photorealistic 3D reconstructions, which is crucial for diverse applications such as robotics and immersive media. However, current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Daheng Yin , Isaac Ding , Yili Jin , Jianxin Shi , Jiangchuan Liu

While the field of 3D scene reconstruction is dominated by NeRFs due to their photorealistic quality, 3D Gaussian Splatting (3DGS) has recently emerged, offering similar quality with real-time rendering speeds. However, both methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jonas Kulhanek , Songyou Peng , Zuzana Kukelova , Marc Pollefeys , Torsten Sattler

Real-time talking head synthesis increasingly relies on deformable 3D Gaussian Splatting (3DGS) due to its low latency. Tri-planes are the standard choice for encoding Gaussians prior to deformation, since they provide a continuous domain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Arpita Saggar , Jonathan C. Darling , Duygu Sarikaya , David C. Hogg

Recently, the multi-modal fusion of RGB, depth, and semantics has shown great potential in dense Simultaneous Localization and Mapping (SLAM). However, a prerequisite for generating consistent semantic maps is the availability of dense,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Linfei Li , Lin Zhang , Zhong Wang , Ying Shen

We propose Hier-SLAM, a semantic 3D Gaussian Splatting SLAM method featuring a novel hierarchical categorical representation, which enables accurate global 3D semantic mapping, scaling-up capability, and explicit semantic label prediction…

Robotics · Computer Science 2025-03-11 Boying Li , Zhixi Cai , Yuan-Fang Li , Ian Reid , Hamid Rezatofighi

Recent advancements in radiance fields have opened new avenues for creating high-quality 3D assets and scenes. Style transfer can enhance these 3D assets with diverse artistic styles, transforming creative expression. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Sahil Jain , Avik Kuthiala , Prabhdeep Singh Sethi , Prakanshul Saxena

Recent advancements in 3D scene understanding have made significant strides in enabling interaction with scenes using open-vocabulary queries, particularly for VR/AR and robotic applications. Nevertheless, existing methods are hindered by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Dianyi Yang , Xihan Wang , Yu Gao , Shiyang Liu , Bohan Ren , Yufeng Yue , Yi Yang

Reconstructing dynamic driving scenes is essential for developing autonomous systems through sensor-realistic simulation. Although recent methods achieve high-fidelity reconstructions, they either rely on costly human annotations for object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Carl Lindström , Mahan Rafidashti , Maryam Fatemi , Lars Hammarstrand , Martin R. Oswald , Lennart Svensson

3D Gaussian Splatting (3D-GS) has emerged as a significant advancement in the field of Computer Graphics, offering explicit scene representation and novel view synthesis without the reliance on neural networks, such as Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ben Fei , Jingyi Xu , Rui Zhang , Qingyuan Zhou , Weidong Yang , Ying He

In this work, we propose a method that leverages CLIP feature distillation, achieving efficient 3D segmentation through language guidance. Unlike previous methods that rely on multi-scale CLIP features and are limited by processing speed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xingyu Miao , Haoran Duan , Yang Bai , Tejal Shah , Jun Song , Yang Long , Rajiv Ranjan , Ling Shao

Recent advancements in camera-based occupancy prediction have focused on the simultaneous prediction of 3D semantics and scene flow, a task that presents significant challenges due to specific difficulties, e.g., occlusions and unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ziyue Zhu , Shenlong Wang , Jin Xie , Jiang-jiang Liu , Jingdong Wang , Jian Yang

The ability for robots to perform efficient and zero-shot grasping of object parts is crucial for practical applications and is becoming prevalent with recent advances in Vision-Language Models (VLMs). To bridge the 2D-to-3D gap for…

Robotics · Computer Science 2024-09-04 Mazeyu Ji , Ri-Zhao Qiu , Xueyan Zou , Xiaolong Wang

3D scene representations have gained immense popularity in recent years. Methods that use Neural Radiance fields are versatile for traditional tasks such as novel view synthesis. In recent times, some work has emerged that aims to extend…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Shijie Zhou , Haoran Chang , Sicheng Jiang , Zhiwen Fan , Zehao Zhu , Dejia Xu , Pradyumna Chari , Suya You , Zhangyang Wang , Achuta Kadambi

Reconstructing 3D scenes from multiple viewpoints is a fundamental task in stereo vision. Recently, advances in generalizable 3D Gaussian Splatting have enabled high-quality novel view synthesis for unseen scenes from sparse input views by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shengji Tang , Weicai Ye , Peng Ye , Weihao Lin , Yang Zhou , Tao Chen , Wanli Ouyang

Understanding a 3D scene immediately with its exploration is essential for embodied tasks, where an agent must construct and comprehend the 3D scene in an online and nearly real-time manner. In this study, we propose EmbodiedSplat, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Seungjun Lee , Zihan Wang , Yunsong Wang , Gim Hee Lee

While neural 3D reconstruction has advanced substantially, its performance significantly degrades with sparse-view data, which limits its broader applicability, since SfM is often unreliable in sparse-view scenarios where feature matches…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhiwen Fan , Wenyan Cong , Kairun Wen , Kevin Wang , Jian Zhang , Xinghao Ding , Danfei Xu , Boris Ivanovic , Marco Pavone , Georgios Pavlakos , Zhangyang Wang , Yue Wang

3D Gaussian Splatting achieves high-fidelity novel view synthesis, but its application to online long-sequence scenarios is still limited. Existing methods either rely on slow per-scene optimization or fail to provide efficient incremental…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Guichen Huang , Ruoyu Wang , Xiangjun Gao , Che Sun , Yuwei Wu , Shenghua Gao , Yunde Jia