English
Related papers

Related papers: Semantic Foam: Unifying Spatial and Semantic Scene…

200 papers

Dynamic scene reconstruction has garnered significant attention in recent years due to its capabilities in high-quality and real-time rendering. Among various methodologies, constructing a 4D spatial-temporal representation, such as 4D-GS,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weiwei Cai , Weicai Ye , Peng Ye , Tong He , Tao Chen

Radiance field methods, such as Neural Radiance Field or 3D Gaussian Splatting, have emerged as seminal 3D representations for synthesizing realistic novel views. For practical applications, there is ongoing research on flexible scene…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Ji Hyun Seo , Byounhyun Yoo , Gerard Jounghyun Kim

Scene reconstruction has emerged as a central challenge in computer vision, with approaches such as Neural Radiance Fields (NeRF) and Gaussian Splatting achieving remarkable progress. While Gaussian Splatting demonstrates strong performance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Alexander Valverde , Brian Xu , Yuyin Zhou , Meng Xu , Hongyun Wang

Recent advancements in camera-based occupancy prediction have focused on the simultaneous prediction of 3D semantics and scene flow, a task that presents significant challenges due to specific difficulties, e.g., occlusions and unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ziyue Zhu , Shenlong Wang , Jin Xie , Jiang-jiang Liu , Jingdong Wang , Jian Yang

Recent advancements in 3D Gaussian Splatting have significantly improved the efficiency and quality of dense semantic SLAM. However, previous methods are generally constrained by limited-category pre-trained classifiers and implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Dianyi Yang , Yu Gao , Xihan Wang , Yufeng Yue , Yi Yang , Mengyin Fu

Scene representations using 3D Gaussian primitives have produced excellent results in modeling the appearance of static and dynamic 3D scenes. Many graphics applications, however, demand the ability to manipulate both the appearance and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ri-Zhao Qiu , Ge Yang , Weijia Zeng , Xiaolong Wang

3D Gaussian Splatting has recently gained traction for its efficient training and real-time rendering. While its vanilla representation is mainly designed for view synthesis, recent works extended it to scene understanding with language…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siyun Liang , Sen Wang , Kunyi Li , Michael Niemeyer , Stefano Gasperini , Hendrik P. A. Lensch , Nassir Navab , Federico Tombari

Existing NeRF-based methods for large scene reconstruction often have limitations in visual quality and rendering speed. While the recent 3D Gaussian Splatting works well on small-scale and object-centric scenes, scaling it up to large…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiaqi Lin , Zhihao Li , Xiao Tang , Jianzhuang Liu , Shiyong Liu , Jiayue Liu , Yangdi Lu , Xiaofei Wu , Songcen Xu , Youliang Yan , Wenming Yang

3D Gaussian Splatting has recently emerged as a highly promising technique for modeling of static 3D scenes. In contrast to Neural Radiance Fields, it utilizes efficient rasterization allowing for very fast rendering at high-quality.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wieland Morgenstern , Florian Barthel , Anna Hilsmann , Peter Eisert

We have introduced SegSplat, a novel framework designed to bridge the gap between rapid, feed-forward 3D reconstruction and rich, open-vocabulary semantic understanding. By constructing a compact semantic memory bank from multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Peter Siegel , Federico Tombari , Marc Pollefeys , Daniel Barath

3D semantic occupancy prediction aims to obtain 3D fine-grained geometry and semantics of the surrounding scene and is an important task for the robustness of vision-centric autonomous driving. Most existing methods employ dense grids such…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yuanhui Huang , Wenzhao Zheng , Yunpeng Zhang , Jie Zhou , Jiwen Lu

We introduce a differentiable 3D representation that unifies the ray tracing capabilities of foam-based ray tracing with the efficiency of modern rasterization pipelines. While prior foam representations enable constant-time ray traversal…

We present a dense simultaneous localization and mapping (SLAM) method that uses 3D Gaussians as a scene representation. Our approach enables interactive-time reconstruction and photo-realistic rendering from real-world single-camera RGBD…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Vladimir Yugay , Yue Li , Theo Gevers , Martin R. Oswald

Reconstructing intricate, ever-changing environments remains a central ambition in computer vision, yet existing solutions often crumble before the complexity of real-world dynamics. We present DynaSplat, an approach that extends Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Junli Deng , Ping Shi , Qipei Li , Jinyang Guo

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Dynamic reconstruction of deformable tissues in endoscopic video is a key technology for robot-assisted surgery. Recent reconstruction methods based on neural radiance fields (NeRFs) have achieved remarkable results in the reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Weixing Xie , Junfeng Yao , Xianpeng Cao , Qiqin Lin , Zerui Tang , Xiao Dong , Xiaohu Guo

Representing and rendering dynamic scenes from 2D images is a fundamental yet challenging problem in computer vision and graphics. This survey provides a comprehensive review of the evolution and advancements in dynamic scene representation…

Graphics · Computer Science 2025-03-12 Jiaxuan Zhu , Hao Tang

Differentiable 3D Gaussian splatting has emerged as an efficient and flexible rendering technique for representing complex scenes from a collection of 2D views and enabling high-quality real-time novel-view synthesis. However, its reliance…

Graphics · Computer Science 2025-01-16 Meenakshi Krishnan , Liam Fowl , Ramani Duraiswami

Gaussian splatting enables fast novel view synthesis in static 3D environments. However, reconstructing real-world environments remains challenging as distractors or occluders break the multi-view consistency assumption required for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yihao Wang , Marcus Klasson , Matias Turkulainen , Shuzhe Wang , Juho Kannala , Arno Solin

We present SGS-SLAM, the first semantic visual SLAM system based on Gaussian Splatting. It incorporates appearance, geometry, and semantic features through multi-channel optimization, addressing the oversmoothing limitations of neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Mingrui Li , Shuhong Liu , Heng Zhou , Guohao Zhu , Na Cheng , Tianchen Deng , Hongyu Wang