English
Related papers

Related papers: GSMem: 3D Gaussian Splatting as Persistent Spatial…

200 papers

Achieving real-time Simultaneous Localization and Mapping (SLAM) based on 3D Gaussian splatting (3DGS) in large-scale real-world environments remains challenging, as existing methods still struggle to jointly achieve low-latency pose…

Humans naturally retain memories of permanent elements, while ephemeral moments often slip through the cracks of memory. This selective retention is crucial for robotic perception, localization, and mapping. To endow robots with this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Yiming Li , Zehong Wang , Yue Wang , Zhiding Yu , Zan Gojcic , Marco Pavone , Chen Feng , Jose M. Alvarez

In this paper, we propose a RGB-D SLAM system that reconstructs a language-aligned dense feature field while sustaining low-latency tracking and mapping. First, we introduce a Top-K Rendering pipeline, a high-throughput and…

Robotics · Computer Science 2026-02-10 Seongbo Ha , Sibaek Lee , Kyungsu Kang , Joonyeol Choi , Seungjun Tak , Hyeonwoo Yu

Recent advancements in 3D Gaussian Splatting have significantly improved the efficiency and quality of dense semantic SLAM. However, previous methods are generally constrained by limited-category pre-trained classifiers and implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Dianyi Yang , Yu Gao , Xihan Wang , Yufeng Yue , Yi Yang , Mengyin Fu

3D Gaussian Splatting (3DGS) has recently emerged as a fast, high-quality method for novel view synthesis (NVS). However, its use of low-degree spherical harmonics limits its ability to capture spatially varying color and view-dependent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Hoang Chuong Nguyen , Wei Mao , Jose M. Alvarez , Miaomiao Liu

We present a dense simultaneous localization and mapping (SLAM) method that uses 3D Gaussians as a scene representation. Our approach enables interactive-time reconstruction and photo-realistic rendering from real-world single-camera RGBD…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Vladimir Yugay , Yue Li , Theo Gevers , Martin R. Oswald

3D Gaussian Splatting has recently gained traction for its efficient training and real-time rendering. While its vanilla representation is mainly designed for view synthesis, recent works extended it to scene understanding with language…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siyun Liang , Sen Wang , Kunyi Li , Michael Niemeyer , Stefano Gasperini , Hendrik P. A. Lensch , Nassir Navab , Federico Tombari

3D Gaussian Splatting offers expressive scene reconstruction, modeling a broad range of visual, geometric, and semantic information. However, efficient real-time map reconstruction with data streamed from multiple robots and devices remains…

Robotics · Computer Science 2025-06-04 Javier Yu , Timothy Chen , Mac Schwager

Experience Goal Visual Rearrangement task stands as a foundational challenge within Embodied AI, requiring an agent to construct a robust world model that accurately captures the goal state. The agent uses this world model to restore a…

Robotics · Computer Science 2024-12-18 Arjun P S , Andrew Melnik , Gora Chand Nandi

Simultaneous Localization and Mapping (SLAM) is a foundational component in robotics, AR/VR, and autonomous systems. With the rising focus on spatial AI in recent years, combining SLAM with semantic understanding has become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jisang Yoo , Gyeongjin Kang , Hyun-kyu Ko , Hyeonwoo Yu , Eunbyung Park

Semantic-aware 3D scene reconstruction is essential for autonomous robots to perform complex interactions. Semantic SLAM, an online approach, integrates pose tracking, geometric reconstruction, and semantic mapping into a unified framework,…

Robotics · Computer Science 2025-05-20 Zuxing Lu , Xin Yuan , Shaowen Yang , Jingyu Liu , Changyin Sun

Recently, several studies have combined Gaussian Splatting to obtain scene representations with language embeddings for open-vocabulary 3D scene understanding. While these methods perform well, they essentially require very dense multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jun Hu , Zhang Chen , Zhong Li , Yi Xu , Juyong Zhang

Dense simultaneous localization and mapping (SLAM) is crucial for robotics and augmented reality applications. However, current methods are often hampered by the non-volumetric or implicit way they represent a scene. This work introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Nikhil Keetha , Jay Karhade , Krishna Murthy Jatavallabhula , Gengshan Yang , Sebastian Scherer , Deva Ramanan , Jonathon Luiten

Traditional SLAM algorithms excel at camera tracking, but typically produce incomplete and low-resolution maps that are not tightly integrated with semantics prediction. Recent work integrates Gaussian Splatting (GS) into SLAM to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingqi Jiang , Chanho Kim , Chen Ziwen , Li Fuxin

This survey comprehensively reviews the evolving field of multi-robot collaborative Simultaneous Localization and Mapping (SLAM) using 3D Gaussian Splatting (3DGS). As an explicit scene representation, 3DGS has enabled unprecedented…

Robotics · Computer Science 2025-10-29 Phuc Nguyen Xuan , Thanh Nguyen Canh , Huu-Hung Nguyen , Nak Young Chong , Xiem HoangVan

Spatial memory, or the ability to remember and recall specific locations and objects, is central to autonomous agents' ability to carry out tasks in real environments. However, most existing artificial memory modules are not very adept at…

Robotics · Computer Science 2021-02-18 Daniel Lenton , Stephen James , Ronald Clark , Andrew J. Davison

Embodied intelligence requires precise reconstruction and rendering to simulate large-scale real-world data. Although 3D Gaussian Splatting (3DGS) has recently demonstrated high-quality results with real-time performance, it still faces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haodong Xiang , Xinghui Li , Kai Cheng , Xiansong Lai , Wanting Zhang , Zhichao Liao , Long Zeng , Xueping Liu

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

Recently, generalizable human Gaussian splatting from sparse-view inputs has been actively studied for the photorealistic human rendering. Most existing methods rely on explicit geometric constraints or predefined structural representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jingi Kim , Wonjun Kim

We present a real-time tracking SLAM system that unifies efficient camera tracking with photorealistic feature-enriched mapping using 3D Gaussian Splatting (3DGS). Our main contribution is integrating dense feature rasterization into the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Christopher Thirgood , Oscar Mendez , Erin Ling , Jon Storey , Simon Hadfield