English
Related papers

Related papers: Language-Embedded Gaussian Splats (LEGS): Incremen…

200 papers

Novel view synthesis has seen significant advancements with 3D Gaussian Splatting (3DGS), enabling real-time photorealistic rendering. However, the inherent fuzziness of Gaussian Splatting presents challenges for 3D scene understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Abdalla Arafa , Didier Stricker

3D Gaussian Splatting is renowned for its high-fidelity reconstructions and real-time novel view synthesis, yet its lack of semantic understanding limits object-level perception. In this work, we propose ObjectGS, an object-aware framework…

Graphics · Computer Science 2025-07-22 Ruijie Zhu , Mulin Yu , Linning Xu , Lihan Jiang , Yixuan Li , Tianzhu Zhang , Jiangmiao Pang , Bo Dai

Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Denis Gridusov , Maxim Popov , Sergey Kolyubin

This survey comprehensively reviews the evolving field of multi-robot collaborative Simultaneous Localization and Mapping (SLAM) using 3D Gaussian Splatting (3DGS). As an explicit scene representation, 3DGS has enabled unprecedented…

Robotics · Computer Science 2025-10-29 Phuc Nguyen Xuan , Thanh Nguyen Canh , Huu-Hung Nguyen , Nak Young Chong , Xiem HoangVan

Robots are finding wider adoption in human environments, increasing the need for natural human-robot interaction. However, understanding a natural language command requires the robot to infer the intended task and how to decompose it into…

Robotics · Computer Science 2026-02-05 Julia Kuhn , Francesco Verdoja , Tsvetomila Mihaylova , Ville Kyrki

3D Gaussian Splatting (3DGS) has emerged as a novel explicit representation for 3D scenes, offering both high-fidelity reconstruction and efficient rendering. However, 3DGS lacks 3D segmentation ability, which limits its applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yupeng Zhang , Dezhi Zheng , Ping Lu , Han Zhang , Lei Wang , Liping xiang , Cheng Luo , Kaijun Deng , Xiaowen Fu , Linlin Shen , Jinbao Wang

Capturing 4D spatiotemporal surroundings is crucial for the safe and reliable operation of robots in dynamic environments. However, most existing methods address only one side of the problem: they either provide coarse geometric tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Maximilian Luz , Rohit Mohan , Thomas Nürnberg , Yakov Miron , Daniele Cattaneo , Abhinav Valada

Recent advances in neural rendering have improved both training and rendering times by orders of magnitude. While these methods demonstrate state-of-the-art quality and speed, they are designed for photogrammetry of static scenes and do not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Muhammed Kocabas , Jen-Hao Rick Chang , James Gabriel , Oncel Tuzel , Anurag Ranjan

Language-guided robotic grasping is a rapidly advancing field where robots are instructed using human language to grasp specific objects. However, existing methods often depend on dense camera views and struggle to quickly update scenes,…

Robotics · Computer Science 2024-12-04 Junqiu Yu , Xinlin Ren , Yongchong Gu , Haitao Lin , Tianyu Wang , Yi Zhu , Hang Xu , Yu-Gang Jiang , Xiangyang Xue , Yanwei Fu

Open-vocabulary 3D scene understanding enables users to segment novel objects in complex 3D environments through natural language. However, existing approaches remain slow, memory-intensive, and overly complex due to iterative optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jaehun Bang , Jinhyeok Kim , Minji Kim , Seungheon Jeong , Kyungdon Joo

In this paper, we propose a RGB-D SLAM system that reconstructs a language-aligned dense feature field while sustaining low-latency tracking and mapping. First, we introduce a Top-K Rendering pipeline, a high-throughput and…

Robotics · Computer Science 2026-02-10 Seongbo Ha , Sibaek Lee , Kyungsu Kang , Joonyeol Choi , Seungjun Tak , Hyeonwoo Yu

Tracking objects that move within dynamic environments is a core challenge in robotics. Recent research has advanced this topic significantly; however, many existing approaches remain inefficient due to their reliance on heavy foundation…

Large Language Models (LLM) have emerged as a tool for robots to generate task plans using common sense reasoning. For the LLM to generate actionable plans, scene context must be provided, often through a map. Recent works have shifted from…

Robotics · Computer Science 2024-09-25 Mike Zhang , Kaixian Qu , Vaishakh Patil , Cesar Cadena , Marco Hutter

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziwen Li , Jiaxin Huang , Runnan Chen , Yunlong Che , Yandong Guo , Tongliang Liu , Fakhri Karray , Mingming Gong

Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The ability to detect and disambiguate different objects and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Negar Nejatishahidin , Madhukar Reddy Vongala , Jana Kosecka

3D Language Gaussian Splatting (3DLGS) augments 3D Gaussian Splatting with language-aligned visual features for open-vocabulary 3D scene understanding. A core challenge is efficiently associating high-dimensional vision-language embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Lovre Antonio Budimir , Yushi Guan , Steve Ryhner , Sven Lončarić , Nandita Vijaykumar

Visual localization involves estimating a query image's 6-DoF (degrees of freedom) camera pose, which is a fundamental component in various computer vision and robotic tasks. This paper presents LoGS, a vision-based localization pipeline…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yuzhou Cheng , Jianhao Jiao , Yue Wang , Dimitrios Kanoulas

3D Gaussian Splatting (3DGS) has garnered significant attention in robotics for its explicit, high fidelity dense scene representation, demonstrating strong potential for robotic applications. However, 3DGS-based methods in robotics…

Robotics · Computer Science 2025-03-25 Bin Fu , Jialin Li , Bin Zhang , Ruiping Wang , Xilin Chen

Understanding the geometric and semantic structure of environments is essential for embodied navigation and reasoning. Existing semantic mapping methods trade off between explicit geometry and multi-scale semantics, and lack a native…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Sixian Zhang , Yiyao Wang , Xinhang Song , Keming Zhang , Zijian Xu , Shuqiang Jiang

Accurate open-vocabulary 3D scene understanding requires semantic representations that are both language-aligned and spatially precise at the pixel level, while remaining scalable when lifted to 3D space. However, existing representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Junjie Wen , Junlin He , Fei Ma , Jinqiang Cui