English
Related papers

Related papers: RoboGSim: A Real2Sim2Real Robotic Gaussian Splatti…

200 papers

Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities since their data association usually relies on feature correspondences. Additionally, learning-based SLAM systems often fall short in terms of real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhongche Qu , Zhi Zhang , Cong Liu , Jianhua Yin

This paper tackles the challenge of automatically performing realistic surgical simulations from readily available surgical videos. Recent efforts have successfully integrated physically grounded dynamics within 3D Gaussians to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kailing Wang , Chen Yang , Keyang Zhao , Xiaokang Yang , Wei Shen

The reliability of Simultaneous Localization and Mapping (SLAM) is severely constrained in environments where visual inputs suffer from noise and low illumination. Although recent 3D Gaussian Splatting (3DGS) based SLAM frameworks achieve…

Robotics · Computer Science 2025-10-28 Huilin Yin , Zhaolin Yang , Linchuan Zhang , Gerhard Rigoll , Johannes Betz

3D Gaussian Splatting is a novel method for 3D view synthesis, which can gain an implicit neural learning rendering result than the traditional neural rendering technology but keep the more high-definition fast rendering speed. But it is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jinwei Lin

The robotics field is evolving towards data-driven, end-to-end learning, inspired by multimodal large models. However, reliance on expensive real-world data limits progress. Simulators offer cost-effective alternatives, but the gap between…

Robotics · Computer Science 2025-12-23 Hongwei Fan , Hang Dai , Jiyao Zhang , Jinzhou Li , Qiyang Yan , Yujie Zhao , Mingju Gao , Jinghang Wu , Hao Tang , Hao Dong

We present the first application of 3D Gaussian Splatting in monocular SLAM, the most fundamental but the hardest setup for Visual SLAM. Our method, which runs live at 3fps, utilises Gaussians as the only 3D representation, unifying the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hidenobu Matsuki , Riku Murai , Paul H. J. Kelly , Andrew J. Davison

Surgical simulation is essential for medical training, enabling practitioners to develop crucial skills in a risk-free environment while improving patient safety and surgical outcomes. However, conventional methods for building simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhenya Yang

Embodied AI research is undergoing a shift toward vision-centric perceptual paradigms. While massively parallel simulators have catalyzed breakthroughs in proprioception-based locomotion, their potential remains largely untapped for…

3D Gaussian Splats (3DGSs) are 3D object models derived from multi-view images. Such "digital twins" are useful for simulations, virtual reality, marketing, robot policy fine-tuning, and part inspection. 3D object scanning usually requires…

Robotics · Computer Science 2025-08-04 Tianshuang Qiu , Zehan Ma , Karim El-Refai , Hiya Shah , Chung Min Kim , Justin Kerr , Ken Goldberg

3D Gaussian Splatting (3DGS) has emerged as a powerful representation due to its efficiency and high-fidelity rendering. 3DGS training requires a known camera pose for each input view, typically obtained by Structure-from-Motion (SfM)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zhen-Hui Dong , Sheng Ye , Yu-Hui Wen , Nannan Li , Yong-Jin Liu

Building generalist robots capable of performing functional grasping in everyday, open-world environments remains a significant challenge due to the vast diversity of objects and tasks. Existing methods are either constrained to narrow…

Robotics · Computer Science 2026-04-10 Chao Tang , Jiacheng Xu , Haofei Lu , Bolin Zou , Wenlong Dong , Hong Zhang , Danica Kragic

3D reconstruction and simulation, although interrelated, have distinct objectives: reconstruction requires a flexible 3D representation that can adapt to diverse scenes, while simulation needs a structured representation to model motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Shaojie Ma , Yawei Luo , Wei Yang , Yi Yang

Compressive video capture encodes a short high-speed video into a single measurement using a low-speed sensor, then computationally reconstructs the original video. Prior implementations rely on expensive hardware and are restricted to…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Kevin Tandi , Xiang Dai , Chinmay Talegaonkar , Gal Mishne , Nick Antipa

Gaussian splatting has emerged as a powerful tool for high-fidelity reconstruction of dynamic scenes. However, existing methods primarily rely on implicit motion representations, such as encoding motions into neural networks or per-Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinyu Zhang , Haonan Chang , Yuhan Liu , Abdeslam Boularias

Dense simultaneous localization and mapping (SLAM) is crucial for robotics and augmented reality applications. However, current methods are often hampered by the non-volumetric or implicit way they represent a scene. This work introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Nikhil Keetha , Jay Karhade , Krishna Murthy Jatavallabhula , Gengshan Yang , Sebastian Scherer , Deva Ramanan , Jonathon Luiten

Gaussian Splatting (GS) has gained attention as a fast and effective method for novel view synthesis. It has also been applied to 3D reconstruction using multi-view images and can achieve fast and accurate 3D reconstruction. However, GS…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Natsuki Takama , Shintaro Ito , Koichi Ito , Hwann-Tzong Chen , Takafumi Aoki

Reconstructing high-fidelity underwater scenes remains a challenging task due to light absorption, scattering, and limited visibility inherent in aquatic environments. This paper presents an enhanced Gaussian Splatting-based framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhuodong Jiang , Haoran Wang , Guoxi Huang , Brett Seymour , Nantheera Anantrasirichai

We introduce GausSim, a novel neural network-based simulator designed to capture the dynamic behaviors of real-world elastic objects represented through Gaussian kernels. We leverage continuum mechanics and treat each kernel as a Center of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yidi Shao , Mu Huang , Chen Change Loy , Bo Dai

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yang Liu , He Guan , Chuanchen Luo , Lue Fan , Naiyan Wang , Junran Peng , Zhaoxiang Zhang

3D Gaussian Splatting has emerged as a transformative technique in novel view synthesis, primarily due to its high rendering speed and photorealistic fidelity. However, its memory footprint scales rapidly with scene complexity, often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Keshav Gupta , Akshat Sanghvi , Shreyas Reddy Palley , Astitva Srivastava , Charu Sharma , Avinash Sharma