English
Related papers

Related papers: Realistic Surgical Image Dataset Generation Based …

200 papers

Dense simultaneous localization and mapping (SLAM) is crucial for robotics and augmented reality applications. However, current methods are often hampered by the non-volumetric or implicit way they represent a scene. This work introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Nikhil Keetha , Jay Karhade , Krishna Murthy Jatavallabhula , Gengshan Yang , Sebastian Scherer , Deva Ramanan , Jonathon Luiten

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mustafa Khan , Hamidreza Fazlali , Dhruv Sharma , Tongtong Cao , Dongfeng Bai , Yuan Ren , Bingbing Liu

The advent of 3D Gaussian Splatting (3D-GS) techniques and their dynamic scene modeling variants, 4D-GS, offers promising prospects for real-time rendering of dynamic surgical scenarios. However, the prerequisite for modeling dynamic scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Hengyu Liu , Yifan Liu , Chenxin Li , Wuyang Li , Yixuan Yuan

Ensuring the safety of autonomous robots, such as self-driving vehicles, requires extensive testing across diverse driving scenarios. Simulation is a key ingredient for conducting such testing in a cost-effective and scalable way. Neural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Georg Hess , Carl Lindström , Maryam Fatemi , Christoffer Petersson , Lennart Svensson

Sim-to-Real refers to the process of transferring policies learned in simulation to the real world, which is crucial for achieving practical robotics applications. However, recent Sim2real methods either rely on a large amount of augmented…

Robotics · Computer Science 2025-02-25 Yuxuan Wu , Lei Pan , Wenhua Wu , Guangming Wang , Yanzi Miao , Fan Xu , Hesheng Wang

3D scene reconstruction from stereo endoscopic video data is crucial for advancing surgical interventions. In this work, we present an online framework for online, dense 3D scene reconstruction and tracking, aimed at enhancing surgical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Michel Hayoz , Christopher Hahne , Thomas Kurmann , Max Allan , Guido Beldi , Daniel Candinas , ablo Márquez-Neila , Raphael Sznitman

In this paper, we present a novel geometry-aware RGB-D Gaussian Splatting SLAM system, named G2S-ICP SLAM. The proposed method performs high-fidelity 3D reconstruction and robust camera pose tracking in real-time by representing each scene…

Robotics · Computer Science 2025-07-25 Gyuhyeon Pak , Hae Min Cho , Euntai Kim

High-Fidelity 3D scene reconstruction plays a crucial role in autonomous driving by enabling novel data generation from existing datasets. This allows simulating safety-critical scenarios and augmenting training datasets without incurring…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Pou-Chun Kung , Skanda Harisha , Ram Vasudevan , Aline Eid , Katherine A. Skinner

3D Gaussian Splatting has recently emerged as a powerful representation that can synthesize remarkable novel views using consistent multi-view images as input. However, we notice that images captured in dark environments where the scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Sheng Ye , Zhen-Hui Dong , Yubin Hu , Yu-Hui Wen , Yong-Jin Liu

Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an important role in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Parth Rawal , Mrunal Sompura , Wolfgang Hintze

Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Quentin Herau , Moussab Bennehar , Arthur Moreau , Nathan Piasco , Luis Roldao , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Empowering 3D Gaussian Splatting with generalization ability is appealing. However, existing generalizable 3D Gaussian Splatting methods are largely confined to narrow-range interpolation between stereo images due to their heavy backbones,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yunsong Wang , Tianxin Huang , Hanlin Chen , Gim Hee Lee

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for generating photorealistic renderings of a scene in real-time. However, the volumetric nature of 3DGS limits its ability to accurately capture surface geometry. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Prajwal Gupta C. R. , Divyam Sheth , Jinjoo Ha , Mirela Ostrek , Justus Thies

This paper presents a novel approach to image-goal navigation by integrating 3D Gaussian Splatting (3DGS) with Visual Navigation Models (VNMs), a method we refer to as GSplatVNM. VNMs offer a promising paradigm for image-goal navigation by…

Robotics · Computer Science 2025-07-29 Kohei Honda , Takeshi Ishita , Yasuhiro Yoshimura , Ryo Yonetani

Gaussian Splatting (GS) offers a promising alternative to Neural Radiance Fields (NeRF) for real-time 3D scene rendering. Using a set of 3D Gaussians to represent complex geometry and appearance, GS achieves faster rendering times and…

Multimedia · Computer Science 2025-06-18 Pedro Martin , António Rodrigues , João Ascenso , Maria Paula Queluz

Complete reconstruction of surgical scenes is crucial for robot-assisted surgery (RAS). Deep depth estimation is promising but existing works struggle with depth discontinuities, resulting in noisy predictions at object boundaries and do…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Xu Wang , Shuai Zhang , Baoru Huang , Danail Stoyanov , Evangelos B. Mazomenos

We present a novel approach for enhancing the resolution and geometric fidelity of 3D Gaussian Splatting (3DGS) beyond native training resolution. Current 3DGS methods are fundamentally limited by their input resolution, producing…

Graphics · Computer Science 2025-06-10 Shuja Khalid , Mohamed Ibrahim , Yang Liu

3D Gaussian Splatting (3DGS) has shown promising results for 3D scene modeling using mixtures of Gaussians, yet its existing simultaneous localization and mapping (SLAM) variants typically rely on direct, deterministic pose optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yuhan Zhu , Yanyu Zhang , Jie Xu , Wei Ren

Recent advancements in radiance field rendering show promising results in 3D scene representation, where Gaussian splatting-based techniques emerge as state-of-the-art due to their quality and efficiency. Gaussian splatting is widely used…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Arnab Dey , Cheng-You Lu , Andrew I. Comport , Srinath Sridhar , Chin-Teng Lin , Jean Martinet

In this paper, we present a real-time photo-realistic SLAM method based on marrying Gaussian Splatting with LiDAR-Inertial-Camera SLAM. Most existing radiance-field-based SLAM systems mainly focus on bounded indoor environments, equipped…

Robotics · Computer Science 2025-08-21 Xiaolei Lang , Laijian Li , Chenming Wu , Chen Zhao , Lina Liu , Yong Liu , Jiajun Lv , Xingxing Zuo