English
Related papers

Related papers: Registering Neural 4D Gaussians for Endoscopic Sur…

200 papers

Gaussian splatting has emerged as a powerful tool for high-fidelity reconstruction of dynamic scenes. However, existing methods primarily rely on implicit motion representations, such as encoding motions into neural networks or per-Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinyu Zhang , Haonan Chang , Yuhan Liu , Abdeslam Boularias

3D Gaussian Splatting is emerging as a state-of-the-art technique in novel view synthesis, recognized for its impressive balance between visual quality, speed, and rendering efficiency. However, reliance on third-degree spherical harmonics…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yiwen Wang , Siyuan Chen , Ran Yi

Implicit Neural Representation (INR) has demonstrated remarkable advances in the field of image representation but demands substantial GPU resources. GaussianImage recently pioneered the use of Gaussian Splatting to mitigate this cost,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhaojie Zeng , Yuesong Wang , Chao Yang , Tao Guan , Lili Ju

Recently, high-fidelity scene reconstruction with an optimized 3D Gaussian splat representation has been introduced for novel view synthesis from sparse image sets. Making such representations suitable for applications like network…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Simon Niedermayr , Josef Stumpfegger , Rüdiger Westermann

High-fidelity 3D reconstruction of common indoor scenes is crucial for VR and AR applications. 3D Gaussian splatting, a novel differentiable rendering technique, has achieved state-of-the-art novel view synthesis results with high rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Matias Turkulainen , Xuqian Ren , Iaroslav Melekhov , Otto Seiskari , Esa Rahtu , Juho Kannala

While neural rendering has demonstrated impressive capabilities in 3D scene reconstruction and novel view synthesis, it heavily relies on high-quality sharp images and accurate camera poses. Numerous approaches have been proposed to train…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Lingzhe Zhao , Peng Wang , Peidong Liu

In robot-assisted minimally invasive surgery, accurate 3D reconstruction from endoscopic video is vital for downstream tasks and improved outcomes. However, endoscopic scenarios present unique challenges, including photometric…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Taoyu Wu , Yiyi Miao , Jiaxin Guo , Ziyan Chen , Sihang Zhao , Zhuoxiao Li , Zhe Tang , Baoru Huang , Limin Yu

Recent 4D dynamic scene editing methods require editing thousands of 2D images used for dynamic scene synthesis and updating the entire scene with additional training loops, resulting in several hours of processing to edit a single dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Joohyun Kwon , Hanbyel Cho , Junmo Kim

Spike cameras, as an innovative neuromorphic camera that captures scenes with the 0-1 bit stream at 40 kHz, are increasingly employed for the 3D reconstruction task via Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS). Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Kang Chen , Jiyuan Zhang , Zecheng Hao , Yajing Zheng , Tiejun Huang , Zhaofei Yu

Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities since their data association usually relies on feature correspondences. Additionally, learning-based SLAM systems often fall short in terms of real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhongche Qu , Zhi Zhang , Cong Liu , Jianhua Yin

We present GaSpCT, a novel view synthesis and 3D scene representation method used to generate novel projection views for Computer Tomography (CT) scans. We adapt the Gaussian Splatting framework to enable novel view synthesis in CT based on…

Image and Video Processing · Electrical Eng. & Systems 2024-04-05 Emmanouil Nikolakakis , Utkarsh Gupta , Jonathan Vengosh , Justin Bui , Razvan Marinescu

In medical image visualization, path tracing of volumetric medical data like CT scans produces lifelike three-dimensional visualizations. Immersive VR displays can further enhance the understanding of complex anatomies. Going beyond the…

Graphics · Computer Science 2026-01-30 Constantin Kleinbeck , Hannah Schieber , Klaus Engel , Ralf Gutjahr , Daniel Roth

We present GSLoc: a new visual localization method that performs dense camera alignment using 3D Gaussian Splatting as a map representation of the scene. GSLoc backpropagates pose gradients over the rendering pipeline to align the rendered…

Robotics · Computer Science 2024-10-10 Kazii Botashev , Vladislav Pyatov , Gonzalo Ferrer , Stamatios Lefkimmiatis

Scene reconstruction and novel-view synthesis for large, complex, multi-story, indoor scenes is a challenging and time-consuming task. Prior methods have utilized drones for data capture and radiance fields for scene reconstruction, both of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yuanbo Chen , Chengyu Zhang , Jason Wang , Xuefan Gao , Avideh Zakhor

High-quality novel view synthesis for large-scale scenes presents a challenging dilemma in 3D computer vision. Existing methods typically partition large scenes into multiple regions, reconstruct a 3D representation using Gaussian splatting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xiaohan Zhang , Sitong Wang , Yushen Yan , Yi Yang , Mingda Xu , Qi Liu

Capturing and re-animating the 3D structure of articulated objects present significant barriers. On one hand, methods requiring extensively calibrated multi-view setups are prohibitively complex and resource-intensive, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Heng Yu , Joel Julin , Zoltán Á. Milacski , Koichiro Niinuma , László A. Jeni

Recent advancements in high-fidelity dynamic scene reconstruction have leveraged dynamic 3D Gaussians and 4D Gaussian Splatting for realistic scene representation. However, to make these methods viable for real-time applications such as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Saqib Javed , Ahmad Jarrar Khan , Corentin Dumery , Chen Zhao , Mathieu Salzmann

In contemporary surgical research and practice, accurately comprehending 3D surgical scenes with text-promptable capabilities is particularly crucial for surgical planning and real-time intra-operative guidance, where precisely identifying…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Yiming Huang , Long Bai , Beilei Cui , Kun Yuan , Guankun Wang , Mobarak I. Hoque , Nicolas Padoy , Nassir Navab , Hongliang Ren

Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tingxuan Huang , Haowei Zhu , Jun-hai Yong , Hao Pan , Bin Wang

3D Gaussian Splatting (3DGS) has emerged as a promising representation for photorealistic rendering of 3D scenes. However, its high storage requirements pose significant challenges for practical applications. We observe that Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yuang Shi , Simone Gasparini , Géraldine Morin , Chenggang Yang , Wei Tsang Ooi