English
Related papers

Related papers: EndoGaussians: Single View Dynamic Gaussian Splatt…

200 papers

Implicit neural representation has paved the way for new approaches to dynamic scene reconstruction and rendering. Nonetheless, cutting-edge dynamic neural rendering methods rely heavily on these implicit representations, which frequently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Xinyu Gao , Wen Zhou , Shaohui Jiao , Yuqing Zhang , Xiaogang Jin

Robot-assisted minimally invasive surgery benefits from enhancing dynamic scene reconstruction, as it improves surgical outcomes. While Neural Radiance Fields (NeRF) have been effective in scene reconstruction, their slow inference speeds…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Haoyu Zhao , Xingyue Zhao , Lingting Zhu , Weixi Zheng , Yongchao Xu

Real-time reconstruction of deformable surgical scenes is vital for advancing robotic surgery, improving surgeon guidance, and enabling automation. Recent methods achieve dense reconstructions from da Vinci robotic surgery videos, with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Tianyi Song , Danail Stoyanov , Evangelos Mazomenos , Francisco Vasconcelos

Efficient and high-fidelity reconstruction of deformable surgical scenes is a critical yet challenging task. Building on recent advancements in 3D Gaussian splatting, current methods have seen significant improvements in both reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jiwei Shan , Zeyu Cai , Cheng-Tai Hsieh , Shing Shin Cheng , Hesheng Wang

Complete reconstruction of surgical scenes is crucial for robot-assisted surgery (RAS). Deep depth estimation is promising but existing works struggle with depth discontinuities, resulting in noisy predictions at object boundaries and do…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Xu Wang , Shuai Zhang , Baoru Huang , Danail Stoyanov , Evangelos B. Mazomenos

Dynamic scene reconstruction has garnered significant attention in recent years due to its capabilities in high-quality and real-time rendering. Among various methodologies, constructing a 4D spatial-temporal representation, such as 4D-GS,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weiwei Cai , Weicai Ye , Peng Ye , Tong He , Tao Chen

In this work, we propose a novel clothed human reconstruction method called GaussianBody, based on 3D Gaussian Splatting. Compared with the costly neural radiance based models, 3D Gaussian Splatting has recently demonstrated great…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Mengtian Li , Shengxiang Yao , Zhifeng Xie , Keyu Chen

Image-based 3D reconstruction is a challenging task that involves inferring the 3D shape of an object or scene from a set of input images. Learning-based methods have gained attention for their ability to directly estimate 3D shapes. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Anurag Dalal , Daniel Hagen , Kjell G. Robbersmyr , Kristian Muri Knausgård

Previous surface reconstruction methods either suffer from low geometric accuracy or lengthy training times when dealing with real-world complex dynamic scenes involving multi-person activities, and human-object interactions. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Shuo Wang , Binbin Huang , Ruoyu Wang , Shenghua Gao

3D Gaussian Splatting (GS) enables highly photorealistic scene reconstruction from posed image sequences but struggles with viewpoint extrapolation due to its anisotropic nature, leading to overfitting and poor generalization, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shuohan Tao , Boyao Zhou , Hanzhang Tu , Yuwang Wang , Yebin Liu

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

Accurate 3D reconstruction of colonoscopy data, accounting for complex peristaltic movements, is crucial for advanced surgical navigation and retrospective diagnostics. While recent novel view synthesis and 3D reconstruction methods have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Weronika Smolak-Dyżewska , Joanna Kaleta , Diego Dall'Alba , Przemysław Spurek

We introduce GeoGS3D, a novel two-stage framework for reconstructing detailed 3D objects from single-view images. Inspired by the success of pre-trained 2D diffusion models, our method incorporates an orthogonal plane decomposition…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Qijun Feng , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for generating photorealistic renderings of a scene in real-time. However, the volumetric nature of 3DGS limits its ability to accurately capture surface geometry. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Prajwal Gupta C. R. , Divyam Sheth , Jinjoo Ha , Mirela Ostrek , Justus Thies

As 3D Gaussian Splatting (3DGS) provides fast and high-quality novel view synthesis, it is a natural extension to deform a canonical 3DGS to multiple frames for representing a dynamic scene. However, previous works fail to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Jeongmin Bae , Seoha Kim , Youngsik Yun , Hahyun Lee , Gun Bang , Youngjung Uh

While the field of 3D scene reconstruction is dominated by NeRFs due to their photorealistic quality, 3D Gaussian Splatting (3DGS) has recently emerged, offering similar quality with real-time rendering speeds. However, both methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jonas Kulhanek , Songyou Peng , Zuzana Kukelova , Marc Pollefeys , Torsten Sattler

We present the first application of 3D Gaussian Splatting in monocular SLAM, the most fundamental but the hardest setup for Visual SLAM. Our method, which runs live at 3fps, utilises Gaussians as the only 3D representation, unifying the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hidenobu Matsuki , Riku Murai , Paul H. J. Kelly , Andrew J. Davison

Real2Sim is becoming increasingly important with the rapid development of surgical artificial intelligence (AI) and autonomy. In this work, we propose a novel Real2Sim methodology, Instrument-Splatting, that leverages 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Shuojue Yang , Zijian Wu , Mingxuan Hong , Qian Li , Daiyun Shen , Septimiu E. Salcudean , Yueming Jin

Reconstructing soft tissues from stereo endoscope videos is an essential prerequisite for many medical applications. Previous methods struggle to produce high-quality geometry and appearance due to their inadequate representations of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ruyi Zha , Xuelian Cheng , Hongdong Li , Mehrtash Harandi , Zongyuan Ge

3D Gaussian Splatting (3DGS) leverages densely distributed Gaussian primitives for high-quality scene representation and reconstruction. While existing 3DGS methods perform well in scenes with minor view variation, large view changes from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chenhao Zhang , Yuanping Cao , Lei Zhang