English
Related papers

Related papers: Efficient EndoNeRF Reconstruction and Its Applicat…

200 papers

Neurosurgery interventions involve complex tracking systems because a tissue deformation takesplace. The neuronavigation system relies only on preoperative images. In order to overcome the soft tissue deformations and guarantee the accuracy…

Medical Physics · Physics 2007-10-03 Claudio Lobos , Marek Bucki , Yohan Payan , Nancy Hitschfeld

This paper tackles the challenge of automatically performing realistic surgical simulations from readily available surgical videos. Recent efforts have successfully integrated physically grounded dynamics within 3D Gaussians to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kailing Wang , Chen Yang , Keyang Zhao , Xiaokang Yang , Wei Shen

Robot-assisted minimally invasive surgery benefits from enhancing dynamic scene reconstruction, as it improves surgical outcomes. While Neural Radiance Fields (NeRF) have been effective in scene reconstruction, their slow inference speeds…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Haoyu Zhao , Xingyue Zhao , Lingting Zhu , Weixi Zheng , Yongchao Xu

Neural rendering has garnered substantial attention owing to its capacity for creating realistic 3D scenes. However, its applicability to extensive scenes remains challenging, with limitations in effectiveness. In this work, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Zhihao Jia , Bing Wang , Changhao Chen

In the realm of robot-assisted minimally invasive surgery, dynamic scene reconstruction can significantly enhance downstream tasks and improve surgical outcomes. Neural Radiance Fields (NeRF)-based methods have recently risen to prominence…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yiming Huang , Beilei Cui , Long Bai , Ziqi Guo , Mengya Xu , Mobarakol Islam , Hongliang Ren

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Anish Bhattacharya , Ratnesh Madaan , Fernando Cladera , Sai Vemprala , Rogerio Bonatti , Kostas Daniilidis , Ashish Kapoor , Vijay Kumar , Nikolai Matni , Jayesh K. Gupta

Current methods for 3D reconstruction and environmental mapping frequently face challenges in achieving high precision, highlighting the need for practical and effective solutions. In response to this issue, our study introduces FlyNeRF, a…

Robotics · Computer Science 2024-04-22 Maria Dronova , Vladislav Cheremnykh , Alexey Kotcov , Aleksey Fedoseev , Dzmitry Tsetserukou

Accurate and efficient modeling of soft-tissue interactions is fundamental for advancing surgical simulation, surgical robotics, and model-based surgical automation. To achieve real-time latency, classical Finite Element Method (FEM)…

In minimal invasive surgery, it is important to rebuild and visualize the latest deformed shape of soft-tissue surfaces to mitigate tissue damages. This paper proposes an innovative Simultaneous Localization and Mapping (SLAM) algorithm for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Jingwei Song , Jun Wang , Liang Zhao , Shoudong Huang , Gamini Dissanayake

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

Surgical simulation offers a promising addition to conventional surgical training. However, available simulation tools lack photorealism and rely on hardcoded behaviour. Denoising Diffusion Models are a promising alternative for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yannik Frisch , Ssharvien Kumar Sivakumar , Çağhan Köksal , Elsa Böhm , Felix Wagner , Adrian Gericke , Ghazal Ghazaei , Anirban Mukhopadhyay

Traditional control and task automation have been successfully demonstrated in a variety of structured, controlled environments through the use of highly specialized modeled robotic systems in conjunction with multiple sensors. However, the…

Robotics · Computer Science 2020-02-20 Yang Li , Florian Richter , Jingpei Lu , Emily K. Funk , Ryan K. Orosco , Jianke Zhu , Michael C. Yip

Accurate simulation of brain deformation is a key component for developing realistic, interactive neurosurgical simulators, as complex nonlinear deformations must be captured to ensure realistic tool-tissue interactions. However,…

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Reconstructing and simulating dynamic 3D scenes with both visual realism and physical consistency remains a fundamental challenge. Existing neural representations, such as NeRFs and 3DGS, excel in appearance reconstruction but struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Dan Wang , Xinrui Cui , Serge Belongie , Ravi Ramamoorthi

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Li Ma , Xiaoyu Li , Jing Liao , Qi Zhang , Xuan Wang , Jue Wang , Pedro V. Sander

This paper presents a survey of the state-of-the-art deformable models studied in the literature concerning soft tissue deformable modeling for interactive surgical simulation. It first introduces the challenges of surgical simulation,…

Computational Engineering, Finance, and Science · Computer Science 2019-09-10 Jinao Zhang , Yongmin Zhong , Chengfan Gu

Reconstructing the 3D shape of a deformable environment from the information captured by a moving depth camera is highly relevant to surgery. The underlying challenge is the fact that simultaneously estimating camera motion and tissue…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Guido Caccianiga , Julian Nubert , Cesar Cadena , Marco Hutter , Katherine J. Kuchenbecker

3D neural implicit representations play a significant component in many robotic applications. However, reconstructing neural radiance fields (NeRF) from realistic event data remains a challenge due to the sparsities and the lack of…

Robotics · Computer Science 2024-01-31 Jiaxu Wang , Junhao He , Ziyi Zhang , Renjing Xu