English
Related papers

Related papers: EndoGSim: Physics-Aware 4D Dynamic Endoscopic Scen…

200 papers

High-fidelity reconstruction of deformable tissues from endoscopic videos remains challenging due to the limitations of existing methods in capturing subtle color variations and modeling global deformations. While 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Qun Ji , Peng Li , Mingqiang Wei

3D Gaussian Splatting (3DGS) has recently gained popularity for efficient scene rendering by representing scenes as explicit sets of anisotropic 3D Gaussians. However, most existing work focuses primarily on modeling external surfaces. In…

Image and Video Processing · Electrical Eng. & Systems 2026-01-12 Shuxin Liang , Yihan Xiao , Wenlu Tang

The scalability of robotic learning is fundamentally bottlenecked by the significant cost and labor of real-world data collection. While simulated data offers a scalable alternative, it often fails to generalize to the real world due to…

Real-time reconstruction of deformable surgical scenes is vital for advancing robotic surgery, improving surgeon guidance, and enabling automation. Recent methods achieve dense reconstructions from da Vinci robotic surgery videos, with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Tianyi Song , Danail Stoyanov , Evangelos Mazomenos , Francisco Vasconcelos

Recent advancements in 3D generation models have opened new possibilities for simulating dynamic 3D object movements and customizing behaviors, yet creating this content remains challenging. Current methods often require manual assignment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Haoyu Zhao , Hao Wang , Xingyue Zhao , Hao Fei , Hongqiu Wang , Chengjiang Long , Hua Zou

Visual simultaneous localization and mapping (V-SLAM) is a fundamental capability for autonomous perception and navigation. However, endoscopic scenes violate the rigidity assumption due to persistent soft-tissue deformations, creating a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Jiwei Shan , Zeyu Cai , Yirui Li , Yongbo Chen , Lijun Han , Yun-hui Liu , Hesheng Wang , Shing Shin Cheng

Surgical reconstruction of dynamic tissues from endoscopic videos is a crucial technology in robot-assisted surgery. The development of Neural Radiance Fields (NeRFs) has greatly advanced deformable tissue reconstruction, achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Wenfeng Huang , Xiangyun Liao , Yinling Qian , Hao Liu , Yongming Yang , Wenjing Jia , Qiong Wang

Robot-assisted minimally invasive surgery benefits from enhancing dynamic scene reconstruction, as it improves surgical outcomes. While Neural Radiance Fields (NeRF) have been effective in scene reconstruction, their slow inference speeds…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Haoyu Zhao , Xingyue Zhao , Lingting Zhu , Weixi Zheng , Yongchao Xu

3D Gaussian Splatting (3DGS) has emerged as a prominent 3D representation for high-fidelity and real-time rendering. Prior work has coupled physics simulation with Gaussians, but predominantly targets soft, deformable materials, leaving…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Bei Huang , Yixin Chen , Ruijie Lu , Gang Zeng , Hongbin Zha , Yuru Pei , Siyuan Huang

Gaussian splatting has emerged as a powerful tool for high-fidelity reconstruction of dynamic scenes. However, existing methods primarily rely on implicit motion representations, such as encoding motions into neural networks or per-Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinyu Zhang , Haonan Chang , Yuhan Liu , Abdeslam Boularias

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Guanjun Wu , Taoran Yi , Jiemin Fang , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Qi Tian , Xinggang Wang

High-fidelity reconstruction of surgical scene is a fundamentally crucial task to support many applications, such as intra-operative navigation and surgical education. However, most existing methods assume the ideal surgical scenarios -…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Qian Li , Shuojue Yang , Daiyun Shen , Jimmy Bok Yan So , Jing Qin , Yueming Jin

Implicit neural representation has paved the way for new approaches to dynamic scene reconstruction and rendering. Nonetheless, cutting-edge dynamic neural rendering methods rely heavily on these implicit representations, which frequently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Xinyu Gao , Wen Zhou , Shaohui Jiao , Yuqing Zhang , Xiaogang Jin

3D reconstruction of biological tissues from a collection of endoscopic images is a key to unlock various important downstream surgical applications with 3D capabilities. Existing methods employ various advanced neural rendering techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Chenxin Li , Brandon Y. Feng , Yifan Liu , Hengyu Liu , Cheng Wang , Weihao Yu , Yixuan Yuan

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziwen Li , Jiaxin Huang , Runnan Chen , Yunlong Che , Yandong Guo , Tongliang Liu , Fakhri Karray , Mingming Gong

Simultaneous localization and mapping (SLAM) technology has recently achieved photorealistic mapping capabilities thanks to the real-time, high-fidelity rendering enabled by 3D Gaussian Splatting (3DGS). However, due to the static…

Robotics · Computer Science 2025-12-01 Zhicong Sun , Jacqueline Lo , Jinxing Hu

Dynamic scene reconstruction has garnered significant attention in recent years due to its capabilities in high-quality and real-time rendering. Among various methodologies, constructing a 4D spatial-temporal representation, such as 4D-GS,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weiwei Cai , Weicai Ye , Peng Ye , Tong He , Tao Chen

Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Rui Song , Chenwei Liang , Yan Xia , Walter Zimmer , Hu Cao , Holger Caesar , Andreas Festag , Alois Knoll

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li