中文
相关论文

相关论文: Efficient 3D Scene Reconstruction and Simulation f…

200 篇论文

Real2Sim is becoming increasingly important with the rapid development of surgical artificial intelligence (AI) and autonomy. In this work, we propose a novel Real2Sim methodology, Instrument-Splatting, that leverages 3D Gaussian Splatting…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Shuojue Yang , Zijian Wu , Mingxuan Hong , Qian Li , Daiyun Shen , Septimiu E. Salcudean , Yueming Jin

The accurate 3D reconstruction of deformable soft body tissues from endoscopic videos is a pivotal challenge in medical applications such as VR surgery and medical image analysis. Existing methods often struggle with accuracy and the…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Yangsen Chen , Hao Wang

Efficient three-dimensional reconstruction and real-time visualization are critical in surgical scenarios such as endoscopy. In recent years, 3D Gaussian Splatting (3DGS) has demonstrated remarkable performance in efficient 3D…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Taoyu Wu , Yiyi Miao , Zhuoxiao Li , Haocheng Zhao , Kang Dang , Jionglong Su , Limin Yu , Haoang Li

Novel view synthesis for dynamic scenes is still a challenging problem in computer vision and graphics. Recently, Gaussian splatting has emerged as a robust technique to represent static scenes and enable high-quality and real-time novel…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Yi-Hua Huang , Yang-Tian Sun , Ziyi Yang , Xiaoyang Lyu , Yan-Pei Cao , Xiaojuan Qi

The recent advance in neural rendering has enabled the ability to reconstruct high-quality 4D scenes using neural networks. Although 4D neural reconstruction is popular, registration for such representations remains a challenging task,…

机器人学 · 计算机科学 2024-07-30 Yiming Huang , Beilei Cui , Ikemura Kei , Jiekai Zhang , Long Bai , Hongliang Ren

Tissue deformation poses a key challenge for accurate surgical scene reconstruction. Despite yielding high reconstruction quality, existing methods suffer from slow rendering speeds and long training times, limiting their intraoperative…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Shuojue Yang , Qian Li , Daiyun Shen , Bingchen Gong , Qi Dou , Yueming Jin

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

In the realm of robot-assisted minimally invasive surgery, dynamic scene reconstruction can significantly enhance downstream tasks and improve surgical outcomes. Neural Radiance Fields (NeRF)-based methods have recently risen to prominence…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Yiming Huang , Beilei Cui , Long Bai , Ziqi Guo , Mengya Xu , Mobarakol Islam , Hongliang Ren

Previous surface reconstruction methods either suffer from low geometric accuracy or lengthy training times when dealing with real-world complex dynamic scenes involving multi-person activities, and human-object interactions. To tackle the…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Shuo Wang , Binbin Huang , Ruoyu Wang , Shenghua Gao

As a crucial and intricate task in robotic minimally invasive surgery, reconstructing surgical scenes using stereo or monocular endoscopic video holds immense potential for clinical applications. NeRF-based techniques have recently garnered…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Mengya Xu , Ziqi Guo , An Wang , Long Bai , Hongliang Ren

Differentiable 3D Gaussian splatting has emerged as an efficient and flexible rendering technique for representing complex scenes from a collection of 2D views and enabling high-quality real-time novel-view synthesis. However, its reliance…

图形学 · 计算机科学 2025-01-16 Meenakshi Krishnan , Liam Fowl , Ramani Duraiswami

We present a framework that enables fast reconstruction and real-time rendering of urban-scale scenes while maintaining robustness against appearance variations across multi-view captures. Our approach begins with scene partitioning for…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Zhensheng Yuan , Haozhi Huang , Zhen Xiong , Di Wang , Guanghua Yang

High-fidelity 3D reconstruction of common indoor scenes is crucial for VR and AR applications. 3D Gaussian splatting, a novel differentiable rendering technique, has achieved state-of-the-art novel view synthesis results with high rendering…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Matias Turkulainen , Xuqian Ren , Iaroslav Melekhov , Otto Seiskari , Esa Rahtu , Juho Kannala

The modeling and manipulation of 3D scenes captured from the real world are pivotal in various applications, attracting growing research interest. While previous works on editing have achieved interesting results through manipulating 3D…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Guan Luo , Tian-Xing Xu , Ying-Tian Liu , Xiao-Xiong Fan , Fang-Lue Zhang , Song-Hai Zhang

3D Gaussian Splatting reconstructs scenes by starting from a sparse Structure-from-Motion initialization and refining under-reconstructed regions. This process is slow, as it requires multiple densification steps where Gaussians are…

图形学 · 计算机科学 2026-02-13 Dmytro Kotovenko , Olga Grebenkova , Björn Ommer

In this paper, we aim ambitiously for a realistic yet challenging problem, namely, how to reconstruct high-quality 3D scenes from sparse low-resolution views that simultaneously suffer from deficient perspectives and clarity. Whereas…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Yecong Wan , Mingwen Shao , Yuanshuo Cheng , Wangmeng Zuo

Recent developments in 3D Gaussian Splatting have made significant advances in surface reconstruction. However, scaling these methods to large-scale scenes remains challenging due to high computational demands and the complex dynamic…

图形学 · 计算机科学 2025-06-24 Shihan Chen , Zhaojin Li , Zeyu Chen , Qingsong Yan , Gaoyang Shen , Ran Duan

3D Gaussian Splatting (3DGS) has recently gained popularity for efficient scene rendering by representing scenes as explicit sets of anisotropic 3D Gaussians. However, most existing work focuses primarily on modeling external surfaces. In…

图像与视频处理 · 电气工程与系统科学 2026-01-12 Shuxin Liang , Yihan Xiao , Wenlu Tang

Spine surgery is a high-risk intervention demanding precise execution, often supported by image-based navigation systems. Recently, supervised learning approaches have gained attention for reconstructing 3D spinal anatomy from sparse…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Sascha Jecklin , Aidana Massalimova , Ruyi Zha , Lilian Calvet , Christoph J. Laux , Mazda Farshad , Philipp Fürnstahl

Gaussian Splatting (GS) has gained attention as a fast and effective method for novel view synthesis. It has also been applied to 3D reconstruction using multi-view images and can achieve fast and accurate 3D reconstruction. However, GS…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Natsuki Takama , Shintaro Ito , Koichi Ito , Hwann-Tzong Chen , Takafumi Aoki