English
Related papers

Related papers: Plenodium: UnderWater 3D Scene Reconstruction with…

200 papers

Accurate 3D reconstruction of dynamic surgical scenes from endoscopic video is essential for robotic-assisted surgery. While recent 3D Gaussian Splatting methods have shown promise in achieving high-quality reconstructions with fast…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jialei Chen , Xin Zhang , Mobarakol Islam , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

We propose Panoptic Lifting, a novel approach for learning panoptic 3D volumetric representations from images of in-the-wild scenes. Once trained, our model can render color images together with 3D-consistent panoptic segmentation from…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Yawar Siddiqui , Lorenzo Porzi , Samuel Rota Buló , Norman Müller , Matthias Nießner , Angela Dai , Peter Kontschieder

Mobile robots operating indoors must be prepared to navigate challenging scenes that contain transparent surfaces. This paper proposes a novel method for the fusion of acoustic and visual sensing modalities through implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Advaith V. Sethuraman , Onur Bagoren , Harikrishnan Seetharaman , Dalton Richardson , Joseph Taylor , Katherine A. Skinner

Understanding geometric, semantic, and instance information in 3D scenes from sequential video data is essential for applications in robotics and augmented reality. However, existing Simultaneous Localization and Mapping (SLAM) methods…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Runnan Chen , Zhaoqing Wang , Jiepeng Wang , Yuexin Ma , Mingming Gong , Wenping Wang , Tongliang Liu

Panoramic image enables deeper understanding and more holistic perception of $360^\circ$ surrounding environment, which can naturally encode enriched scene context information compared to standard perspective image. Previous work has made…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuan Dong , Chuan Fang , Liefeng Bo , Zilong Dong , Ping Tan

Underwater scene reconstruction poses a substantial challenge because of the intricate interplay between light and the medium, resulting in scattering and absorption effects that make both depth estimation and rendering more complex. While…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shuyi Hu , Qi Liu

In this paper, we rethink the problem of scene reconstruction from an embodied agent's perspective: While the classic view focuses on the reconstruction accuracy, our new perspective emphasizes the underlying functions and constraints such…

Robotics · Computer Science 2021-03-31 Muzhi Han , Zeyu Zhang , Ziyuan Jiao , Xu Xie , Yixin Zhu , Song-Chun Zhu , Hangxin Liu

Three-dimensional Gaussian Splatting (3DGS) has recently emerged as an efficient representation for novel-view synthesis, achieving impressive visual quality. However, in scenes dominated by large and low-texture regions, common in indoor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Xirui Jin , Renbiao Jin , Boying Li , Danping Zou , Wenxian Yu

This work addresses the problem of recovering complete, simulatable object geometry from reconstructed real-world scenes, enabling physics-based interaction with objects embedded in the scene. While modern multi-view reconstruction methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xin Dong , Weijian Deng , Lihan Zhang , Tianru Dai , Wenfeng Deng , Yansong Tang

Underwater perception and 3D surface reconstruction are challenging problems with broad applications in construction, security, marine archaeology, and environmental monitoring. Treacherous operating conditions, fragile surroundings, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mohamad Qadri , Kevin Zhang , Akshay Hinduja , Michael Kaess , Adithya Pediredla , Christopher A. Metzler

Performing single image holistic understanding and 3D reconstruction is a central task in computer vision. This paper presents an integrated system that performs dense scene labeling, object detection, instance segmentation, depth…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sainan Liu , Vincent Nguyen , Yuan Gao , Subarna Tripathi , Zhuowen Tu

We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum-position entanglement and photon-number correlations to provide the…

A depth map can be represented by a set of learned bases and can be efficiently solved in a closed form solution. However, one issue with this method is that it may create artifacts when colour boundaries are inconsistent with depth…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Yiran Zhong , Yuchao Dai , Hongdong Li

Scene reconstruction has emerged as a central challenge in computer vision, with approaches such as Neural Radiance Fields (NeRF) and Gaussian Splatting achieving remarkable progress. While Gaussian Splatting demonstrates strong performance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Alexander Valverde , Brian Xu , Yuyin Zhou , Meng Xu , Hongyun Wang

To reconstruct a 3D scene from a set of calibrated views, traditional multi-view stereo techniques rely on two distinct stages: local depth maps computation and global depth maps fusion. Recent studies concentrate on deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Jaesung Choe , Sunghoon Im , Francois Rameau , Minjun Kang , In So Kweon

Estimating precise metric depth and scene reconstruction from monocular endoscopy is a fundamental task for surgical navigation in robotic surgery. However, traditional stereo matching adopts binocular images to perceive the depth…

Robotics · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Fangxun Zhong , Yonghao Long , Qi Dou , Yun-Hui Liu , Dong Sun

In this study, we address the challenge of 3D scene structure recovery from monocular depth estimation. While traditional depth estimation methods leverage labeled datasets to directly predict absolute depth, recent advancements advocate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chi Zhang , Wei Yin , Gang Yu , Zhibin Wang , Tao Chen , Bin Fu , Joey Tianyi Zhou , Chunhua Shen

3D scanning is a complex multistage process that generates a point cloud of an object typically containing damaged parts due to occlusions, reflections, shadows, scanner motion, specific properties of the object surface, imperfect…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Taras Rumezhak , Oles Dobosevych , Rostyslav Hryniv , Vladyslav Selotkin , Volodymyr Karpiv , Mykola Maksymenko

Underwater monocular SLAM is a challenging problem with applications from autonomous underwater vehicles to marine archaeology. However, existing underwater SLAM methods struggle to produce maps with high-fidelity rendering. In this paper,…

Robotics · Computer Science 2026-04-07 Kangxu Wang , Shaofeng Zou , Chenxing Jiang , Yixiang Dai , Siang Chen , Shaojie Shen , Guijin Wang

In the fields of photogrammetry, computer vision and computer graphics, the task of neural 3D scene reconstruction has led to the exploration of various techniques. Among these, 3D Gaussian Splatting stands out for its explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Miriam Jäger , Theodor Kapler , Michael Feßenbecker , Felix Birkelbach , Markus Hillemann , Boris Jutzi