English
Related papers

Related papers: Physical Priors Augmented Event-Based 3D Reconstru…

200 papers

With the advent of Neural Radiance Field (NeRF), representing 3D scenes through multiple observations has shown remarkable improvements in performance. Since this cutting-edge technique is able to obtain high-resolution renderings by…

Robotics · Computer Science 2023-09-18 Minjae Lee , Kyeongsu Kang , Hyeonwoo Yu

Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging. The generic reconstruction methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sandika Biswas , Qianyi Wu , Biplab Banerjee , Hamid Rezatofighi

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Neural fields excel in computer vision and robotics due to their ability to understand the 3D visual world such as inferring semantics, geometry, and dynamics. Given the capabilities of neural fields in densely representing a 3D scene from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Muhammad Zubair Irshad , Sergey Zakharov , Vitor Guizilini , Adrien Gaidon , Zsolt Kira , Rares Ambrus

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

Neural Radiance Field (NeRF), as an implicit 3D scene representation, lacks inherent ability to accommodate changes made to the initial static scene. If objects are reconfigured, it is difficult to update the NeRF to reflect the new state…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziqi Lu , Jianbo Ye , Xiaohan Fei , Xiaolong Li , Jiawei Mo , Ashwin Swaminathan , Stefano Soatto

Identifying spatially complete planar primitives from visual data is a crucial task in computer vision. Prior methods are largely restricted to either 2D segment recovery or simplifying 3D structures, even with extensive plane annotations.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zheng Chen , Qingan Yan , Huangying Zhan , Changjiang Cai , Xiangyu Xu , Yuzhong Huang , Weihan Wang , Ziyue Feng , Yi Xu , Lantao Liu

Neural radiance fields (NeRFs) are a deep learning technique that can generate novel views of 3D scenes using sparse 2D images from different viewing directions and camera poses. As an extension of conventional NeRFs in underwater…

Computational Engineering, Finance, and Science · Computer Science 2024-07-12 Haojie Lian , Xinhao Li , Yilin Qu , Jing Du , Zhuxuan Meng , Jie Liu , Leilei Chen

The problem of inferring object shape from a single 2D image is underconstrained. Prior knowledge about what objects are plausible can help, but even given such prior knowledge there may still be uncertainty about the shapes of occluded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Matthew D. Hoffman , Tuan Anh Le , Pavel Sountsov , Christopher Suter , Ben Lee , Vikash K. Mansinghka , Rif A. Saurous

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Christina Tsalicoglou , Keisuke Tateno , Jonathan T. Barron , Federico Tombari

While neural radiance fields (NeRF) led to a breakthrough in photorealistic novel view synthesis, handling mirroring surfaces still denotes a particular challenge as they introduce severe inconsistencies in the scene representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Leif Van Holland , Michael Weinmann , Jan U. Müller , Patrick Stotko , Reinhard Klein

Reconstruction of rigid motion over large spatiotemporal scales remains a challenging task due to limitations in modeling paradigms, severe motion blur, and insufficient physical consistency. In this work, we propose PEGS, a framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yijun Xu , Jingrui Zhang , Hongyi Liu , Yuhan Chen , Yuanyang Wang , Qingyao Guo , Dingwen Wang , Lei Yu , Chu He

In this paper, we tackle the problem of active robotic 3D reconstruction of an object. In particular, we study how a mobile robot with an arm-held camera can select a favorable number of views to recover an object's 3D shape efficiently.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Soomin Lee , Le Chen , Jiahao Wang , Alexander Liniger , Suryansh Kumar , Fisher Yu

Neural Radiance Fields (NeRF) have achieved impressive results in 3D reconstruction and novel view generation. A significant challenge within NeRF involves editing reconstructed 3D scenes, such as object removal, which demands consistency…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zhihao Guo , Peng Wang

Recent advances in neural rendering have enabled highly photorealistic 3D scene reconstruction and novel view synthesis. Despite this progress, current state-of-the-art methods struggle to reconstruct high frequency detail, due to factors…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sibi Catley-Chandar , Richard Shaw , Gregory Slabaugh , Eduardo Perez-Pellitero

3D surface reconstruction from multi-view images is essential for scene understanding and interaction. However, complex indoor scenes pose challenges such as ambiguity due to limited observations. Recent implicit surface representations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xulong Wang , Siyan Dong , Youyi Zheng , Yanchao Yang

Neural Radiance Fields (NeRFs) have emerged as a groundbreaking paradigm for representing 3D objects and scenes by encoding shape and appearance information into the weights of a neural network. Recent studies have demonstrated that these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Francesco Ballerini , Pierluigi Zama Ramirez , Luigi Di Stefano , Samuele Salti

In the realm of digital situational awareness during disaster situations, accurate digital representations, like 3D models, play an indispensable role. To ensure the safety of rescue teams, robotic platforms are often deployed to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Hartmut Surmann , Niklas Digakis , Jan-Nicklas Kremer , Julien Meine , Max Schulte , Niklas Voigt

Neural Radiance Fields (NeRFs) increase reconstruction detail for novel view synthesis and scene reconstruction, with applications ranging from large static scenes to dynamic human motion. However, the increased resolution and model-free…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Abiramy Kuganesan , Shih-yang Su , James J. Little , Helge Rhodin