English
Related papers

Related papers: Survey on Fundamental Deep Learning 3D Reconstruct…

200 papers

Deep learning (DL) based unrolled reconstructions have shown state-of-the-art performance for under-sampled magnetic resonance imaging (MRI). Similar to compressed sensing, DL can leverage high-dimensional data (e.g. 3D, 2D+time, 3D+time)…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Ke Wang , Michael Kellman , Christopher M. Sandino , Kevin Zhang , Shreyas S. Vasanawala , Jonathan I. Tamir , Stella X. Yu , Michael Lustig

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

Light-field microscopy (LFM) enables rapid volumetric imaging through single-frame acquisition and fast 3D reconstruction algorithms. The high speed and low phototoxicity of LFM make it highly suitable for real-time 3D fluorescence imaging,…

Optics · Physics 2025-02-24 Bohan Qu , Zhouyu Jin , You Zhou , Bo Xiong , Xun Cao

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

The conversion of 2D freehand sketches into 3D models remains a pivotal challenge in computer vision, bridging the gap between fluent sketching and CAD. Traditional monocular depth reconstruction techniques are not suitable for line drawing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Elton Cao , Hod Lipson

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

Three-dimensional reconstruction is a fundamental problem in robotics perception. We examine the problem of active view selection to perform 3D Gaussian Splatting reconstructions with as few input images as possible. Although 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Monica M. Q. Li , Pierre-Yves Lajoie , Giovanni Beltrame

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

The sparse layouts of radio interferometers result in an incomplete sampling of the sky in Fourier space which leads to artifacts in the reconstructed images. Cleaning these systematic effects is essential for the scientific use of…

Instrumentation and Methods for Astrophysics · Physics 2023-07-27 Kevin Schmidt , Felix Geyer , Stefan Fröse , Paul-Simon Blomenkamp , Marcus Brüggen , Francesco de Gasperin , Dominik Elsässer , Wolfgang Rhode

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

Latent scene representation plays a significant role in training reinforcement learning (RL) agents. To obtain good latent vectors describing the scenes, recent works incorporate the 3D-aware latent-conditioned NeRF pipeline into scene…

Robotics · Computer Science 2024-09-30 Jiaxu Wang , Ziyi Zhang , Qiang Zhang , Jia Li , Jingkai Sun , Mingyuan Sun , Junhao He , Renjing Xu

Medical imaging is playing a more and more important role in clinics. However, there are several issues in different imaging modalities such as slow imaging speed in MRI, radiation injury in CT and PET. Therefore, accelerating MRI, reducing…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Jing Cheng , Haifeng Wang , Yanjie Zhu , Qiegen Liu , Qiyang Zhang , Ting Su , Jianwei Chen , Yongshuai Ge , Zhanli Hu , Xin Liu , Hairong Zheng , Leslie Ying , Dong Liang

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

While neural rendering has demonstrated impressive capabilities in 3D scene reconstruction and novel view synthesis, it heavily relies on high-quality sharp images and accurate camera poses. Numerous approaches have been proposed to train…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Lingzhe Zhao , Peng Wang , Peidong Liu

3D Gaussian splatting (GS) has emerged as a transformative technique in radiance fields. Unlike mainstream implicit neural models, 3D GS uses millions of learnable 3D Gaussians for an explicit scene representation. Paired with a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Guikun Chen , Wenguan Wang

The remarkable achievements of both generative models of 2D images and neural field representations for 3D scenes present a compelling opportunity to integrate the strengths of both approaches. In this work, we propose a methodology that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Azmi Haider , Dan Rosenbaum

Following the success of deep learning in a wide range of applications, neural network-based machine-learning techniques have received significant interest for accelerating magnetic resonance imaging (MRI) acquisition and reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2022-03-11 Arghya Pal , Yogesh Rathi

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Dynamic scene reconstruction has garnered significant attention in recent years due to its capabilities in high-quality and real-time rendering. Among various methodologies, constructing a 4D spatial-temporal representation, such as 4D-GS,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weiwei Cai , Weicai Ye , Peng Ye , Tong He , Tao Chen

Deep learning (DL) has emerged as a leading approach in accelerating MR imaging. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited…

Image and Video Processing · Electrical Eng. & Systems 2024-02-06 Shanshan Wang , Ruoyou Wu , Sen Jia , Alou Diakite , Cheng Li , Qiegen Liu , Leslie Ying