English
Related papers

Related papers: ND-SDF: Learning Normal Deflection Fields for High…

200 papers

Accurate segmentation of vascular networks from sparse CT scan slices remains a significant challenge in medical imaging, particularly due to the thin, branching nature of vessels and the inherent sparsity between imaging planes. Existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Salvatore Esposito , Daniel Rebain , Arno Onken , Changjian Li , Oisin Mac Aodha

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Yanzhen Chen , Xinyu Gao , Yazhen Yuan , Yu Wu , Xiaowei Zhou , Xiaogang Jin

We present a novel single-stage framework, Neural Photon Field (NePF), to address the ill-posed inverse rendering from multi-view images. Contrary to previous methods that recover the geometry, material, and illumination in multiple stages…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Tuen-Yue Tsui , Qin Zou

In this work, we present a new multi-view depth estimation method that utilizes both conventional reconstruction and learning-based priors over the recently proposed neural radiance fields (NeRF). Unlike existing neural network based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Yi Wei , Shaohui Liu , Yongming Rao , Wang Zhao , Jiwen Lu , Jie Zhou

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

We introduce SparseNeuS, a novel neural rendering based method for the task of surface reconstruction from multi-view images. This task becomes more difficult when only sparse images are provided as input, a scenario where existing neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Xiaoxiao Long , Cheng Lin , Peng Wang , Taku Komura , Wenping Wang

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

Combining the signed distance function (SDF) and differentiable volume rendering has emerged as a powerful paradigm for surface reconstruction from multi-view images without 3D supervision. However, current methods are impeded by requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rui Peng , Xiaodong Gu , Luyang Tang , Shihe Shen , Fanqi Yu , Ronggang Wang

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

We present LoD-NeuS, an efficient neural representation for high-frequency geometry detail recovery and anti-aliased novel view rendering. Drawing inspiration from voxel-based representations with the level of detail (LoD), we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Yiyu Zhuang , Qi Zhang , Ying Feng , Hao Zhu , Yao Yao , Xiaoyu Li , Yan-Pei Cao , Ying Shan , Xun Cao

Neural Radiance Field (NeRF) has revolutionized novel-view rendering tasks and achieved impressive results. However, the inefficient sampling and per-scene optimization hinder its wide applications. Though some generalizable NeRFs have been…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yue Shi , Dingyi Rong , Chang Chen , Chaofan Ma , Bingbing Ni , Wenjun Zhang

Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Iryna Repinetska , Anna Hilsmann , Peter Eisert

Hyperspectral Imagery (HSI) has been used in many applications to non-destructively determine the material and/or chemical compositions of samples. There is growing interest in creating 3D hyperspectral reconstructions, which could provide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Gerry Chen , Sunil Kumar Narayanan , Thomas Gautier Ottou , Benjamin Missaoui , Harsh Muriki , Cédric Pradalier , Yongsheng Chen

We present iSDF, a continual learning system for real-time signed distance field (SDF) reconstruction. Given a stream of posed depth images from a moving camera, it trains a randomly initialised neural network to map input 3D coordinate to…

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

This comparative study evaluates various neural surface reconstruction methods, particularly focusing on their implications for scientific visualization through reconstructing 3D surfaces via multi-view rendering images. We categorize ten…

Graphics · Computer Science 2024-07-31 Siyuan Yao , Weixi Song , Chaoli Wang

Dynamic imaging is essential for analyzing various biological systems and behaviors but faces two main challenges: data incompleteness and computational burden. For many imaging systems, high frame rates and short acquisition times require…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Luke Lozenski , Mark A. Anastasio , Umberto Villa

The reconstruction of high-quality shape geometry is crucial for developing freehand 3D ultrasound imaging. However, the shape reconstruction of multi-view ultrasound data remains challenging due to the elevation distortion caused by thick…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Hongbo Chen , Yuchong Gao , Shuhang Zhang , Jiangjie Wu , Yuexin Ma , Rui Zheng

Generalizable neural surface reconstruction has become a compelling technique to reconstruct from few images without per-scene optimization, where dense 3D feature volume has proven effective as a global representation of scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Hieu Le , Pascal Fua