English
Related papers

Related papers: Frequency-regularized Neural Representation Method…

200 papers

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruction capabilities with dense view images. However, its performance significantly deteriorates under sparse view settings. We observe that learning the 3D consistency of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Shoukang Hu , Kaichen Zhou , Kaiyu Li , Longhui Yu , Lanqing Hong , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Ziwei Liu

Image reconstruction and synthesis have witnessed remarkable progress thanks to the development of generative models. Nonetheless, gaps could still exist between the real and generated images, especially in the frequency domain. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Liming Jiang , Bo Dai , Wayne Wu , Chen Change Loy

Accurate material modeling is crucial for achieving photorealistic rendering, bridging the gap between computer-generated imagery and real-world photographs. While traditional approaches rely on tabulated BRDF data, recent work has shifted…

Graphics · Computer Science 2025-08-18 Chenliang Zhou , Zheyuan Hu , Cengiz Oztireli

Proper regularization is crucial in inverse problems to achieve high-quality reconstruction, even with an ill-conditioned measurement system. This is particularly true for three-dimensional photoacoustic tomography, which is computationally…

Optimization and Control · Mathematics 2024-09-26 Chao Wang , Alexandre H. Thiery

Novel view synthesis with sparse inputs is a challenging problem for neural radiance fields (NeRF). Recent efforts alleviate this challenge by introducing external supervision, such as pre-trained models and extra depth signals, and by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Jiawei Yang , Marco Pavone , Yue Wang

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Super-resolution and denoising are ill-posed yet fundamental image restoration tasks. In blind settings, the degradation kernel or the noise level are unknown. This makes restoration even more challenging, notably for learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Majed El Helou , Ruofan Zhou , Sabine Süsstrunk

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Young Chun Ahn , Seokhwan Jang , Sungheon Park , Ji-Yeon Kim , Nahyup Kang

Implicit Neural Representations (INRs) have emerged as a promising paradigm for video compression. However, existing INR-based frameworks typically suffer from inherent spectral bias, which favors low-frequency components and leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jun Zhu , Xinfeng Zhang , Lv Tang , Junhao Jiang , Gai Zhang , Jia Wang

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

Neural Radiance Fields (NeRF) have led to breakthroughs in the novel view synthesis problem. Positional Encoding (P.E.) is a critical factor that brings the impressive performance of NeRF, where low-dimensional coordinates are mapped to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Liangchen Song , Zhong Li , Xuan Gong , Lele Chen , Zhang Chen , Yi Xu , Junsong Yuan

The sparse-views x-ray computed tomography (CT) is essential for medical diagnosis and industrial nondestructive testing. However, in particular, the reconstructed image usually suffers from complex artifacts and noise, when the sampling is…

Medical Physics · Physics 2019-10-08 Genwei Ma , Yining Zhu , Xing Zhao

Neural Radiance Field (NeRF), as an implicit 3D scene representation, lacks inherent ability to accommodate changes made to the initial static scene. If objects are reconfigured, it is difficult to update the NeRF to reflect the new state…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziqi Lu , Jianbo Ye , Xiaohan Fei , Xiaolong Li , Jiawei Mo , Ashwin Swaminathan , Stefano Soatto

Surface reconstruction from sparse views aims to reconstruct a 3D shape or scene from few RGB images. The latest methods are either generalization-based or overfitting-based. However, the generalization-based methods do not generalize well…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Liang Han , Xu Zhang , Haichuan Song , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Neural Radiance Fields (NeRF) show impressive performance in photo-realistic free-view rendering of scenes. Recent improvements on the NeRF such as TensoRF and ZipNeRF employ explicit models for faster optimization and rendering, as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Nagabhushan Somraj , Sai Harsha Mupparaju , Adithyan Karanayil , Rajiv Soundararajan

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Dynamic imaging involves the reconstruction of a spatio-temporal object at all times using its undersampled measurements. In particular, in dynamic computed tomography (dCT), only a single projection at one view angle is available at a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-14 Berk Iskender , Sushan Nakarmi , Nitin Daphalapurkar , Marc L. Klasky , Yoram Bresler

We introduce SparseNeuS, a novel neural rendering based method for the task of surface reconstruction from multi-view images. This task becomes more difficult when only sparse images are provided as input, a scenario where existing neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Xiaoxiao Long , Cheng Lin , Peng Wang , Taku Komura , Wenping Wang

Even though image signals are typically defined on a regular two-dimensional grid, there also exist many scenarios where this is not the case and the amplitude of the image signal only is available for a non-regular subset of pixel…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Jürgen Seiler , Markus Jonscher , Michael Schöberl , André Kaup

We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Nalini M. Singh , Juan Eugenio Iglesias , Elfar Adalsteinsson , Adrian V. Dalca , Polina Golland