English
Related papers

Related papers: Learning Novel View Synthesis from Heterogeneous L…

200 papers

Neural Radiance Fields (NeRF) have shown impressive performance in novel view synthesis, but challenges remain in rendering scenes with complex specular reflections and highlights. Existing approaches may produce blurry reflections due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Wenpeng Xing , Jie Chen , Zaifeng Yang , Tiancheng Zhao , Gaolei Li , Changting Lin , Yike Guo , Meng Han

We address the challenge of constructing a consistent and photorealistic Neural Radiance Field in inhomogeneously illuminated, scattering environments with unknown, co-moving light sources. While most existing works on underwater scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mengkun She , Felix Seegräber , David Nakath , Patricia Schöntag , Kevin Köser

The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e.g., Street View). Given a sequence of posed RGB…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Konstantinos Rematas , Andrew Liu , Pratul P. Srinivasan , Jonathan T. Barron , Andrea Tagliasacchi , Thomas Funkhouser , Vittorio Ferrari

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , Jonathan T. Barron

We propose the first approach for the decomposition of a monocular color video into direct and indirect illumination components in real time. We retrieve, in separate layers, the contribution made to the scene appearance by the scene…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Abhimitra Meka , Mohammad Shafiei , Michael Zollhoefer , Christian Richardt , Christian Theobalt

Existing instance segmentation techniques are primarily tailored for high-visibility inputs, but their performance significantly deteriorates in extremely low-light environments. In this work, we take a deep look at instance segmentation in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Linwei Chen , Ying Fu , Kaixuan Wei , Dezhi Zheng , Felix Heide

Images captured under low-light conditions present significant limitations in many applications, as poor lighting can obscure details, reduce contrast, and hide noise. Removing the illumination effects and enhancing the quality of such…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Daniel Torres , Joan Duran , Julia Navarro , Catalina Sbert

Under challenging light conditions, captured images often suffer from various degradations, leading to a decline in the performance of vision-based applications. Although numerous methods have been proposed to enhance image quality, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jing Tao , You Li , Banglei Guan , Yang Shang , Qifeng Yu

This paper aims to recover the intrinsic reflectance layer and shading layer given a single image. Though this intrinsic image decomposition problem has been studied for decades, it remains a significant challenge in cases of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Xiaodong Wang , Zijun He , Xin Yuan

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

In recent years, significant progress has been made in image recognition technology based on deep neural networks. However, improving recognition performance under low-light conditions remains a significant challenge. This study addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Seitaro Ono , Yuka Ogino , Takahiro Toizumi , Atsushi Ito , Masato Tsukada

This paper presents an algorithm that enhances undesirably illuminated images by generating and fusing multi-level illuminations from a single image.The input image is first decomposed into illumination and reflectance components by using…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Jae Sung Park , Nam Ik Cho

Unlike single image task, stereo image enhancement can use another view information, and its key stage is how to perform cross-view feature interaction to extract useful information from another view. However, complex noise in low-light…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Minghua Zhao , Xiangdong Qin , Shuangli Du , Xuefei Bai , Jiahao Lyu , Yiguang Liu

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

While current multi-frame restoration methods combine information from multiple input images using 2D alignment techniques, recent advances in novel view synthesis are paving the way for a new paradigm relying on volumetric scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Thomas Tanay , Aleš Leonardis , Matteo Maggioni

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Images obtained in real-world low-light conditions are not only low in brightness, but they also suffer from many other types of degradation, such as color bias, unknown noise, detail loss and halo artifacts. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-07-01 Xinxu Wei , Xianshi Zhang , Shisen Wang , Cheng Cheng , Yanlin Huang , Kaifu Yang , Yongjie Li

Novel view synthesis from low dynamic range (LDR) blurry images, which are common in the wild, struggles to recover high dynamic range (HDR) and sharp 3D representations in extreme lighting conditions. Although existing methods employ event…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yunshan Qi , Lin Zhu , Nan Bao , Yifan Zhao , Jia Li