English
Related papers

Related papers: Neural Light Transport for Relighting and View Syn…

200 papers

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

We introduce LumiNet, a novel architecture that leverages generative models and latent intrinsic representations for effective lighting transfer. Given a source image and a target lighting image, LumiNet synthesizes a relit version of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Xiaoyan Xing , Konrad Groh , Sezer Karaoglu , Theo Gevers , Anand Bhattad

We present a neural rendering framework for simultaneous view synthesis and appearance editing of a scene from multi-view images captured under known environment illumination. Existing approaches either achieve view synthesis alone or view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Pulkit Gera , Aakash KT , Dhawal Sirikonda , Parikshit Sakurikar , P. J. Narayanan

Neural radiance field has achieved fundamental success in novel view synthesis from input views with the same brightness level captured under fixed normal lighting. Unfortunately, synthesizing novel views remains to be a challenge for input…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Quan Zheng , Hao Sun , Huiyao Xu , Fanjiang Xu

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

This paper presents a novel neural implicit radiance representation for free viewpoint relighting from a small set of unstructured photographs of an object lit by a moving point light source different from the view position. We express the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chong Zeng , Guojun Chen , Yue Dong , Pieter Peers , Hongzhi Wu , Xin Tong

Synthesizing a densely sampled light field from a single image is highly beneficial for many applications. The conventional method reconstructs a depth map and relies on physical-based rendering and a secondary network to improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Andre Ivan , Williem , In Kyu Park

This paper tackles the problem of novel view synthesis from a single image. In particular, we target real-world scenes with rich geometric structure, a challenging task due to the large appearance variations of such scenes and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Miaomiao Liu , Xuming He , Mathieu Salzmann

In this work, we present a novel learning-based approach to synthesize new views of a light field image. In particular, given the four corner views of a light field, the presented method estimates any in-between view. We use three…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Julia Navarro , Neus Sabater

We address the challenge of relighting a single image or video, a task that demands precise scene intrinsic understanding and high-quality light transport synthesis. Existing end-to-end relighting models are often limited by the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Kai He , Ruofan Liang , Jacob Munkberg , Jon Hasselgren , Nandita Vijaykumar , Alexander Keller , Sanja Fidler , Igor Gilitschenski , Zan Gojcic , Zian Wang

Given a portrait image of a person and an environment map of the target lighting, portrait relighting aims to re-illuminate the person in the image as if the person appeared in an environment with the target lighting. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yu-Ying Yeh , Koki Nagano , Sameh Khamis , Jan Kautz , Ming-Yu Liu , Ting-Chun Wang

Precomputed Radiance Transfer (PRT) remains an attractive solution for real-time rendering of complex light transport effects such as glossy global illumination. After precomputation, we can relight the scene with new environment maps while…

Graphics · Computer Science 2023-07-13 Nithin Raghavan , Yan Xiao , Kai-En Lin , Tiancheng Sun , Sai Bi , Zexiang Xu , Tzu-Mao Li , Ravi Ramamoorthi

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

We present SILT, a Self-supervised Implicit Lighting Transfer method. Unlike previous research on scene relighting, we do not seek to apply arbitrary new lighting configurations to a given scene. Instead, we wish to transfer the lighting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Nikolina Kubiak , Armin Mustafa , Graeme Phillipson , Stephen Jolly , Simon Hadfield

This paper addresses the task of estimating the light arriving from all directions to a 3D point observed at a selected pixel in an RGB image. This task is challenging because it requires predicting a mapping from a partial scene…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Shuran Song , Thomas Funkhouser

It is suggested that low-light image enhancement realizes one-to-many mapping since we have different definitions of NORMAL-light given application scenarios or users' aesthetic. However, most existing methods ignore subjectivity of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Ya'nan Wang , Zhuqing Jiang , Chang Liu , Kai Li , Aidong Men , Haiying Wang

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen

Large transformer models are proving to be a powerful tool for 3D vision and novel view synthesis. However, the standard Transformer's well-known quadratic complexity makes it difficult to scale these methods to large scenes. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tooba Imtiaz , Lucy Chai , Kathryn Heal , Xuan Luo , Jungyeon Park , Jennifer Dy , John Flynn

Light field (LF) images containing information for multiple views have numerous applications, which can be severely affected by low-light imaging. Recent learning-based methods for low-light enhancement have some disadvantages, such as a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Shansi Zhang , Nan Meng , Edmund Y. Lam