English
Related papers

Related papers: Adjustable Visual Appearance for Generalizable Nov…

200 papers

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

High Dynamic Range Novel View Synthesis (HDR NVS) seeks to learn an HDR 3D model from Low Dynamic Range (LDR) training images captured under conventional imaging conditions. Current methods primarily focus on static scenes, implicitly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixuan Zhang , Zhipeng Xiong , Minxian Li , Mingwu Ren , Jiankang Deng , Xiatian Zhu

Visual scene understanding is a fundamental task in computer vision that aims to extract meaningful information from visual data. It traditionally involves disjoint and specialized algorithms for different tasks that are tailored for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Américo Pereira , Pedro Carvalho , Luís Côrte-Real

This paper addresses the problem of novel view synthesis by means of neural rendering, where we are interested in predicting the novel view at an arbitrary camera pose based on a given set of input images from other viewpoints. Using the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Janne Heikkila

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende

Novel view synthesis (NVS) enables to generate new images of a scene or convert a set of 2D images into a comprehensive 3D model. In the context of Space Domain Awareness, since space is becoming increasingly congested, NVS can accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Nidhi Mathihalli , Audrey Wei , Giovanni Lavezzi , Peng Mun Siew , Victor Rodriguez-Fernandez , Hodei Urrutxua , Richard Linares

We present an algorithm for generating novel views at arbitrary viewpoints and any input time step given a monocular video of a dynamic scene. Our work builds upon recent advances in neural implicit representation and uses continuous and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chen Gao , Ayush Saraf , Johannes Kopf , Jia-Bin Huang

Recent methods have made significant progress in synthesizing novel views with long video sequences. This paper proposes a highly scalable method for dynamic novel view synthesis with continual learning. We leverage the 3D Gaussians to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zhenhuan Liu , Shuai Liu , Yidong Lu , Yirui Chen , Jie Yang , Wei Liu

Single image view synthesis allows for the generation of new views of a scene given a single input image. This is challenging, as it requires comprehensively understanding the 3D scene from a single image. As a result, current methods…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Olivia Wiles , Georgia Gkioxari , Richard Szeliski , Justin Johnson

A concept of light-fields computed from multiple view images on regular grids has proven its benefit for scene representations, and supported realistic renderings of novel views and photographic effects such as refocusing and shallow depth…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Hyunjun Jung , Hae-Gon Jeon

Novel view synthesis from sparse inputs is a vital yet challenging task in 3D computer vision. Previous methods explore 3D Gaussian Splatting with neural priors (e.g. depth priors) as an additional supervision, demonstrating promising…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Liang Han , Junsheng Zhou , Yu-Shen Liu , Zhizhong Han

Novel view synthesis is a challenging problem in computer vision and robotics. Different from the existing works, which need the reference images or 3D models of the scene to generate images under novel views, we propose a novel paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Xiang Guo , Bo Li , Yuchao Dai , Tongxin Zhang , Hui Deng

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

Conditional image synthesis from layout has recently attracted much interest. Previous approaches condition the generator on object locations as well as class labels but lack fine-grained control over the diverse appearance aspects of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Stanislav Frolov , Avneesh Sharma , Jörn Hees , Tushar Karayil , Federico Raue , Andreas Dengel

Simultaneous reconstruction of geometry and reflectance properties in uncontrolled environments remains a challenging problem. In this paper, we propose an efficient method to reconstruct the scene's 3D geometry and reflectance from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rui Li , Guangmin Zang , Miao Qi , Wolfgang Heidrich

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Novel view synthesis from a single input image is a challenging task, where the goal is to generate a new view of a scene from a desired camera pose that may be separated by a large motion. The highly uncertain nature of this synthesis task…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Jason J. Yu , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

We propose UpFusion, a system that can perform novel view synthesis and infer 3D representations for an object given a sparse set of reference images without corresponding pose information. Current sparse-view 3D inference methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Bharath Raj Nagoor Kani , Hsin-Ying Lee , Sergey Tulyakov , Shubham Tulsiani

We present a portable multiscopic camera system with a dedicated model for novel view and time synthesis in dynamic scenes. Our goal is to render high-quality images for a dynamic scene from any viewpoint at any time using our portable…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Tianjia Zhang , Yuen-Fui Lau , Qifeng Chen

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson