English
Related papers

Related papers: SimVS: Simulating World Inconsistencies for Robust…

200 papers

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

Large image diffusion models enable novel view synthesis with high quality and excellent zero-shot capability. However, such models based on image-to-image translation have no guarantee of view consistency, limiting the performance for…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Haohan Weng , Tianyu Yang , Jianan Wang , Yu Li , Tong Zhang , C. L. Philip Chen , Lei Zhang

Synthesizing novel views for urban environments is crucial for tasks like autonomous driving and virtual tours. Compared to object-level or indoor situations, outdoor settings present unique challenges, such as inconsistency across frames…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Mreenav Shyam Deka , Lu Sang , Daniel Cremers

Image view synthesis has seen great success in reconstructing photorealistic visuals, thanks to deep learning and various novel representations. The next key step in immersive virtual experiences is view synthesis of dynamic scenes.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kai-En Lin , Guowei Yang , Lei Xiao , Feng Liu , Ravi Ramamoorthi

Recent conditional image synthesis approaches provide high-quality synthesized images. However, it is still challenging to accurately adjust image contents such as the positions and orientations of objects, and synthesized images often have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jaebong Jeong , Janghun Jo , Jingdong Wang , Sunghyun Cho , Jaesik Park

This paper considers the problem of generative novel view synthesis (GNVS), generating novel, plausible views of a scene given a limited number of known views. Here, we propose a set-based generative model that can simultaneously generate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Jason J. Yu , Tristan Aumentado-Armstrong , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

We address the problem of novel view synthesis (NVS) from a few sparse source view images. Conventional image-based rendering methods estimate scene geometry and synthesize novel views in two separate steps. However, erroneous geometry…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yujiao Shi , Hongdong Li , Xin Yu

Scene-level novel view synthesis (NVS) is fundamental to many vision and graphics applications. Recently, pose-conditioned diffusion models have led to significant progress by extracting 3D information from 2D foundation models, but these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Joseph Tung , Gene Chou , Ruojin Cai , Guandao Yang , Kai Zhang , Gordon Wetzstein , Bharath Hariharan , Noah Snavely

High angular resolution is advantageous for practical applications of light fields. In order to enhance the angular resolution of light fields, view synthesis methods can be utilized to generate dense intermediate views from sparse light…

Image and Video Processing · Electrical Eng. & Systems 2020-08-13 Yang Chen , Martin Alain , Aljosa Smolic

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

Given just a few glimpses of a scene, can you imagine the movie playing out as the camera glides through it? That's the lens we take on \emph{sparse-input novel view synthesis}, not only as filling spatial gaps between widely spaced views,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yan Xu , Yixing Wang , Stella X. Yu

Generating high-quality novel views of a scene from a single image requires maintaining structural coherence across different views, referred to as view consistency. While diffusion models have driven advancements in novel view synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiwoo Park , Tae Eun Choi , Youngjun Jun , Seong Jae Hwang

Image-based geometric modeling and novel view synthesis based on sparse, large-baseline samplings are challenging but important tasks for emerging multimedia applications such as virtual reality and immersive telepresence. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Wenpeng Xing , Jie Chen , Zaifeng Yang , Qiang Wang

Video stabilization is pivotal for video processing, as it removes unwanted shakiness while preserving the original user motion intent. Existing approaches, depending on the domain they operate, suffer from several issues (e.g. geometric…

Graphics · Computer Science 2025-07-21 Zinuo You , Stamatios Georgoulis , Anpei Chen , Siyu Tang , Dengxin Dai

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Novel view synthesis (NVS) is a cornerstone for image-to-3d creation. However, existing works still struggle to maintain consistency between the generated views and the input views, especially when there is a significant camera pose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xuying Zhang , Yupeng Zhou , Kai Wang , Yikai Wang , Zhen Li , Shaohui Jiao , Daquan Zhou , Qibin Hou , Ming-Ming Cheng

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. We build upon recent advances in semantic image synthesis and view synthesis for handling…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Hsin-Ping Huang , Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang

High Dynamic Range Novel View Synthesis (HDR NVS) seeks to learn an HDR 3D model from Low Dynamic Range (LDR) training images captured under conventional imaging conditions. Current methods primarily focus on static scenes, implicitly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixuan Zhang , Zhipeng Xiong , Minxian Li , Mingwu Ren , Jiankang Deng , Xiatian Zhu

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros