English
Related papers

Related papers: Real-Time Position-Aware View Synthesis from Singl…

200 papers

We present a transformation-grounded image generation network for novel 3D view synthesis from a single image. Instead of taking a 'blank slate' approach, we first explicitly infer the parts of the geometry visible both in the input and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-09 Eunbyung Park , Jimei Yang , Ersin Yumer , Duygu Ceylan , Alexander C. Berg

This paper addresses the problem of novel view synthesis by means of neural rendering, where we are interested in predicting the novel view at an arbitrary camera pose based on a given set of input images from other viewpoints. Using the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Janne Heikkila

We introduce the task of mixed-view panorama synthesis, where the goal is to synthesize a novel panorama given a small set of input panoramas and a satellite image of the area. This contrasts with previous work which only uses input…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhexiao Xiong , Xin Xing , Scott Workman , Subash Khanal , Nathan Jacobs

We present a practical and robust deep learning solution for capturing and rendering novel views of complex real world scenes for virtual exploration. Previous approaches either require intractably dense view sampling or provide little to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Ben Mildenhall , Pratul P. Srinivasan , Rodrigo Ortiz-Cayon , Nima Khademi Kalantari , Ravi Ramamoorthi , Ren Ng , Abhishek Kar

The task of novel view synthesis aims to generate unseen perspectives of an object or scene from a limited set of input images. Nevertheless, synthesizing novel views from a single image still remains a significant challenge in the realm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yifan Jiang , Hao Tang , Jen-Hao Rick Chang , Liangchen Song , Zhangyang Wang , Liangliang Cao

This work addresses the problem of novel view synthesis in diverse scenes from small collections of RGB images. We propose ERUPT (Efficient Rendering with Unposed Patch Transformer) a state-of-the-art scene reconstruction model capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Maxim V. Shugaev , Vincent Chen , Maxim Karrenbach , Kyle Ashley , Bridget Kennedy , Naresh P. Cuntoor

This work introduces VISY-REVE: a novel pipeline to validate image processing algorithms for Vision-Based Navigation. Traditional validation methods such as synthetic rendering or robotic testbed acquisition suffer from difficult setup and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Marius Neuhalfen , Jonathan Grzymisch , Manuel Sanchez-Gestido

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new views. While recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jeong-gi Kwak , Erqun Dong , Yuhe Jin , Hanseok Ko , Shweta Mahajan , Kwang Moo Yi

Aerial-to-ground image synthesis is an emerging and challenging problem that aims to synthesize a ground image from an aerial image. Due to the highly different layout and object representation between the aerial and ground images, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Jinhyun Jang , Taeyong Song , Kwanghoon Sohn

We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. We build upon recent advances in semantic image synthesis and view synthesis for handling…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Hsin-Ping Huang , Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Congrui Hetang , Yuping Wang

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Nagabhushan Somraj

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Scene view synthesis, which generates novel views from limited perspectives, is increasingly vital for applications like virtual reality, augmented reality, and robotics. Unlike object-based tasks, such as generating 360{\deg} views of a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Yan Fang , Matteo Frosi , Jianfei Ge , Jiangjian Xiao , Matteo Matteucci

In this paper, we present a novel approach to synthesize realistic images based on their semantic layouts. It hypothesizes that for objects with similar appearance, they share similar representation. Our method establishes dependencies…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Yi Wang , Lu Qi , Ying-Cong Chen , Xiangyu Zhang , Jiaya Jia

Novel view synthesis of remote sensing scenes is of great significance for scene visualization, human-computer interaction, and various downstream applications. Despite the recent advances in computer graphics and photogrammetry technology,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yongchang Wu , Zhengxia Zou , Zhenwei Shi

Hand-object interaction understanding and the barely addressed novel view synthesis are highly desired in the immersive communication, whereas it is challenging due to the high deformation of hand and heavy occlusions between hand and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Wentian Qu , Zhaopeng Cui , Yinda Zhang , Chenyu Meng , Cuixia Ma , Xiaoming Deng , Hongan Wang