English
Related papers

Related papers: Deep View Synthesis via Self-Consistent Generative…

200 papers

In this work we introduce a new self-supervised, semi-parametric approach for synthesizing novel views of a vehicle starting from a single monocular image. Differently from parametric (i.e. entirely learning-based) methods, we show how…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Andrea Palazzi , Luca Bergamini , Simone Calderara , Rita Cucchiara

In the last few years, we have witnessed the rise of a series of deep learning methods to generate synthetic images that look extremely realistic. These techniques prove useful in the movie industry and for artistic purposes. However, they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Sara Mandelli , Nicolò Bonettini , Paolo Bestagini , Stefano Tubaro

Zero-shot novel view synthesis (NVS) from a single image is an essential problem in 3D object understanding. While recent approaches that leverage pre-trained generative models can synthesize high-quality novel views from in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jianglong Ye , Peng Wang , Kejie Li , Yichun Shi , Heng Wang

We present a new weakly supervised learning-based method for generating novel category-specific 3D shapes from unoccluded image collections. Our method is weakly supervised and only requires silhouette annotations from unoccluded,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Xiao Li , Yue Dong , Pieter Peers , Xin Tong

View synthesis is a process for generating novel views from a scene which has been recorded with a 3-D camera setup. It has important applications in 3-D post-production and 2-D to 3-D conversion. However, a central problem in the…

Computer Vision and Pattern Recognition · Computer Science 2014-06-25 Julian Habigt , Klaus Diepold

Recent advances in generative adversarial networks (GANs) have achieved great success in automated image composition that generates new images by embedding interested foreground objects into background images automatically. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Changgong Zhang , Fangneng Zhan , Shijian Lu , Feiying Ma , Xuansong Xie

This paper addresses the problem of novel view synthesis by means of neural rendering, where we are interested in predicting the novel view at an arbitrary camera pose based on a given set of input images from other viewpoints. Using the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Janne Heikkila

We introduce EscherNet, a multi-view conditioned diffusion model for view synthesis. EscherNet learns implicit and generative 3D representations coupled with a specialised camera positional encoding, allowing precise and continuous relative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xin Kong , Shikun Liu , Xiaoyang Lyu , Marwan Taher , Xiaojuan Qi , Andrew J. Davison

This paper presents an improved scheme for the generation and adaption of synthetic images for the training of deep Convolutional Neural Networks(CNNs) to perform the object detection task in smart vending machines. While generating…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Kai Wang , Fuyuan Shi , Wenqi Wang , Yibing Nan , Shiguo Lian

We introduce a principled approach for synthesizing new views of a scene given a single source image. Previous methods for novel view synthesis can be divided into image-based rendering methods (e.g. flow prediction) or pixel generation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Yuxin Hou , Arno Solin , Juho Kannala

Novel view synthesis (NVS) from a single image is highly ill-posed due to large unobserved regions, especially for views that deviate significantly from the input. While existing methods focus on consistency between the source and generated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xueyang Kang , Zhengkang Xiang , Zezheng Zhang , Kourosh Khoshelham

Recent progress in deep generative models has led to tremendous breakthroughs in image generation. However, while existing models can synthesize photorealistic images, they lack an understanding of our underlying 3D world. We present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Jun-Yan Zhu , Zhoutong Zhang , Chengkai Zhang , Jiajun Wu , Antonio Torralba , Joshua B. Tenenbaum , William T. Freeman

Photorealistic frontal view synthesis from a single face image has a wide range of applications in the field of face recognition. Although data-driven deep learning methods have been proposed to address this problem by seeking solutions…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Rui Huang , Shu Zhang , Tianyu Li , Ran He

We present a method for novel view synthesis from input images that are freely distributed around a scene. Our method does not rely on a regular arrangement of input views, can synthesize images for free camera movement through the scene,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Gernot Riegler , Vladlen Koltun

Over the past decade, many Super Resolution techniques have been developed using deep learning. Among those, generative adversarial networks (GAN) and very deep convolutional networks (VDSR) have shown promising results in terms of HR image…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Saifuddin Hitawala , Yao Li , Xian Wang , Dongyang Yang

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Roy Or-El , Xuan Luo , Mengyi Shan , Eli Shechtman , Jeong Joon Park , Ira Kemelmacher-Shlizerman

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Congrui Hetang , Yuping Wang

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Recent advancements in generative models have significantly improved novel view synthesis (NVS) from multi-view data. However, existing methods depend on external multi-view alignment processes, such as explicit pose estimation or…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Lingen Li , Zhaoyang Zhang , Yaowei Li , Jiale Xu , Wenbo Hu , Xiaoyu Li , Weihao Cheng , Jinwei Gu , Tianfan Xue , Ying Shan