English
Related papers

Related papers: Deep View Synthesis via Self-Consistent Generative…

200 papers

We propose a new cascaded architecture for novel view synthesis, called RGBD-Net, which consists of two core components: a hierarchical depth regression network and a depth-aware generator network. The former one predicts depth maps of the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Phong Nguyen-Ha , Animesh Karnewar , Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in synthesizing novel views after training on a given set of viewpoints. However, its rendering quality deteriorates when the synthesized view deviates significantly from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiatong Xia , Lingqiao Liu

Single-image-based view generation (SIVG) is important for producing 3D stereoscopic content. Here, handling different spatial resolutions as input and optimizing both reconstruction accuracy and processing speed is desirable. Latest…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Sung-Ho Bae , Mohamed Elgharib , Mohamed Hefeeda , Wojciech Matusik

Novel view synthesis is a challenging problem in computer vision and robotics. Different from the existing works, which need the reference images or 3D models of the scene to generate images under novel views, we propose a novel paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Xiang Guo , Bo Li , Yuchao Dai , Tongxin Zhang , Hui Deng

This paper presents a new method to synthesize an image from arbitrary views and times given a collection of images of a dynamic scene. A key challenge for the novel view synthesis arises from dynamic scene reconstruction where epipolar…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jae Shin Yoon , Kihwan Kim , Orazio Gallo , Hyun Soo Park , Jan Kautz

In this paper, we tackle the problem of generating a novel image from an arbitrary viewpoint given a single frame as input. While existing methods operating in this setup aim at predicting the target view depth map to guide the synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Giovanni Minelli , Matteo Poggi , Samuele Salti

Text-to-image synthesis aims to automatically generate images according to text descriptions given by users, which is a highly challenging task. The main issues of text-to-image synthesis lie in two gaps: the heterogeneous and homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Mingkuan Yuan , Yuxin Peng

In recent years, Multi-View Clustering (MVC) has been significantly advanced under the influence of deep learning. By integrating heterogeneous data from multiple views, MVC enhances clustering analysis, making multi-view fusion critical to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jian Zhu , Xin Zou , Xi Wang , Lei Liu , Chang Tang , Li-Rong Dai

We propose a novel approach for generating high quality visible-like images from Synthetic Aperture Radar (SAR) images using Deep Convolutional Generative Adversarial Network (GAN) architectures. The proposed approach is based on a cascaded…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Puyang Wang , Vishal M. Patel

Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications that provide immersive experiences. However, most existing techniques can only synthesize novel views within a limited range of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hung-Yu Tseng , Qinbo Li , Changil Kim , Suhib Alsisan , Jia-Bin Huang , Johannes Kopf

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view images. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Zixiong Huang , Qi Chen , Libo Sun , Yifan Yang , Naizhou Wang , Mingkui Tan , Qi Wu

Deep networks have recently enjoyed enormous success when applied to recognition and classification problems in computer vision, but their use in graphics problems has been limited. In this work, we present a novel deep architecture that…

Computer Vision and Pattern Recognition · Computer Science 2015-06-24 John Flynn , Ivan Neulander , James Philbin , Noah Snavely

Style synthesis attracts great interests recently, while few works focus on its dual problem "style separation". In this paper, we propose the Style Separation and Synthesis Generative Adversarial Network (S3-GAN) to simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Rui Zhang , Sheng Tang , Yu Li , Junbo Guo , Yongdong Zhang , Jintao Li , Shuicheng Yan

The deep generative adversarial networks (GAN) recently have been shown to be promising for different computer vision applications, like image edit- ing, synthesizing high resolution images, generating videos, etc. These networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Ali Diba , Vivek Sharma , Rainer Stiefelhagen , Luc Van Gool

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weihao Xia , Jing-Hao Xue

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Richard Tucker , Noah Snavely

Novel view synthesis requires strong 3D geometric consistency and the ability to generate visually coherent images across diverse viewpoints. While recent camera-controlled video diffusion models show promising results, they often suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Minjun Kang , Inkyu Shin , Taeyeop Lee , Myungchul Kim , In So Kweon , Kuk-Jin Yoon

This paper considers the problem of generative novel view synthesis (GNVS), generating novel, plausible views of a scene given a limited number of known views. Here, we propose a set-based generative model that can simultaneously generate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Jason J. Yu , Tristan Aumentado-Armstrong , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

Single image super resolution (SISR) is to reconstruct a high resolution image from a single low resolution image. The SISR task has been a very attractive research topic over the last two decades. In recent years, convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Bingzhe Wu , Haodong Duan , Zhichao Liu , Guangyu Sun

We introduce a scalable framework for novel view synthesis from RGB-D images with largely incomplete scene coverage. While generative neural approaches have demonstrated spectacular results on 2D images, they have not yet achieved similar…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zuoyue Li , Tianxing Fan , Zhenqiang Li , Zhaopeng Cui , Yoichi Sato , Marc Pollefeys , Martin R. Oswald