English
Related papers

Related papers: Warp and Learn: Novel Views Generation for Vehicle…

200 papers

We propose a method to learn 3D deformable object categories from raw single-view images, without external supervision. The method is based on an autoencoder that factors each input image into depth, albedo, viewpoint and illumination. In…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Shangzhe Wu , Christian Rupprecht , Andrea Vedaldi

Capturing and rendering novel views of complex real-world scenes is a long-standing problem in computer graphics and vision, with applications in augmented and virtual reality, immersive experiences and 3D photography. The advent of deep…

Graphics · Computer Science 2024-08-09 Ravi Ramamoorthi

Existing state-of-the-art novel view synthesis methods rely on either fairly accurate 3D geometry estimation or sampling of the entire space for neural volumetric rendering, which limit the overall efficiency. In order to improve the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Yuemei Zhou , Tao Yu , Zerong Zheng , Ying Fu , Yebin Liu

Parametric approaches to Learning, such as deep learning (DL), are highly popular in nonlinear regression, in spite of their extremely difficult training with their increasing complexity (e.g. number of layers in DL). In this paper, we…

Machine Learning · Computer Science 2018-03-23 Ashkan Panahi , Hamid Krim , Liyi Dai

We propose a learned image-guided rendering technique that combines the benefits of image-based rendering and GAN-based image synthesis. The goal of our method is to generate photo-realistic re-renderings of reconstructed objects for…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Justus Thies , Michael Zollhöfer , Christian Theobalt , Marc Stamminger , Matthias Nießner

The task of generating natural images from 3D scenes has been a long standing goal in computer graphics. On the other hand, recent developments in deep neural networks allow for trainable models that can produce natural-looking images with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Hassan Abu Alhaija , Siva Karthik Mustikovela , Andreas Geiger , Carsten Rother

An important problem for both graphics and vision is to synthesize novel views of a 3D object from a single image. This is particularly challenging due to the partial observability inherent in projecting a 3D object onto the image space,…

Machine Learning · Computer Science 2016-01-06 Jimei Yang , Scott Reed , Ming-Hsuan Yang , Honglak Lee

Currently almost all state-of-the-art novel view synthesis and reconstruction models rely on calibrated cameras or additional geometric priors for training. These prerequisites significantly limit their applicability to massive uncalibrated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Ruoyu Wang , Yi Ma , Shenghua Gao

We study to generate novel views of indoor scenes given sparse input views. The challenge is to achieve both photorealism and view consistency. We present SparseGNV: a learning framework that incorporates 3D structures and image generative…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Weihao Cheng , Yan-Pei Cao , Ying Shan

We propose a novel study of generating unseen arbitrary viewpoints for infrared imagery in the non-linear feature subspace . Current methods use synthetic images and often result in blurry and distorted outputs. Our approach on the contrary…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Maliha Arif , Abhijit Mahalanobis

We show that generative models can be used to capture visual geometry constraints statistically. We use this fact to infer the 3D shape of object categories from raw single-view images. Differently from prior work, we use no external…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Shangzhe Wu , Christian Rupprecht , Andrea Vedaldi

We study how to synthesize novel views of human body from a single image. Though recent deep learning based methods work well for rigid objects, they often fail on objects with large articulation, like human bodies. The core step of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Hao Zhu , Hao Su , Peng Wang , Xun Cao , Ruigang Yang

Recent methods, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have demonstrated remarkable capabilities in novel view synthesis. However, despite their success in producing high-quality images for viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiatong Xia , Libo Sun , Lingqiao Liu

Deep metric learning aims to learn embeddings that contain semantic similarity information among data points. To learn better embeddings, methods to generate synthetic hard samples have been proposed. Existing methods of synthetic hard…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Geonmo Gu , Byungsoo Ko

In this paper we present, to the best of our knowledge, the first method to learn a generative model of 3D shapes from natural images in a fully unsupervised way. For example, we do not use any ground truth 3D or 2D annotations, stereo…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Attila Szabó , Givi Meishvili , Paolo Favaro

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton poses. In contrast, we propose an approach that can exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Simon Jenni , Paolo Favaro

We present a novel approach to detect, segment, and reconstruct complete textured 3D models of vehicles from a single image for autonomous driving. Our approach combines the strengths of deep learning and the elegance of traditional…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Feixiang Lu , Zongdai Liu , Xibin Song , Dingfu Zhou , Wei Li , Hui Miao , Miao Liao , Liangjun Zhang , Bin Zhou , Ruigang Yang , Dinesh Manocha

Estimating the 3D shape of an object from a single or multiple images has gained popularity thanks to the recent breakthroughs powered by deep learning. Most approaches regress the full object shape in a canonical pose, possibly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Riccardo Spezialetti , David Joseph Tan , Alessio Tonioni , Keisuke Tateno , Federico Tombari

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim