English
Related papers

Related papers: Self-supervised novel 2D view synthesis of large-s…

200 papers

Taking an image of an object is at its core a lossy process. The rich information about the three-dimensional structure of the world is flattened to an image plane and decisions such as viewpoint and camera parameters are final and not…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Konstantinos Rematas , Chuong Nguyen , Tobias Ritschel , Mario Fritz , Tinne Tuytelaars

Content creation, central to applications such as virtual reality, can be a tedious and time-consuming. Recent image synthesis methods simplify this task by offering tools to generate new views from as little as a single input image, or by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Tewodros Habtegebrial , Varun Jampani , Orazio Gallo , Didier Stricker

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

This paper targets on learning-based novel view synthesis from a single or limited 2D images without the pose supervision. In the viewer-centered coordinates, we construct an end-to-end trainable conditional variational framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Tong Che , Yiqun Lu , Chao Yang , Site Li , Jane You

Unsupervised learning of object-centric representations in dynamic visual scenes is challenging. Unlike most previous approaches that learn to decompose 2D images, we present DynaVol, a 3D scene generative model that unifies geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Yanpeng Zhao , Siyu Gao , Yunbo Wang , Xiaokang Yang

This paper tackles the problem of novel view synthesis from a single image. In particular, we target real-world scenes with rich geometric structure, a challenging task due to the large appearance variations of such scenes and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Miaomiao Liu , Xuming He , Mathieu Salzmann

Multi-View Stereo (MVS) is a core task in 3D computer vision. With the surge of novel deep learning methods, learned MVS has surpassed the accuracy of classical approaches, but still relies on building a memory intensive dense cost volume.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Radu Alexandru Rosu , Sven Behnke

Synthesizing novel views from monocular videos of dynamic scenes remains a challenging problem. Scene-specific methods that optimize 4D representations with explicit motion priors often break down in highly dynamic regions where multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Thomas Tanay , Mohammed Brahimi , Michal Nazarczuk , Qingwen Zhang , Sibi Catley-Chandar , Arthur Moreau , Zhensong Zhang , Eduardo Pérez-Pellitero

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new views. While recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jeong-gi Kwak , Erqun Dong , Yuhe Jin , Hanseok Ko , Shweta Mahajan , Kwang Moo Yi

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Novel view synthesis (NVS) from a single image is highly ill-posed due to large unobserved regions, especially for views that deviate significantly from the input. While existing methods focus on consistency between the source and generated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xueyang Kang , Zhengkang Xiang , Zezheng Zhang , Kourosh Khoshelham

We present a generalizable novel view synthesis method which enables modifying the visual appearance of an observed scene so rendered views match a target weather or lighting condition without any scene specific training or access to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Josef Bengtson , David Nilsson , Che-Tsung Lin , Marcel Büsching , Fredrik Kahl

Current methods for 3D scene reconstruction from sparse posed images employ intermediate 3D representations such as neural fields, voxel grids, or 3D Gaussians, to achieve multi-view consistent scene appearance and geometry. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Vitor Guizilini , Muhammad Zubair Irshad , Dian Chen , Greg Shakhnarovich , Rares Ambrus

Novel view synthesis in 360$^\circ$ scenes from extremely sparse input views is essential for applications like virtual reality and augmented reality. This paper presents a novel framework for novel view synthesis in extremely sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guangan Chen , Anh Minh Truong , Hanhe Lin , Michiel Vlaminck , Wilfried Philips , Hiep Luong

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

Learning object-centric representations from unsupervised videos is challenging. Unlike most previous approaches that focus on decomposing 2D images, we present a 3D generative model named DynaVol-S for dynamic scenes that enables…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yanpeng Zhao , Yiwei Hao , Siyu Gao , Yunbo Wang , Xiaokang Yang

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann