English
Related papers

Related papers: CheapNVS: Real-Time On-Device Narrow-Baseline Nove…

200 papers

In recent years, novel view synthesis from a single image has seen significant progress thanks to the rapid advancements in 3D scene representation and image inpainting techniques. While the current approaches are able to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Avinash Paliwal , Brandon Nguyen , Andrii Tsarov , Nima Khademi Kalantari

This paper considers the problem of generative novel view synthesis (GNVS), generating novel, plausible views of a scene given a limited number of known views. Here, we propose a set-based generative model that can simultaneously generate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Jason J. Yu , Tristan Aumentado-Armstrong , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

We present SHARP, an approach to photorealistic view synthesis from a single image. Given a single photograph, SHARP regresses the parameters of a 3D Gaussian representation of the depicted scene. This is done in less than a second on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Lars Mescheder , Wei Dong , Shiwei Li , Xuyang Bai , Marcel Santos , Peiyun Hu , Bruno Lecouat , Mingmin Zhen , Amaël Delaunoy , Tian Fang , Yanghai Tsin , Stephan R. Richter , Vladlen Koltun

Novel view synthesis (NVS) and video prediction (VP) are typically considered disjoint tasks in computer vision. However, they can both be seen as ways to observe the spatial-temporal world: NVS aims to synthesize a scene from a new point…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Yunzhi Zhang , Jiajun Wu

Capturing and rendering novel views of complex real-world scenes is a long-standing problem in computer graphics and vision, with applications in augmented and virtual reality, immersive experiences and 3D photography. The advent of deep…

Graphics · Computer Science 2024-08-09 Ravi Ramamoorthi

Real-time visual feedback is essential for tetherless control of remotely operated vehicles, particularly during inspection and manipulation tasks. Though acoustic communication is the preferred choice for medium-range communication…

Image and Video Processing · Electrical Eng. & Systems 2026-03-11 Luyuan Peng , Mandar Chitre , Hari Vishnu , Yuen Min Too , Bharath Kalyan , Rajat Mishra , Soo Pieng Tan

Neuromorphic vision sensing (NVS)\ devices represent visual information as sequences of asynchronous discrete events (a.k.a., ``spikes'') in response to changes in scene reflectance. Unlike conventional active pixel sensing (APS), NVS…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Yin Bi , Aaron Chadha , Alhabib Abbas , Eirina Bourtsoulatze , Yiannis Andreopoulos

Multi-view videos (MVVs) provide immersive viewing experience, at the cost of heavy load to wireless networks. Except for further improving viewing experience, view synthesis can create multicast opportunities for efficient transmission of…

Information Theory · Computer Science 2018-08-16 Wei Xu , Yuzhuo Wei , Ying Cui , Zhi Liu

There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Georgios Kopanas , Julien Philip , Thomas Leimkühler , George Drettakis

Multiview applications endow final users with the possibility to freely navigate within 3D scenes with minimum-delay. A real feeling of scene navigation is enabled by transmitting multiple high-quality camera views, which can be used to…

Multimedia · Computer Science 2018-03-28 Xue Zhang , Laura Toni , Pascal Frossard , Yao Zhao , Chunyu Lin

Deep learning-based single image super-resolution (SISR) approaches have drawn much attention and achieved remarkable success on modern advanced GPUs. However, most state-of-the-art methods require a huge number of parameters, memories, and…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Ziwei Luo , Youwei Li , Lei Yu , Qi Wu , Zhihong Wen , Haoqiang Fan , Shuaicheng Liu

High dynamic range (HDR) novel view synthesis (NVS) aims to create photorealistic images from novel viewpoints using HDR imaging techniques. The rendered HDR images capture a wider range of brightness levels containing more details of the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Cai , Zihao Xiao , Yixun Liang , Minghan Qin , Yulun Zhang , Xiaokang Yang , Yaoyao Liu , Alan Yuille

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

Novel view synthesis in 360$^\circ$ scenes from extremely sparse input views is essential for applications like virtual reality and augmented reality. This paper presents a novel framework for novel view synthesis in extremely sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guangan Chen , Anh Minh Truong , Hanhe Lin , Michiel Vlaminck , Wilfried Philips , Hiep Luong

Diffusion-based approaches have recently demonstrated strong performance for single-image novel view synthesis by conditioning generative models on geometry inferred from monocular depth estimation. However, in practice, the quality and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Amirhosein Javadi , Chi-Shiang Gau , Konstantinos D. Polyzos , Tara Javidi

Succinct representation of complex signals using coordinate-based neural representations (CNRs) has seen great progress, and several recent efforts focus on extending them for handling videos. Here, the main challenge is how to (a)…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Subin Kim , Sihyun Yu , Jaeho Lee , Jinwoo Shin

The task of synthesizing novel views from a single image is highly ill-posed due to multiple explanations for unobserved areas. Most current methods tend to generate unseen regions from ambiguity priors and interpolation near input views,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Haowang Cui , Rui Chen , Jiaze Wang , Tao Guo , Zheng Qin

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen

Novel view synthesis (NVS) is crucial in computer vision and graphics, with wide applications in AR, VR, and autonomous driving. While 3D Gaussian Splatting (3DGS) enables real-time rendering with high appearance fidelity, it suffers from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yancheng Zhang , Guangyu Sun , Chen Chen