English
Related papers

Related papers: Sphinx: Efficiently Serving Novel View Synthesis u…

200 papers

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Currently almost all state-of-the-art novel view synthesis and reconstruction models rely on calibrated cameras or additional geometric priors for training. These prerequisites significantly limit their applicability to massive uncalibrated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Ruoyu Wang , Yi Ma , Shenghua Gao

This work addresses the problem of novel view synthesis in diverse scenes from small collections of RGB images. We propose ERUPT (Efficient Rendering with Unposed Patch Transformer) a state-of-the-art scene reconstruction model capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Maxim V. Shugaev , Vincent Chen , Maxim Karrenbach , Kyle Ashley , Bridget Kennedy , Naresh P. Cuntoor

Evaluating the perceptual quality of Novel View Synthesis (NVS) images remains a key challenge, particularly in the absence of pixel-aligned ground truth references. Full-Reference Image Quality Assessment (FR-IQA) methods fail under…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Abhijay Ghildyal , Rajesh Sureddi , Nabajeet Barman , Saman Zadtootaghaj , Alan Bovik

The field of novel view synthesis from images has seen rapid advancements with the introduction of Neural Radiance Fields (NeRF) and more recently with 3D Gaussian Splatting. Gaussian Splatting became widely adopted due to its efficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ruihong Yin , Vladimir Yugay , Yue Li , Sezer Karaoglu , Theo Gevers

Neural Radiance Fields (NeRF) have garnered remarkable success in novel view synthesis. Nonetheless, the task of generating high-quality images for novel views persists as a critical challenge. While the existing efforts have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Linsheng Chen , Guangrun Wang , Liuchun Yuan , Keze Wang , Ken Deng , Philip H. S. Torr

Large image diffusion models have demonstrated zero-shot capability in novel view synthesis (NVS). However, existing diffusion-based NVS methods struggle to generate novel views that are accurately consistent with the corresponding ground…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Hongxiang Zhao , Xili Dai , Jianan Wang , Shengbang Tong , Jingyuan Zhang , Weida Wang , Lei Zhang , Yi Ma

The importance of higher-order relations is widely recognized in a large number of real-world systems. However, annotating them is a tedious and sometimes impossible task. Consequently, current approaches for data modelling either ignore…

Machine Learning · Computer Science 2025-06-06 Iulia Duta , Pietro Liò

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

We present NeRV-Diffusion, an implicit latent video diffusion model that synthesizes videos via generating neural network weights. The generated weights can be rearranged as the parameters of a convolutional neural network, which forms an…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixuan Ren , Hanyu Wang , Hao Chen , Bo He , Abhinav Shrivastava

We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-3, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS. Compared to other works…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chuanxia Zheng , Andrea Vedaldi

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

Generating high-resolution images with generative models has recently been made widely accessible by leveraging diffusion models pre-trained on large-scale datasets. Various techniques, such as MultiDiffusion and SyncDiffusion, have further…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Stanislav Frolov , Brian B. Moser , Andreas Dengel

Repurposing pre-trained diffusion models has been proven to be effective for NVS. However, these methods are mostly limited to a single object; directly applying such methods to compositional multi-object scenarios yields inferior results,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruijie Lu , Yixin Chen , Junfeng Ni , Baoxiong Jia , Yu Liu , Diwen Wan , Gang Zeng , Siyuan Huang

Novel view synthesis from a single input image is a challenging task, where the goal is to generate a new view of a scene from a desired camera pose that may be separated by a large motion. The highly uncertain nature of this synthesis task…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Jason J. Yu , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

Consistent human-centric image and video synthesis aims to generate images or videos with new poses while preserving appearance consistency with a given reference image, which is crucial for low-cost visual content creation. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Mingdeng Cao , Chong Mou , Ziyang Yuan , Xintao Wang , Zhaoyang Zhang , Ying Shan , Yinqiang Zheng

Existing real-time RGB-D reconstruction approaches, like Kinect Fusion, lack real-time photo-realistic visualization. This is due to noisy, oversmoothed or incomplete geometry and blurry textures which are fused from imperfect depth maps…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Laura Fink , Darius Rückert , Linus Franke , Joachim Keinert , Marc Stamminger