English
Related papers

Related papers: Novel View Synthesis using DDIM Inversion

200 papers

We introduce a scalable framework for novel view synthesis from RGB-D images with largely incomplete scene coverage. While generative neural approaches have demonstrated spectacular results on 2D images, they have not yet achieved similar…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zuoyue Li , Tianxing Fan , Zhenqiang Li , Zhaopeng Cui , Yoichi Sato , Marc Pollefeys , Martin R. Oswald

We explore novel-view synthesis for dynamic scenes from monocular videos. Prior approaches rely on costly test-time optimization of 4D representations or do not preserve scene geometry when trained in a feed-forward manner. Our approach is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Kaihua Chen , Tarasha Khurana , Deva Ramanan

In this paper, we explore the problem of 3D point cloud representation-based view synthesis from a set of sparse source views. To tackle this challenging problem, we propose a new deep learning-based view synthesis paradigm that learns a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Meng You , Mantang Guo , Xianqiang Lyu , Hui Liu , Junhui Hou

Diffusion models for single image novel view synthesis (NVS) can generate highly realistic and plausible images, but they are limited in the geometric consistency to the given relative poses. The generated images often show significant…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Josef Bengtson , David Nilsson , Fredrik Kahl

View synthesis aims to produce unseen views from a set of views captured by two or more cameras at different positions. This task is non-trivial since it is hard to conduct pixel-level matching among different views. To address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Zhuoman Liu , Wei Jia , Ming Yang , Peiyao Luo , Yong Guo , Mingkui Tan

Image-based geometric modeling and novel view synthesis based on sparse, large-baseline samplings are challenging but important tasks for emerging multimedia applications such as virtual reality and immersive telepresence. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Wenpeng Xing , Jie Chen , Zaifeng Yang , Qiang Wang

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Nagabhushan Somraj

Novel view synthesis (NVS) is a cornerstone for image-to-3d creation. However, existing works still struggle to maintain consistency between the generated views and the input views, especially when there is a significant camera pose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xuying Zhang , Yupeng Zhou , Kai Wang , Yikai Wang , Zhen Li , Shaohui Jiao , Daquan Zhou , Qibin Hou , Ming-Ming Cheng

We present Extreme View Synthesis, a solution for novel view extrapolation that works even when the number of input images is small--as few as two. In this context, occlusions and depth uncertainty are two of the most pressing issues, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Inchang Choi , Orazio Gallo , Alejandro Troccoli , Min H. Kim , Jan Kautz

Inspired by the remarkable success of Latent Diffusion Models (LDMs) for image synthesis, we study LDM for text-to-video generation, which is a formidable challenge due to the computational and memory constraints during both model training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiaxi Gu , Shicong Wang , Haoyu Zhao , Tianyi Lu , Xing Zhang , Zuxuan Wu , Songcen Xu , Wei Zhang , Yu-Gang Jiang , Hang Xu

Novel view synthesis (NVS) is a challenging task requiring systems to generate photorealistic images of scenes from new viewpoints, where both quality and speed are important for applications. Previous image-based rendering (IBR) methods…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Ang Cao , Chris Rockwell , Justin Johnson

We introduce a 3D-aware diffusion model, ZeroNVS, for single-image novel view synthesis for in-the-wild scenes. While existing methods are designed for single objects with masked backgrounds, we propose new techniques to address challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Kyle Sargent , Zizhang Li , Tanmay Shah , Charles Herrmann , Hong-Xing Yu , Yunzhi Zhang , Eric Ryan Chan , Dmitry Lagun , Li Fei-Fei , Deqing Sun , Jiajun Wu

Novel view synthesis often needs the paired data from both the source and target views. This paper proposes a view translation model under cVAE-GAN framework without requiring the paired data. We design a conditional deformable module (CDM)…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Mingyu Yin , Li Sun , Qingli Li

Content creation, central to applications such as virtual reality, can be a tedious and time-consuming. Recent image synthesis methods simplify this task by offering tools to generate new views from as little as a single input image, or by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Tewodros Habtegebrial , Varun Jampani , Orazio Gallo , Didier Stricker

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

In this paper, we present a novel diffusion model called that generates multiview-consistent images from a single-view image. Using pretrained large-scale 2D diffusion models, recent work Zero123 demonstrates the ability to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yuan Liu , Cheng Lin , Zijiao Zeng , Xiaoxiao Long , Lingjie Liu , Taku Komura , Wenping Wang

Existing real-time RGB-D reconstruction approaches, like Kinect Fusion, lack real-time photo-realistic visualization. This is due to noisy, oversmoothed or incomplete geometry and blurry textures which are fused from imperfect depth maps…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Laura Fink , Darius Rückert , Linus Franke , Joachim Keinert , Marc Stamminger

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

Large-scale text-to-image diffusion models have been a ground-breaking development in generating convincing images following an input text prompt. The goal of image editing research is to give users control over the generated images by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Chuanming Tang , Kai Wang , Joost van de Weijer
‹ Prev 1 8 9 10 Next ›