中文
相关论文

相关论文: Generative View Synthesis: From Single-view Semant…

200 篇论文

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

计算机视觉与模式识别 · 计算机科学 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen

Novel view synthesis from a single image has recently achieved remarkable results, although the requirement of some form of 3D, pose, or multi-view supervision at training time limits the deployment in real scenarios. This work aims at…

计算机视觉与模式识别 · 计算机科学 2021-12-16 Pierluigi Zama Ramirez , Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

Conventional depth-free multi-view datasets are captured using a moving monocular camera without metric calibration. The scales of camera positions in this monocular setting are ambiguous. Previous methods have acknowledged scale ambiguity…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Fereshteh Forghani , Jason J. Yu , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Marcus A. Brubaker

Existing view synthesis methods mainly focus on the perspective images and have shown promising results. However, due to the limited field-of-view of the pinhole camera, the performance quickly degrades when large camera movements are…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Jiale Xu , Jia Zheng , Yanyu Xu , Rui Tang , Shenghua Gao

Zero-shot novel view synthesis (NVS) from a single image is an essential problem in 3D object understanding. While recent approaches that leverage pre-trained generative models can synthesize high-quality novel views from in-the-wild…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Jianglong Ye , Peng Wang , Kejie Li , Yichun Shi , Heng Wang

In recent years, there has been a growing interest in Semantic Image Synthesis (SIS) through the use of Generative Adversarial Networks (GANs) and diffusion models. This field has seen innovations such as the implementation of specialized…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Khaled M. Seyam , Julian Wiederer , Markus Braun , Bin Yang

Novel view synthesis requires strong 3D geometric consistency and the ability to generate visually coherent images across diverse viewpoints. While recent camera-controlled video diffusion models show promising results, they often suffer…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Minjun Kang , Inkyu Shin , Taeyeop Lee , Myungchul Kim , In So Kweon , Kuk-Jin Yoon

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

Novel view synthesis (NVS) from a single image is highly ill-posed due to large unobserved regions, especially for views that deviate significantly from the input. While existing methods focus on consistency between the source and generated…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Xueyang Kang , Zhengkang Xiang , Zezheng Zhang , Kourosh Khoshelham

We present a generalizable novel view synthesis method which enables modifying the visual appearance of an observed scene so rendered views match a target weather or lighting condition without any scene specific training or access to…

计算机视觉与模式识别 · 计算机科学 2024-01-29 Josef Bengtson , David Nilsson , Che-Tsung Lin , Marcel Büsching , Fredrik Kahl

Accurate reconstruction of complex dynamic scenes from just a single viewpoint continues to be a challenging task in computer vision. Current dynamic novel view synthesis methods typically require videos from many different camera…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Basile Van Hoorick , Rundi Wu , Ege Ozguroglu , Kyle Sargent , Ruoshi Liu , Pavel Tokmakov , Achal Dave , Changxi Zheng , Carl Vondrick

Recent single-view 3D generative methods have made significant advancements by leveraging knowledge distilled from extensive 3D object datasets. However, challenges persist in the synthesis of 3D scenes from a single view, primarily due to…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Guo Pu , Yiming Zhao , Zhouhui Lian

In this paper, we propose the first generalizable view synthesis approach that specifically targets multi-view stereo-camera images. Since recent stereo matching has demonstrated accurate geometry prediction, we introduce stereo matching…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Haechan Lee , Wonjoon Jin , Seung-Hwan Baek , Sunghyun Cho

Novel View Synthesis (NVS) aims to generate unseen views of a 3D object given a limited number of known views. Existing methods often struggle to synthesize plausible views for unobserved regions, particularly under single-view input, and…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Jinglin Liang , Zijian Zhou , Rui Huang , Shuangping Huang , Yichen Gong

Existing reconstruction-based novel view synthesis methods for driving scenes focus on synthesizing camera views along the recorded trajectory of the ego vehicle. Their image rendering performance will severely degrade on viewpoints falling…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Qitai Wang , Lue Fan , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang

We introduce a novel approach that takes a single semantic mask as input to synthesize multi-view consistent color images of natural scenes, trained with a collection of single images from the Internet. Prior works on 3D-aware image…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Shangzan Zhang , Sida Peng , Tianrun Chen , Linzhan Mou , Haotong Lin , Kaicheng Yu , Yiyi Liao , Xiaowei Zhou

Synthesizing novel views from monocular videos of dynamic scenes remains a challenging problem. Scene-specific methods that optimize 4D representations with explicit motion priors often break down in highly dynamic regions where multi-view…

In this paper, we present TOSS, which introduces text to the task of novel view synthesis (NVS) from just a single RGB image. While Zero-1-to-3 has demonstrated impressive zero-shot open-set NVS capability, it treats NVS as a pure…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Yukai Shi , Jianan Wang , He Cao , Boshi Tang , Xianbiao Qi , Tianyu Yang , Yukun Huang , Shilong Liu , Lei Zhang , Heung-Yeung Shum

Recent advancements in generative models have significantly improved novel view synthesis (NVS) from multi-view data. However, existing methods depend on external multi-view alignment processes, such as explicit pose estimation or…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Lingen Li , Zhaoyang Zhang , Yaowei Li , Jiale Xu , Wenbo Hu , Xiaoyu Li , Weihao Cheng , Jinwei Gu , Tianfan Xue , Ying Shan

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson