中文
相关论文

相关论文: FSViewFusion: Few-Shots View Generation of Novel O…

200 篇论文

The field of novel view synthesis from images has seen rapid advancements with the introduction of Neural Radiance Fields (NeRF) and more recently with 3D Gaussian Splatting. Gaussian Splatting became widely adopted due to its efficiency…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Ruihong Yin , Vladimir Yugay , Yue Li , Sezer Karaoglu , Theo Gevers

Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications that provide immersive experiences. However, most existing techniques can only synthesize novel views within a limited range of…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Hung-Yu Tseng , Qinbo Li , Changil Kim , Suhib Alsisan , Jia-Bin Huang , Johannes Kopf

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Novel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts. We introduce Deceptive-NeRF/3DGS to enhance sparse-view…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Xinhang Liu , Jiaben Chen , Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

Synthesizing a novel view from a single input image is a challenging task. Traditionally, this task was approached by estimating scene depth, warping, and inpainting, with machine learning models enabling parts of the pipeline. More…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Noam Elata , Bahjat Kawar , Yaron Ostrovsky-Berman , Miriam Farber , Ron Sokolovsky

Utilizing pre-trained 2D large-scale generative models, recent works are capable of generating high-quality novel views from a single in-the-wild image. However, due to the lack of information from multiple views, these works encounter…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Yunhan Yang , Yukun Huang , Xiaoyang Wu , Yuan-Chen Guo , Song-Hai Zhang , Hengshuang Zhao , Tong He , Xihui Liu

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

We present Knowledge NeRF to synthesize novel views for dynamic scenes. Reconstructing dynamic 3D scenes from few sparse views and rendering them from arbitrary perspectives is a challenging problem with applications in various domains.…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Wenxiao Cai , Xinyue Lei , Xinyu He , Junming Leo Chen , Yangang Wang

We present a method for generating consistent novel views from a single source image. Our approach focuses on maximizing the reuse of visible pixels from the source image. To achieve this, we use a monocular depth estimator that transfers…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Yash Kant , Aliaksandr Siarohin , Michael Vasilkovsky , Riza Alp Guler , Jian Ren , Sergey Tulyakov , Igor Gilitschenski

Modern learning-based approaches to 3D-aware image synthesis achieve high photorealism and 3D-consistent viewpoint changes for the generated images. Existing approaches represent instances in a shared canonical space. However, for…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Katja Schwarz , Seung Wook Kim , Jun Gao , Sanja Fidler , Andreas Geiger , Karsten Kreis

Current methods for 3D scene reconstruction from sparse posed images employ intermediate 3D representations such as neural fields, voxel grids, or 3D Gaussians, to achieve multi-view consistent scene appearance and geometry. In this paper…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Vitor Guizilini , Muhammad Zubair Irshad , Dian Chen , Greg Shakhnarovich , Rares Ambrus

Current 4D generation methods have achieved noteworthy efficacy with the aid of advanced diffusion generative models. However, these methods lack multi-view spatial-temporal modeling and encounter challenges in integrating diverse prior…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

We introduce TurboPortrait3D: a method for low-latency novel-view synthesis of human portraits. Our approach builds on the observation that existing image-to-3D models for portrait generation, while capable of producing renderable 3D…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Emily Kim , Julieta Martinez , Timur Bagautdinov , Jessica Hodgins

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. Despite numerous task-specific methods, developing a comprehensive model remains challenging. In this paper, we present…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Hansheng Chen , Jiatao Gu , Anpei Chen , Wei Tian , Zhuowen Tu , Lingjie Liu , Hao Su

We present 3DiM, a diffusion model for 3D novel view synthesis, which is able to translate a single input view into consistent and sharp completions across many views. The core component of 3DiM is a pose-conditional image-to-image…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Daniel Watson , William Chan , Ricardo Martin-Brualla , Jonathan Ho , Andrea Tagliasacchi , Mohammad Norouzi

Synthesizing novel view images from a few views is a challenging but practical problem. Existing methods often struggle with producing high-quality results or necessitate per-object optimization in such few-view settings due to the…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Paul Yoo , Jiaxian Guo , Yutaka Matsuo , Shixiang Shane Gu

Despite recent advances in Novel View Synthesis (NVS), generating high-fidelity views from single or sparse observations remains a significant challenge. Existing splatting-based approaches often produce distorted geometry due to splatting…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Xiang Zhang , Yang Zhang , Lukas Mehl , Markus Gross , Christopher Schroers

Novel view synthesis from limited observations remains an important and persistent task. However, high efficiency in existing NeRF-based few-shot view synthesis is often compromised to obtain an accurate 3D representation. To address this…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Zehao Zhu , Zhiwen Fan , Yifan Jiang , Zhangyang Wang

Repurposing pre-trained diffusion models has been proven to be effective for NVS. However, these methods are mostly limited to a single object; directly applying such methods to compositional multi-object scenarios yields inferior results,…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Ruijie Lu , Yixin Chen , Junfeng Ni , Baoxiong Jia , Yu Liu , Diwen Wan , Gang Zeng , Siyuan Huang

In this paper, we propose VistaDream a novel framework to reconstruct a 3D scene from a single-view image. Recent diffusion models enable generating high-quality novel-view images from a single-view input image. Most existing methods only…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Haiping Wang , Yuan Liu , Ziwei Liu , Wenping Wang , Zhen Dong , Bisheng Yang