中文
相关论文

相关论文: NeRDi: Single-View NeRF Synthesis with Language-Gu…

200 篇论文

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

Single-view novel view synthesis (NVS), the task of generating images from new viewpoints based on a single reference image, is important but challenging in computer vision. Recent advancements in NVS have leveraged Denoising Diffusion…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Yifeng Xiong , Haoyu Ma , Shanlin Sun , Kun Han , Hao Tang , Xiaohui Xie

3D object reconstruction from single-view image is a fundamental task in computer vision with wide-ranging applications. Recent advancements in Large Reconstruction Models (LRMs) have shown great promise in leveraging multi-view images…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Zhiyuan Wu , Xibin Song , Senbo Wang , Weizhe Liu , Jiayu Yang , Ziang Cheng , Shenzhou Chen , Taizhang Shang , Weixuan Sun , Shan Luo , Pan Ji

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang

We present a method for automatically modifying a NeRF representation based on a single observation of a non-rigid transformed version of the original scene. Our method defines the transformation as a 3D flow, specifically as a weighted…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Zhenggang Tang , Zhongzheng Ren , Xiaoming Zhao , Bowen Wen , Jonathan Tremblay , Stan Birchfield , Alexander Schwing

Recent advancements in 4D scene reconstruction using neural radiance fields (NeRF) have demonstrated the ability to represent dynamic scenes from multi-view videos. However, they fail to reconstruct the dynamic scenes and struggle to fit…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Seoha Kim , Jeongmin Bae , Youngsik Yun , Hahyun Lee , Gun Bang , Youngjung Uh

We introduce a novel framework for solving inverse problems using NeRF-style generative models. We are interested in the problem of 3-D scene reconstruction given a single 2-D image and known camera parameters. We show that naively…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Giannis Daras , Wen-Sheng Chu , Abhishek Kumar , Dmitry Lagun , Alexandros G. Dimakis

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Titas Anciukevičius , Fabian Manhardt , Federico Tombari , Paul Henderson

Neural Radiance Field (NeRF) has achieved substantial progress in novel view synthesis given multi-view images. Recently, some works have attempted to train a NeRF from a single image with 3D priors. They mainly focus on a limited field of…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Guangcong Wang , Peng Wang , Zhaoxi Chen , Wenping Wang , Chen Change Loy , Ziwei Liu

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

Recent advances in diffusion models have enabled 3D generation from a single image. However, current methods often produce suboptimal results for novel views, with blurred textures and deviations from the reference image, limiting their…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Wangbo Yu , Li Yuan , Yan-Pei Cao , Xiangjun Gao , Xiaoyu Li , Wenbo Hu , Long Quan , Ying Shan , Yonghong Tian

This paper tackles the problem of novel view synthesis from a single image. In particular, we target real-world scenes with rich geometric structure, a challenging task due to the large appearance variations of such scenes and the lack of…

计算机视觉与模式识别 · 计算机科学 2018-04-18 Miaomiao Liu , Xuming He , Mathieu Salzmann

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Yinghao Xu , Hao Tan , Fujun Luan , Sai Bi , Peng Wang , Jiahao Li , Zifan Shi , Kalyan Sunkavalli , Gordon Wetzstein , Zexiang Xu , Kai Zhang

This paper introduces MIDI, a novel paradigm for compositional 3D scene generation from a single image. Unlike existing methods that rely on reconstruction or retrieval techniques or recent approaches that employ multi-stage…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Zehuan Huang , Yuan-Chen Guo , Xingqiao An , Yunhan Yang , Yangguang Li , Zi-Xin Zou , Ding Liang , Xihui Liu , Yan-Pei Cao , Lu Sheng

Synthesizing novel views from a single input image is a challenging task. It requires extrapolating the 3D structure of a scene while inferring details in occluded regions, and maintaining geometric consistency across viewpoints. Many…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Sehajdeep Singh , A V Subramanyam , Aditya Gupta , Sahil Gupta