中文
相关论文

相关论文: FewShotNeRF: Meta-Learning-based Novel View Synthe…

200 篇论文

In the field of media production, video editing techniques play a pivotal role. Recent approaches have had great success at performing novel view image synthesis of static scenes. But adding temporal information adds an extra layer of…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Violeta Menéndez González , Andrew Gilbert , Graeme Phillipson , Stephen Jolly , Simon Hadfield

Generalizability and few-shot learning are key challenges in Neural Radiance Fields (NeRF), often due to the lack of a holistic understanding in pixel-level rendering. We introduce CaesarNeRF, an end-to-end approach that leverages…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Haidong Zhu , Tianyu Ding , Tianyi Chen , Ilya Zharkov , Ram Nevatia , Luming Liang

Neural Radiance Fields (NeRFs) increase reconstruction detail for novel view synthesis and scene reconstruction, with applications ranging from large static scenes to dynamic human motion. However, the increased resolution and model-free…

计算机视觉与模式识别 · 计算机科学 2022-06-27 Abiramy Kuganesan , Shih-yang Su , James J. Little , Helge Rhodin

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Neural Radiance Field (NeRF) has shown impressive performance in novel view synthesis via implicit scene representation. However, it usually suffers from poor scalability as requiring densely sampled images for each new scene. Several…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Muyu Xu , Fangneng Zhan , Jiahui Zhang , Yingchen Yu , Xiaoqin Zhang , Christian Theobalt , Ling Shao , Shijian Lu

Editing a local region or a specific object in a 3D scene represented by a NeRF or consistently blending a new realistic object into the scene is challenging, mainly due to the implicit nature of the scene representation. We present…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Ori Gordon , Omri Avrahami , Dani Lischinski

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

计算机视觉与模式识别 · 计算机科学 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

In this paper, we are interested in the few-shot learning problem. In particular, we focus on a challenging scenario where the number of categories is large and the number of examples per novel category is very limited, e.g. 1, 2, or 3.…

计算机视觉与模式识别 · 计算机科学 2017-11-28 Siyuan Qiao , Chenxi Liu , Wei Shen , Alan Yuille

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

We study the problem of novel view synthesis of objects from a single image. Existing methods have demonstrated the potential in single-view view synthesis. However, they still fail to recover the fine appearance details, especially in…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Xingyi Li , Chaoyi Hong , Yiran Wang , Zhiguo Cao , Ke Xian , Guosheng Lin

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural radiance field to RGB images. However, NeRF requires querying a deep Multi-Layer Perceptron (MLP) millions of times, leading to slow rendering times,…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Christian Reiser , Songyou Peng , Yiyi Liao , Andreas Geiger

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view images. However, such…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Zixiong Huang , Qi Chen , Libo Sun , Yifan Yang , Naizhou Wang , Mingkui Tan , Qi Wu

This paper aims to tackle the challenge of efficiently producing interactive free-viewpoint videos. Some recent works equip neural radiance fields with image encoders, enabling them to generalize across scenes. When processing dynamic…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Haotong Lin , Sida Peng , Zhen Xu , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim