中文
相关论文

相关论文: Neural Human Performer: Learning Generalizable Rad…

200 篇论文

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

图形学 · 计算机科学 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

Neural radiance fields (NeRF) appeared recently as a powerful tool to generate realistic views of objects and confined areas. Still, they face serious challenges with open scenes, where the camera has unrestricted movement and content can…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Ahmad AlMughrabi , Umair Haroon , Ricardo Marques , Petia Radeva

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

计算机视觉与模式识别 · 计算机科学 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

Neural Radiance Fields (NeRF) have become an increasingly popular representation to capture high-quality appearance and shape of scenes and objects. However, learning generalizable NeRF priors over categories of scenes or objects has been…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Bipasha Sen , Gaurav Singh , Aditya Agarwal , Rohith Agaram , K Madhava Krishna , Srinath Sridhar

We present a feed-forward human performance capture method that renders novel views of a performer from a monocular RGB stream. A key challenge in this setting is the lack of sufficient observations, especially for unseen regions. Assuming…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Youngjoong Kwon , Yao He , Heejung Choi , Chen Geng , Zhengmao Liu , Jiajun Wu , Ehsan Adeli

Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Ze-Xin Yin , Peng-Yi Jiao , Jiaxiong Qiu , Ming-Ming Cheng , Bo Ren

This work addresses the problem of real-time rendering of photorealistic human body avatars learned from multi-view videos. While the classical approaches to model and render virtual humans generally use a textured mesh, recent research has…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Arthur Moreau , Jifei Song , Helisa Dhamo , Richard Shaw , Yiren Zhou , Eduardo Pérez-Pellitero

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

计算机视觉与模式识别 · 计算机科学 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Chen Gao , Yipeng Wang , Changil Kim , Jia-Bin Huang , Johannes Kopf

We present PersonNeRF, a method that takes a collection of photos of a subject (e.g. Roger Federer) captured across multiple years with arbitrary body poses and appearances, and enables rendering the subject with arbitrary novel…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Chung-Yi Weng , Pratul P. Srinivasan , Brian Curless , Ira Kemelmacher-Shlizerman

We present a method for estimating Neural Radiance Fields (NeRF) from a single headshot portrait. While NeRF has demonstrated high-quality view synthesis, it requires multiple images of static scenes and thus impractical for casual captures…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Chen Gao , Yichang Shih , Wei-Sheng Lai , Chia-Kai Liang , Jia-Bin Huang

This paper proposes an end-to-end framework for generating 3D human pose datasets using Neural Radiance Fields (NeRF). Public datasets generally have limited diversity in terms of human poses and camera viewpoints, largely due to the…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Mohsen Gholami , Rabab Ward , Z. Jane Wang

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

This paper introduces Motion-oriented Compositional Neural Radiance Fields (MoCo-NeRF), a framework designed to perform free-viewpoint rendering of monocular human videos via novel non-rigid motion modeling approach. In the context of…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jaehyeok Kim , Dongyoon Wee , Dan Xu

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

Modeling Neural Radiance Fields for fast-moving deformable objects from visual data alone is a challenging problem. A major issue arises due to the high deformation and low acquisition rates. To address this problem, we propose to use event…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Qi Ma , Danda Pani Paudel , Ajad Chhatkuli , Luc Van Gool

Neural Radiance Fields (NeRFs) aim to synthesize novel views of objects and scenes, given the object-centric camera views with large overlaps. However, we conjugate that this paradigm does not fit the nature of the street views that are…

计算机视觉与模式识别 · 计算机科学 2023-03-02 Ziyang Xie , Junge Zhang , Wenye Li , Feihu Zhang , Li Zhang

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

图形学 · 计算机科学 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

In recent studies, the generalization of neural radiance fields for novel view synthesis task has been widely explored. However, existing methods are limited to objects and indoor scenes. In this work, we extend the generalization task to…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Liang Song , Guangming Wang , Jiuming Liu , Zhenyang Fu , Yanzi Miao , Hesheng

Recently, neural radiance field (NeRF) has shown remarkable performance in novel view synthesis and 3D reconstruction. However, it still requires abundant high-quality images, limiting its applicability in real-world scenarios. To overcome…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Jaewoo Jung , Jisang Han , Jiwon Kang , Seongchan Kim , Min-Seop Kwak , Seungryong Kim