中文
相关论文

相关论文: MPS-NeRF: Generalizable 3D Human Rendering from Mu…

200 篇论文

While recent advancements in animatable human rendering have achieved remarkable results, they require test-time optimization for each subject which can be a significant limitation for real-world applications. To address this, we tackle the…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Mana Masuda , Jinhyung Park , Shun Iwase , Rawal Khirodkar , Kris Kitani

We present a new approach for synthesizing novel views of people in new poses. Our novel differentiable renderer enables the synthesis of highly realistic images from any viewpoint. Rather than operating over mesh-based structures, our…

计算机视觉与模式识别 · 计算机科学 2022-02-22 Guillaume Rochette , Chris Russell , Richard Bowden

This paper presents a novel approach for sparse 3D reconstruction by leveraging the expressive power of Neural Radiance Fields (NeRFs) and fast transfer of their features to learn accurate occupancy fields. Existing 3D reconstruction…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Shubhendu Jena , Franck Multon , Adnane Boukhayma

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

图形学 · 计算机科学 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

Novel view synthesis using neural radiance fields (NeRF) is the state-of-the-art technique for generating high-quality images from novel viewpoints. Existing methods require a priori knowledge about extrinsic and intrinsic camera…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Hannah Schieber , Fabian Deuser , Bernhard Egger , Norbert Oswald , Daniel Roth

Neural Radiance Field (NeRF) has shown impressive performance in novel view synthesis via implicit scene representation. However, it usually suffers from poor scalability as requiring densely sampled images for each new scene. Several…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Muyu Xu , Fangneng Zhan , Jiahui Zhang , Yingchen Yu , Xiaoqin Zhang , Christian Theobalt , Ling Shao , Shijian Lu

We introduce AutoRF - a new approach for learning neural 3D object representations where each object in the training set is observed by only a single view. This setting is in stark contrast to the majority of existing works that leverage…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Norman Müller , Andrea Simonelli , Lorenzo Porzi , Samuel Rota Bulò , Matthias Nießner , Peter Kontschieder

In the rapidly evolving landscape of digital content creation, the demand for fast, convenient, and autonomous methods of crafting detailed 3D reconstructions of humans has grown significantly. Addressing this pressing need, our AirNeRF…

机器人学 · 计算机科学 2024-07-16 Alexey Kotcov , Maria Dronova , Vladislav Cheremnykh , Sausar Karaf , Dzmitry Tsetserukou

Modeling the human body in a canonical space is a common practice for capturing and animation. But when involving the neural radiance field (NeRF), learning a static NeRF in the canonical space is not enough because the lighting of the body…

计算机视觉与模式识别 · 计算机科学 2022-09-01 Yihao Zhi , Shenhan Qian , Xinhao Yan , Shenghua Gao

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou

Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for realizing autonomous…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Shreya Saha , Zekai Liang , Shan Lin , Jingpei Lu , Michael Yip , Sainan Liu

Face rendering using neural radiance fields (NeRF) is a rapidly developing research area in computer vision. While recent methods primarily focus on controlling facial attributes such as identity and expression, they often overlook the…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Hengfei Wang , Zhongqun Zhang , Yihua Cheng , Hyung Jin Chang

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

Photo-realistic neural reconstruction and rendering of the human portrait are critical for numerous VR/AR applications. Still, existing solutions inherently rely on multi-view capture settings, and the one-shot solution to get rid of the…

计算机视觉与模式识别 · 计算机科学 2021-05-17 Ziyu Wang , Liao Wang , Fuqiang Zhao , Minye Wu , Lan Xu , Jingyi Yu

Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Hanxin Zhu , Tianyu He , Zhibo Chen

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

In this paper, we propose PixelHuman, a novel human rendering model that generates animatable human scenes from a few images of a person with unseen identity, views, and poses. Previous work have demonstrated reasonable performance in novel…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Gyumin Shim , Jaeseong Lee , Junha Hyung , Jaegul Choo

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel