中文
相关论文

相关论文: Learning Dense Correspondence for NeRF-Based Face …

200 篇论文

Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Miriam Jäger , Patrick Hübner , Dennis Haitz , Boris Jutzi

Recent research has demonstrated that the combination of pretrained diffusion models with neural radiance fields (NeRFs) has emerged as a promising approach for text-to-3D generation. Simply coupling NeRF with diffusion models will result…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Lu Yu , Wei Xiang , Kang Han

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Implicit surfaces via neural radiance fields (NeRF) have shown surprising accuracy in surface reconstruction. Despite their success in reconstructing richly textured surfaces, existing methods struggle with planar regions with weak…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Albert Gassol Puigjaner , Edoardo Mello Rella , Erik Sandström , Ajad Chhatkuli , Luc Van Gool

Modeling hand-object interactions is a fundamentally challenging task in 3D computer vision. Despite remarkable progress that has been achieved in this field, existing methods still fail to synthesize the hand-object interaction…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Zhongqun Zhang , Jifei Song , Eduardo Pérez-Pellitero , Yiren Zhou , Hyung Jin Chang , Aleš Leonardis

Deep Implicit Functions (DIFs) have gained popularity in 3D computer vision due to their compactness and continuous representation capabilities. However, addressing dense correspondences and semantic relationships across DIF-encoded shapes…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Kun Han , Shanlin Sun , Xiaohui Xie

Neural Radiance Field(NeRF) is an novel implicit method to achieve the 3D reconstruction and representation with a high resolution. After the first research of NeRF is proposed, NeRF has gained a robust developing power and is booming in…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Jinwei Lin

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

Humans describe the physical world using natural language to refer to specific 3D locations based on a vast range of properties: visual appearance, semantics, abstract associations, or actionable affordances. In this work we propose…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Justin Kerr , Chung Min Kim , Ken Goldberg , Angjoo Kanazawa , Matthew Tancik

3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Xiangyu Zhu , Chang Yu , Di Huang , Zhen Lei , Hao Wang , Stan Z. Li

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

图形学 · 计算机科学 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

Talking head synthesis is a practical technique with wide applications. Current Neural Radiance Field (NeRF) based approaches have shown their superiority on driving one-shot talking heads with videos or signals regressed from audio.…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Dongze Li , Kang Zhao , Wei Wang , Yifeng Ma , Bo Peng , Yingya Zhang , Jing Dong

Collaborative mapping of unknown environments can be done faster and more robustly than a single robot. However, a collaborative approach requires a distributed paradigm to be scalable and deal with communication issues. This work presents…

机器人学 · 计算机科学 2025-08-08 Mahboubeh Asadi , Kourosh Zareinia , Sajad Saeedi

This paper presents a novel approach for sparse 3D reconstruction by leveraging the expressive power of Neural Radiance Fields (NeRFs) and fast transfer of their features to learn accurate occupancy fields. Existing 3D reconstruction…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Shubhendu Jena , Franck Multon , Adnane Boukhayma

In this paper, we propose a learning-based framework for non-rigid shape registration without correspondence supervision. Traditional shape registration techniques typically rely on correspondences induced by extrinsic proximity, therefore…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Puhua Jiang , Mingze Sun , Ruqi Huang

We propose INFAMOUS-NeRF, an implicit morphable face model that introduces hypernetworks to NeRF to improve the representation power in the presence of many training subjects. At the same time, INFAMOUS-NeRF resolves the classic…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Andrew Hou , Feng Liu , Zhiyuan Ren , Michel Sarkis , Ning Bi , Yiying Tong , Xiaoming Liu

In recent advances of deep generative models, face reenactment -manipulating and controlling human face, including their head movement-has drawn much attention for its wide range of applicability. Despite its strong expressiveness, it is…

计算机视觉与模式识别 · 计算机科学 2022-02-23 Takuya Yashima , Takuya Narihira , Tamaki Kojima