中文
相关论文

相关论文: GazeNeRF: 3D-Aware Gaze Redirection with Neural Ra…

200 篇论文

We propose a novel framework for 3D-aware object manipulation, called Auto-Encoding Neural Radiance Fields (AE-NeRF). Our model, which is formulated in an auto-encoder architecture, extracts disentangled 3D attributes such as 3D shape,…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Mira Kim , Jaehoon Ko , Kyusun Cho , Junmyeong Choi , Daewon Choi , Seungryong Kim

The goal of our work is to generate high-quality novel views from monocular videos of complex and dynamic scenes. Prior methods, such as DynamicNeRF, have shown impressive performance by leveraging time-varying dynamic radiation fields.…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Xingyu Miao , Yang Bai , Haoran Duan , Yawen Huang , Fan Wan , Yang Long , Yefeng Zheng

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs,…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Yang Hong , Bo Peng , Haiyao Xiao , Ligang Liu , Juyong Zhang

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

The problem of inferring object shape from a single 2D image is underconstrained. Prior knowledge about what objects are plausible can help, but even given such prior knowledge there may still be uncertainty about the shapes of occluded…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Matthew D. Hoffman , Tuan Anh Le , Pavel Sountsov , Christopher Suter , Ben Lee , Vikash K. Mansinghka , Rif A. Saurous

Industrial 3D face assets creation typically reconstructs topology-consistent face meshes from multi-view images for downstream production. However, high-quality reconstruction usually requires manual processing or specific capture…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Yating Wang , Ran Yi , Xiaoning Lei , Ke Fan , Jinkun Hao , Lizhuang Ma

X-ray, known for its ability to reveal internal structures of objects, is expected to provide richer information for 3D reconstruction than visible light. Yet, existing neural radiance fields (NeRF) algorithms overlook this important nature…

图像与视频处理 · 电气工程与系统科学 2024-03-26 Yuanhao Cai , Jiahao Wang , Alan Yuille , Zongwei Zhou , Angtian Wang

Existing neural reconstruction schemes such as Neural Radiance Field (NeRF) are largely focused on modeling opaque objects. We present a novel neural refractive field(NeReF) to recover wavefront of transparent fluids by simultaneously…

计算机视觉与模式识别 · 计算机科学 2022-03-09 Ziyu Wang , Wei Yang , Junming Cao , Lan Xu , Junqing Yu , Jingyi Yu

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

We present a method for automatically modifying a NeRF representation based on a single observation of a non-rigid transformed version of the original scene. Our method defines the transformation as a 3D flow, specifically as a weighted…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Zhenggang Tang , Zhongzheng Ren , Xiaoming Zhao , Bowen Wen , Jonathan Tremblay , Stan Birchfield , Alexander Schwing

We present a novel optimization algorithm called DroNeRF for the autonomous positioning of monocular camera drones around an object for real-time 3D reconstruction using only a few images. Neural Radiance Fields or NeRF, is a novel view…

机器人学 · 计算机科学 2023-08-08 Dipam Patel , Phu Pham , Aniket Bera

This paper presents BioNeRF, a biologically plausible architecture that models scenes in a 3D representation and synthesizes new views through radiance fields. Since NeRF relies on the network weights to store the scene's 3-dimensional…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Leandro A. Passos , Douglas Rodrigues , Danilo Jodas , Kelton A. P. Costa , Ahsan Adeel , João Paulo Papa

The recent surge in popularity of deep generative models for 3D objects has highlighted the need for more efficient training methods, particularly given the difficulties associated with training with conventional 3D representations, such as…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Adam Kania , Artur Kasymov , Jakub Kościukiewicz , Artur Górak , Marcin Mazur , Maciej Zięba , Przemysław Spurek

In this paper, we study the problem of continuous 3D shape representations. The majority of existing successful methods are coordinate-based implicit neural representations. However, they are inefficient to render novel views or recover…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Zhuoman Liu , Bo Yang , Yan Luximon , Ajay Kumar , Jinxi Li

A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Michael Fischer , Zhengqin Li , Thu Nguyen-Phuoc , Aljaz Bozic , Zhao Dong , Carl Marshall , Tobias Ritschel

This paper presents the first significant work on directly predicting 3D face landmarks on neural radiance fields (NeRFs). Our 3D coarse-to-fine Face Landmarks NeRF (FLNeRF) model efficiently samples from a given face NeRF with individual…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Hao Zhang , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as editing individual 2D…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Sara Rojas , Julien Philip , Kai Zhang , Sai Bi , Fujun Luan , Bernard Ghanem , Kalyan Sunkavall

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li