中文
相关论文

相关论文: Controllable Dynamic Appearance for Neural 3D Port…

200 篇论文

Facial 3D Morphable Models are a main computer vision subject with countless applications and have been highly optimized in the last two decades. The tremendous improvements of deep generative networks have created various possibilities for…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Stathis Galanakis , Baris Gecer , Alexandros Lattas , Stefanos Zafeiriou

We present a novel optimization algorithm called DroNeRF for the autonomous positioning of monocular camera drones around an object for real-time 3D reconstruction using only a few images. Neural Radiance Fields or NeRF, is a novel view…

机器人学 · 计算机科学 2023-08-08 Dipam Patel , Phu Pham , Aniket Bera

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

Neural Radiance Fields (NeRF) have achieved huge success in effectively capturing and representing 3D objects and scenes. However, to establish a ubiquitous presence in everyday media formats, such as images and videos, we need to fulfill…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Gyeongjin Kang , Younggeun Lee , Seungjun Oh , Eunbyung Park

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Current methods for 3D reconstruction and environmental mapping frequently face challenges in achieving high precision, highlighting the need for practical and effective solutions. In response to this issue, our study introduces FlyNeRF, a…

机器人学 · 计算机科学 2024-04-22 Maria Dronova , Vladislav Cheremnykh , Alexey Kotcov , Aleksey Fedoseev , Dzmitry Tsetserukou

This paper presents the first significant work on directly predicting 3D face landmarks on neural radiance fields (NeRFs). Our 3D coarse-to-fine Face Landmarks NeRF (FLNeRF) model efficiently samples from a given face NeRF with individual…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Hao Zhang , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Benedict Quartey , Tuluhan Akbulut , Wasiwasi Mgonzo , Zheng Xin Yong

NeRFs have achieved incredible success in novel view synthesis. However, the accuracy of the implicit geometry is unsatisfactory because the passive static environmental illumination has low spatial frequency and cannot provide enough…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Jianyu Tao , Changping Hu , Edward Yang , Jing Xu , Rui Chen

Compared to frame-based methods, computational neuromorphic imaging using event cameras offers significant advantages, such as minimal motion blur, enhanced temporal resolution, and high dynamic range. The multi-view consistency of Neural…

计算机视觉与模式识别 · 计算机科学 2025-01-08 Chaoran Feng , Wangbo Yu , Xinhua Cheng , Zhenyu Tang , Junwu Zhang , Li Yuan , Yonghong Tian

Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shapes, expressions,…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Keqiang Sun , Shangzhe Wu , Zhaoyang Huang , Ning Zhang , Quan Wang , HongSheng Li

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto

3D face generation has achieved high visual quality and 3D consistency thanks to the development of neural radiance fields (NeRF). Recently, to generate and edit 3D faces with NeRF representation, some methods are proposed and achieve good…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Wenyang Zhou , Lu Yuan , Shuyu Chen , Lin Gao , Shimin Hu

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

图形学 · 计算机科学 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

We propose a novel framework for 3D-aware object manipulation, called Auto-Encoding Neural Radiance Fields (AE-NeRF). Our model, which is formulated in an auto-encoder architecture, extracts disentangled 3D attributes such as 3D shape,…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Mira Kim , Jaehoon Ko , Kyusun Cho , Junmyeong Choi , Daewon Choi , Seungryong Kim

The problem of inferring object shape from a single 2D image is underconstrained. Prior knowledge about what objects are plausible can help, but even given such prior knowledge there may still be uncertainty about the shapes of occluded…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Matthew D. Hoffman , Tuan Anh Le , Pavel Sountsov , Christopher Suter , Ben Lee , Vikash K. Mansinghka , Rif A. Saurous

Neural Radiance Fields (NeRF) achieve remarkable performance in dense multi-view scenarios, but their reconstruction quality degrades significantly under sparse inputs due to geometric artifacts. Existing methods utilize global depth…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Weiqi Yu , Yiyang Yao , Lin He , Jianming Lv

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

We propose GazeNeRF, a 3D-aware method for the task of gaze redirection. Existing gaze redirection methods operate on 2D images and struggle to generate 3D consistent results. Instead, we build on the intuition that the face region and…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Alessandro Ruzzi , Xiangwei Shi , Xi Wang , Gengyan Li , Shalini De Mello , Hyung Jin Chang , Xucong Zhang , Otmar Hilliges