中文
相关论文

相关论文: Controllable Radiance Fields for Dynamic Face Synt…

200 篇论文

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Authoring 3D scenes is a central task for spatial computing applications. Competing visions for lowering existing barriers are (1) focus on immersive, direct manipulation of 3D content or (2) leverage AI techniques that capture real scenes…

人机交互 · 计算机科学 2025-12-29 Cyrus Vachha , Yixiao Kang , Zach Dive , Ashwat Chidambaram , Anik Gupta , Eunice Jun , Bjoern Hartmann

Neural Radiance Fields (NeRF) achieves unprecedented performance in synthesizing novel view synthesis, utilizing multi-view consistency. When capturing multiple inputs, image signal processing (ISP) in modern cameras will independently…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Yuehao Wang , Chaoyi Wang , Bingchen Gong , Tianfan Xue

This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Benedict Quartey , Tuluhan Akbulut , Wasiwasi Mgonzo , Zheng Xin Yong

Multi-camera setups find widespread use across various applications, such as autonomous driving, as they greatly expand sensing capabilities. Despite the fast development of Neural radiance field (NeRF) techniques and their wide…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Kai Cheng , Xiaoxiao Long , Wei Yin , Jin Wang , Zhiqiang Wu , Yuexin Ma , Kaixuan Wang , Xiaozhi Chen , Xuejin Chen

We present a method for transferring the artistic features of an arbitrary style image to a 3D scene. Previous methods that perform 3D stylization on point clouds or meshes are sensitive to geometric reconstruction errors for complex…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Kai Zhang , Nick Kolkin , Sai Bi , Fujun Luan , Zexiang Xu , Eli Shechtman , Noah Snavely

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

计算机视觉与模式识别 · 计算机科学 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

Generating photo-realistic video portrait with arbitrary speech audio is a crucial problem in film-making and virtual reality. Recently, several works explore the usage of neural radiance field in this task to improve 3D realness and image…

计算机视觉与模式识别 · 计算机科学 2023-02-01 Zhenhui Ye , Ziyue Jiang , Yi Ren , Jinglin Liu , JinZheng He , Zhou Zhao

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao

Despite the great success in 2D editing using user-friendly tools, such as Photoshop, semantic strokes, or even text prompts, similar capabilities in 3D areas are still limited, either relying on 3D modeling skills or allowing editing…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Chong Bao , Yinda Zhang , Bangbang Yang , Tianxing Fan , Zesong Yang , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

With the advent of Neural Radiance Field (NeRF), representing 3D scenes through multiple observations has shown remarkable improvements in performance. Since this cutting-edge technique is able to obtain high-resolution renderings by…

机器人学 · 计算机科学 2023-09-18 Minjae Lee , Kyeongsu Kang , Hyeonwoo Yu

The performance of face recognition (FR) systems applied in video surveillance has been shown to improve when the design data is augmented through synthetic face generation. This is true, for instance, with pair-wise matchers (e.g., deep…

计算机视觉与模式识别 · 计算机科学 2019-11-01 Fania Mokhayeri , Kaveh Kamali , Eric Granger

Style transfer for human face has been widely researched in recent years. Majority of the existing approaches work in 2D image domain and have 3D inconsistency issue when applied on different viewpoints of the same face. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-11-23 Jianwei Feng , Prateek Singhal

In this paper, we present an approach for combining non-rigid structure-from-motion (NRSfM) with deep generative models,and propose an efficient framework for discovering trajectories in the latent space of 2D GANs corresponding to changes…

计算机视觉与模式识别 · 计算机科学 2022-11-15 René Haas , Stella Graßhof , Sami S. Brandt

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv

Face reenactment is challenging due to the need to establish dense correspondence between various face representations for motion transfer. Recent studies have utilized Neural Radiance Field (NeRF) as fundamental representation, which…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Songlin Yang , Wei Wang , Yushi Lan , Xiangyu Fan , Bo Peng , Lei Yang , Jing Dong