中文
相关论文

相关论文: Controllable Radiance Fields for Dynamic Face Synt…

200 篇论文

Capturing and re-animating the 3D structure of articulated objects present significant barriers. On one hand, methods requiring extensively calibrated multi-view setups are prohibitively complex and resource-intensive, limiting their…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Heng Yu , Joel Julin , Zoltán Á. Milacski , Koichiro Niinuma , László A. Jeni

Neural radiance fields (NeRF) based methods have shown amazing performance in synthesizing 3D-consistent photographic images, but fail to generate multi-view portrait drawings. The key is that the basic assumption of these methods -- a…

计算机视觉与模式识别 · 计算机科学 2023-05-05 Biao Ma , Fei Gao , Chang Jiang , Nannan Wang , Gang Xu

Recent breakthroughs in text-guided image generation have led to remarkable progress in the field of 3D synthesis from text. By optimizing neural radiance fields (NeRF) directly from text, recent methods are able to produce remarkable…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Dana Cohen-Bar , Elad Richardson , Gal Metzer , Raja Giryes , Daniel Cohen-Or

Traditional 3D face models are based on mesh representations with texture. One of the most important models is FLAME (Faces Learned with an Articulated Model and Expressions), which produces meshes of human faces that are fully…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Wojciech Zając , Joanna Waczyńska , Piotr Borycki , Jacek Tabor , Maciej Zięba , Przemysław Spurek

Tremendous progress in deep generative models has led to photorealistic image synthesis. While achieving compelling results, most approaches operate in the two-dimensional image domain, ignoring the three-dimensional nature of our world.…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Michael Niemeyer , Andreas Geiger

Although 2D generative models have made great progress in face image generation and animation, they often suffer from undesirable artifacts such as 3D inconsistency when rendering images from different camera viewpoints. This prevents them…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Yue Wu , Yu Deng , Jiaolong Yang , Fangyun Wei , Qifeng Chen , Xin Tong

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Over recent years, diffusion models have facilitated significant advancements in video generation. Yet, the creation of face-related videos still confronts issues such as low facial fidelity, lack of frame consistency, limited editability…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Linze Li , Sunqi Fan , Hengjun Pu , Zhaodong Bing , Yao Tang , Tianzhu Ye , Tong Yang , Liangyu Chen , Jiajun Liang

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Neural Radiance Fields (NeRF) have shown impressive performance in novel view synthesis, but challenges remain in rendering scenes with complex specular reflections and highlights. Existing approaches may produce blurry reflections due to…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Wenpeng Xing , Jie Chen , Zaifeng Yang , Tiancheng Zhao , Gaolei Li , Changting Lin , Yike Guo , Meng Han

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

Recent advances in 3D representations, such as Neural Radiance Fields and 3D Gaussian Splatting, have greatly improved realistic scene modeling and novel-view synthesis. However, achieving controllable and consistent editing in dynamic 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Kai He , Chin-Hsuan Wu , Igor Gilitschenski

Neural Radiance Fields (NeRF) accomplishes photo-realistic novel view synthesis by learning the implicit volumetric representation of a scene from multi-view images, which faithfully convey the colorimetric information. However, sensor…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jiacong Xu , Mingqian Liao , K Ram Prabhakar , Vishal M. Patel

Current Neural Radiance Fields (NeRF) can generate photorealistic novel views. For editing 3D scenes represented by NeRF, with the advent of generative models, this paper proposes Inpaint4DNeRF to capitalize on state-of-the-art stable…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Han Jiang , Haosen Sun , Ruoxuan Li , Chi-Keung Tang , Yu-Wing Tai

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Nagabhushan Somraj

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

While dynamic Neural Radiance Fields (NeRF) have shown success in high-fidelity 3D modeling of talking portraits, the slow training and inference speed severely obstruct their potential usage. In this paper, we propose an efficient…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Jiaxiang Tang , Kaisiyuan Wang , Hang Zhou , Xiaokang Chen , Dongliang He , Tianshu Hu , Jingtuo Liu , Gang Zeng , Jingdong Wang

Current 3D stylization techniques primarily focus on static scenes, while our world is inherently dynamic, filled with moving objects and changing environments. Existing style transfer methods primarily target appearance -- such as color…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Nhat Phuong Anh Vu , Abhishek Saroha , Or Litany , Daniel Cremers