English
Related papers

Related papers: CharNeRF: 3D Character Generation from Concept Art

200 papers

We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object category models from collections of input images. In contrast to previous work, we are able to do this whilst simultaneously separating foreground…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Christopher Xie , Keunhong Park , Ricardo Martin-Brualla , Matthew Brown

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

Generating high-fidelity talking head video by fitting with the input audio sequence is a challenging problem that receives considerable attentions recently. In this paper, we address this problem with the aid of neural scene representation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Yudong Guo , Keyu Chen , Sen Liang , Yong-Jin Liu , Hujun Bao , Juyong Zhang

Neural Radiance Fields (NeRF) have shown impressive novel view synthesis results; nonetheless, even thorough recordings yield imperfections in reconstructions, for instance due to poorly observed areas or minor lighting changes. Our goal is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Matthias Nießner

The problem of modeling an animatable 3D human head avatar under light-weight setups is of significant importance but has not been well solved. Existing 3D representations either perform well in the realism of portrait images synthesis or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiaochen Zhao , Lizhen Wang , Jingxiang Sun , Hongwen Zhang , Jinli Suo , Yebin Liu

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Implicit representations such as Neural Radiance Fields (NeRF) have been shown to be very effective at novel view synthesis. However, these models typically require manual and careful human data collection for training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Pierre Marza , Laetitia Matignon , Olivier Simonin , Dhruv Batra , Christian Wolf , Devendra Singh Chaplot

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao

The emergence of Neural Radiance Fields (NeRF) has greatly impacted 3D scene modeling and novel-view synthesis. As a kind of visual media for 3D scene representation, compression with high rate-distortion performance is an eternal target.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Sicheng Li , Hao Li , Yiyi Liao , Lu Yu

In the realm of digital situational awareness during disaster situations, accurate digital representations, like 3D models, play an indispensable role. To ensure the safety of rescue teams, robotic platforms are often deployed to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Hartmut Surmann , Niklas Digakis , Jan-Nicklas Kremer , Julien Meine , Max Schulte , Niklas Voigt

Talking head generation based on the neural radiation fields model has shown promising visual effects. However, the slow rendering speed of NeRF seriously limits its application, due to the burdensome calculation process over hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Niu Guanchen

We present a method for transferring the artistic features of an arbitrary style image to a 3D scene. Previous methods that perform 3D stylization on point clouds or meshes are sensitive to geometric reconstruction errors for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Kai Zhang , Nick Kolkin , Sai Bi , Fujun Luan , Zexiang Xu , Eli Shechtman , Noah Snavely

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original…

Graphics · Computer Science 2021-09-07 Wonbong Jang , Lourdes Agapito

Obtaining 3D object representations is important for creating photo-realistic simulations and for collecting AR and VR assets. Neural fields have shown their effectiveness in learning a continuous volumetric representation of a scene from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Ashkan Mirzaei , Yash Kant , Jonathan Kelly , Igor Gilitschenski

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer