English
Related papers

Related papers: Dual-Space NeRF: Learning Animatable Avatars and S…

200 papers

Articulated objects and their representations pose a difficult problem for robots. These objects require not only representations of geometry and texture, but also of the various connections and joint parameters that make up each…

Robotics · Computer Science 2024-09-17 Stanley Lewis , Tom Gao , Odest Chadwicke Jenkins

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tristan Aumentado-Armstrong , Ashkan Mirzaei , Marcus A. Brubaker , Jonathan Kelly , Alex Levinshtein , Konstantinos G. Derpanis , Igor Gilitschenski

Neural Representations have recently been shown to effectively reconstruct a wide range of signals from 3D meshes and shapes to images and videos. We show that, when adapted correctly, neural representations can be used to directly…

Machine Learning · Computer Science 2023-04-24 Maor Ashkenazi , Zohar Rimon , Ron Vainshtein , Shir Levi , Elad Richardson , Pinchas Mintz , Eran Treister

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

Generalizing Neural Radiance Fields (NeRF) to new scenes is a significant challenge that existing approaches struggle to address without extensive modifications to vanilla NeRF framework. We introduce InsertNeRF, a method for INStilling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yanqi Bao , Tianyu Ding , Jing Huo , Wenbin Li , Yuxin Li , Yang Gao

We propose the NeRF-LEBM, a likelihood-based top-down 3D-aware 2D image generative model that incorporates 3D representation via Neural Radiance Fields (NeRF) and 2D imaging process via differentiable volume rendering. The model represents…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yaxuan Zhu , Jianwen Xie , Ping Li

We propose im2nerf, a learning framework that predicts a continuous neural object representation given a single input image in the wild, supervised by only segmentation output from off-the-shelf recognition methods. The standard approach to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Lu Mi , Abhijit Kundu , David Ross , Frank Dellaert , Noah Snavely , Alireza Fathi

Many real-world 3D reconstruction applications demand photorealism and metric accuracy across unbounded, complex scenes with challenging lighting and imperfect captures that current Neural Radiance Field (NeRF) pipelines only partly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Vladislav Polianskii , Elijs Dima , Isabel Salmerón Marazuela , Gergő László Nagy , Sigurdur Sverrisson , Volodya Grancharov

Human reconstruction and synthesis from monocular RGB videos is a challenging problem due to clothing, occlusion, texture discontinuities and sharpness, and framespecific pose changes. Many methods employ deferred rendering, NeRFs and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Rohit Jena , Pratik Chaudhari , James Gee , Ganesh Iyer , Siddharth Choudhary , Brandon M. Smith

We consider the challenging problem of predicting intrinsic object properties from a single image by exploiting differentiable renderers. Many previous learning-based approaches for inverse graphics adopt rasterization-based renderers and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Wenzheng Chen , Joey Litalien , Jun Gao , Zian Wang , Clement Fuji Tsang , Sameh Khamis , Or Litany , Sanja Fidler

Animating high-fidelity video portrait with speech audio is crucial for virtual reality and digital entertainment. While most previous studies rely on accurate explicit structural information, recent works explore the implicit scene…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Xian Liu , Yinghao Xu , Qianyi Wu , Hang Zhou , Wayne Wu , Bolei Zhou

It is a long-standing problem to find effective representations for training reinforcement learning (RL) agents. This paper demonstrates that learning state representations with supervision from Neural Radiance Fields (NeRFs) can improve…

Machine Learning · Computer Science 2022-06-06 Danny Driess , Ingmar Schubert , Pete Florence , Yunzhu Li , Marc Toussaint

Learning a 3D representation of a scene has been a challenging problem for decades in computer vision. Recent advances in implicit neural representation from images using neural radiance fields(NeRF) have shown promising results. Some of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Andrew I. Comport

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool

The generation of a virtual digital avatar is a crucial research topic in the field of computer vision. Many existing works utilize Neural Radiance Fields (NeRF) to address this issue and have achieved impressive results. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Shengbo Gu , Yu-Kun Qiu , Yu-Ming Tang , Ancong Wu , Wei-Shi Zheng

Recent works such as BARF and GARF can bundle adjust camera poses with neural radiance fields (NeRF) which is based on coordinate-MLPs. Despite the impressive results, these methods cannot be applied to Generalizable NeRFs (GeNeRFs) which…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yu Chen , Gim Hee Lee

We present a new generic method for shadow-aware multi-view satellite photogrammetry of Earth Observation scenes. Our proposed method, the Shadow Neural Radiance Field (S-NeRF) follows recent advances in implicit volumetric representation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Dawa Derksen , Dario Izzo

Rigging and skinning clothed human avatars is a challenging task and traditionally requires a lot of manual work and expertise. Recent methods addressing it either generalize across different characters or focus on capturing the dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhouyingcheng Liao , Vladislav Golyanik , Marc Habermann , Christian Theobalt

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler
‹ Prev 1 8 9 10 Next ›