English
Related papers

Related papers: CLA-NeRF: Category-Level Articulated Neural Radian…

200 papers

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Though neural radiance fields (NeRF) have demonstrated impressive view synthesis results on objects and small bounded regions of space, they struggle on "unbounded" scenes, where the camera may point in any direction and content may exist…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jonathan T. Barron , Ben Mildenhall , Dor Verbin , Pratul P. Srinivasan , Peter Hedman

Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Prune Truong , Marie-Julie Rakotosaona , Fabian Manhardt , Federico Tombari

Obtaining a better knowledge of the current state and behavior of objects orbiting Earth has proven to be essential for a range of applications such as active debris removal, in-orbit maintenance, or anomaly detection. 3D models represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Clément Forray , Pauline Delporte , Nicolas Delaygue , Florence Genin , Dawa Derksen

We present Knowledge NeRF to synthesize novel views for dynamic scenes. Reconstructing dynamic 3D scenes from few sparse views and rendering them from arbitrary perspectives is a challenging problem with applications in various domains.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenxiao Cai , Xinyue Lei , Xinyu He , Junming Leo Chen , Yangang Wang

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Coordinate-based implicit neural networks, or neural fields, have emerged as useful representations of shape and appearance in 3D computer vision. Despite advances, however, it remains challenging to build neural fields for categories of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Rohith Agaram , Shaurya Dewan , Rahul Sajnani , Adrien Poulenard , Madhava Krishna , Srinath Sridhar

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

We extend neural 3D representations to allow for intuitive and interpretable user control beyond novel view rendering (i.e. camera control). We allow the user to annotate which part of the scene one wishes to control with just a small…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Kacper Kania , Kwang Moo Yi , Marek Kowalski , Tomasz Trzciński , Andrea Tagliasacchi

Humans describe the physical world using natural language to refer to specific 3D locations based on a vast range of properties: visual appearance, semantics, abstract associations, or actionable affordances. In this work we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Justin Kerr , Chung Min Kim , Ken Goldberg , Angjoo Kanazawa , Matthew Tancik

This paper presents one of the first learning-based NeRF 3D instance segmentation pipelines, dubbed as Instance Neural Radiance Field, or Instance NeRF. Taking a NeRF pretrained from multi-view RGB images as input, Instance NeRF can learn…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yichen Liu , Benran Hu , Junkai Huang , Yu-Wing Tai , Chi-Keung Tang

Traditional approaches for manipulation planning rely on an explicit geometric model of the environment to formulate a given task as an optimization problem. However, inferring an accurate model from raw sensor input is a hard problem in…

Robotics · Computer Science 2023-09-15 Phillip Grote , Joaquim Ortiz-Haro , Marc Toussaint , Ozgur S. Oguz

Reconstructing large-scale 3D scenes is essential for autonomous vehicles, especially when partial sensor data is lost. Although the recently developed neural radiance fields (NeRF) have shown compelling results in implicit representations,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xiuzhong Hu , Guangming Xiong , Zheng Zang , Peng Jia , Yuxuan Han , Junyi Ma

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang