English
Related papers

Related papers: EvDNeRF: Reconstructing Event Data with Dynamic Ne…

200 papers

Event cameras are novel vision sensors that sample, in an asynchronous fashion, brightness increments with low latency and high temporal resolution. The resulting streams of events are of high value by themselves, especially for high speed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 F. Paredes-Vallés , G. C. H. E. de Croon

We present a novel neural radiance model that is trainable in a self-supervised manner for novel-view synthesis of dynamic unstructured scenes. Our end-to-end trainable algorithm learns highly complex, real-world static scenes within…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Shuja Khalid , Frank Rudzicz

Neural Radiance Fields (NeRFs) encode the radiance in a scene parameterized by the scene's plenoptic function. This is achieved by using an MLP together with a mapping to a higher-dimensional space, and has been proven to capture scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Siddhant Ranade , Christoph Lassner , Kai Li , Christian Haene , Shen-Chi Chen , Jean-Charles Bazin , Sofien Bouaziz

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Neural radiance fields (NeRFs) show potential for transforming images captured worldwide into immersive 3D visual experiences. However, most of this captured visual data remains siloed in our camera rolls as these images contain personal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zaid Tasneem , Akshat Dave , Abhishek Singh , Kushagra Tiwary , Praneeth Vepakomma , Ashok Veeraraghavan , Ramesh Raskar

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Event cameras are a new type of sensors that are different from traditional cameras. Each pixel is triggered asynchronously by event. The trigger event is the change of the brightness irradiated on the pixel. If the increment or decrement…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Kun Xiao , Guohui Wang , Yi Chen , Jinghong Nan , Yongfeng Xie

While neural radiance fields (NeRF) led to a breakthrough in photorealistic novel view synthesis, handling mirroring surfaces still denotes a particular challenge as they introduce severe inconsistencies in the scene representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Leif Van Holland , Michael Weinmann , Jan U. Müller , Patrick Stotko , Reinhard Klein

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Recent advancements in dynamic neural radiance field methods have yielded remarkable outcomes. However, these approaches rely on the assumption of sharp input images. When faced with motion blur, existing dynamic NeRF methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Huiqiang Sun , Xingyi Li , Liao Shen , Xinyi Ye , Ke Xian , Zhiguo Cao

When a camera travels across a 3D world, only a fraction of pixel value changes; an event-based camera observes the change as sparse events. How can we utilize sparse events for efficient recovery of the camera pose? We show that we can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Mana Masuda , Yusuke Sekikawa , Hideo Saito

Neural Radiance Fields (NeRF) achieve remarkable performance in dense multi-view scenarios, but their reconstruction quality degrades significantly under sparse inputs due to geometric artifacts. Existing methods utilize global depth…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weiqi Yu , Yiyang Yao , Lin He , Jianming Lv

Neural Radiance Fields (NeRF) is a cutting-edge neural network-based technique for novel view synthesis in 3D reconstruction. However, its significant computational demands pose challenges for deployment on mobile devices. While mesh-based…

Graphics · Computer Science 2025-04-07 Zhe Wang , Yifei Zhu

We introduce HyperFields, a method for generating text-conditioned Neural Radiance Fields (NeRFs) with a single forward pass and (optionally) some fine-tuning. Key to our approach are: (i) a dynamic hypernetwork, which learns a smooth…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Sudarshan Babu , Richard Liu , Avery Zhou , Michael Maire , Greg Shakhnarovich , Rana Hanocka

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Neural Radiance Fields (NeRFs) have shown significant promise in 3D scene reconstruction and novel view synthesis. In agricultural settings, NeRFs can serve as digital twins, providing critical information about fruit detection for yield…

Robotics · Computer Science 2024-09-25 Samarth Chopra , Fernando Cladera , Varun Murali , Vijay Kumar

Neural Radiance Fields (NeRF) have revolutionized the field of 3D visual representation by enabling highly realistic and detailed scene reconstructions from a sparse set of images. NeRF uses a volumetric functional representation that maps…

Multimedia · Computer Science 2024-10-28 Pedro Martin , António Rodrigues , João Ascenso , Maria Paula Queluz