English
Related papers

Related papers: Dynamic LiDAR Re-simulation using Compositional Ne…

200 papers

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Scene flow is the dense 3D reconstruction of motion and geometry of a scene. Most state-of-the-art methods use a pair of stereo images as input for full scene reconstruction. These methods depend a lot on the quality of the RGB images and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Rishav , Ramy Battrawy , René Schuster , Oliver Wasenmüller , Didier Stricker

As recent advances in Neural Radiance Fields (NeRF) have enabled high-fidelity 3D face reconstruction and novel view synthesis, its manipulation also became an essential task in 3D vision. However, existing manipulation methods require…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sungwon Hwang , Junha Hyung , Daejin Kim , Min-Jung Kim , Jaegul Choo

Dynamic scene reconstruction for autonomous driving enables vehicles to perceive and interpret complex scene changes more precisely. Dynamic Neural Radiance Fields (NeRFs) have recently shown promising capability in scene modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Yue Wen , Liang Song , Yijia Liu , Siting Zhu , Yanzi Miao , Lijun Han , Hesheng Wang

While remarkable success has been achieved through diffusion-based 3D generative models for shapes, 4D generative modeling remains challenging due to the complexity of object deformations over time. We propose DNF, a new 4D representation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Xinyi Zhang , Naiqi Li , Angela Dai

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

In this paper, we propose a Neural Radiance Fields (NeRF) based framework, referred to as Novel View Synthesis Framework (NVSF). It jointly learns the implicit neural representation of space and time-varying scene for both LiDAR and Camera.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Gaurav Sharma , Ravi Kothari , Josef Schmid

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

Augmenting LiDAR input with multiple previous frames provides richer semantic information and thus boosts performance in 3D object detection, However, crowded point clouds in multi-frames can hurt the precise position information due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yao Rong , Xiangyu Wei , Tianwei Lin , Yueyu Wang , Enkelejda Kasneci

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

Recent advances in neural radiance fields (NeRFs) achieve state-of-the-art novel view synthesis and facilitate dense estimation of scene properties. However, NeRFs often fail for large, unbounded scenes that are captured under very sparse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Alexandra Carlson , Manikandasriram Srinivasan Ramanagopal , Nathan Tseng , Matthew Johnson-Roberson , Ram Vasudevan , Katherine A. Skinner

We present Factor Fields, a novel framework for modeling and representing signals. Factor Fields decomposes a signal into a product of factors, each represented by a classical or neural field representation which operates on transformed…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Anpei Chen , Zexiang Xu , Xinyue Wei , Siyu Tang , Hao Su , Andreas Geiger

We present a technique for dense 3D reconstruction of objects using an imaging sonar, also known as forward-looking sonar (FLS). Compared to previous methods that model the scene geometry as point clouds or volumetric grids, we represent…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Mohamad Qadri , Michael Kaess , Ioannis Gkioulekas

Dynamic imaging is essential for analyzing various biological systems and behaviors but faces two main challenges: data incompleteness and computational burden. For many imaging systems, high frame rates and short acquisition times require…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Luke Lozenski , Mark A. Anastasio , Umberto Villa

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Safe motion planning in robotics requires planning into space which has been verified to be free of obstacles. However, obtaining such environment representations using lidars is challenging by virtue of the sparsity of their depth…

We propose Neural Deformable Fields (NDF), a new representation for dynamic human digitization from a multi-view video. Recent works proposed to represent a dynamic human body with shared canonical neural radiance fields which links to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ruiqi Zhang , Jie Chen

Accurate reconstruction of static environments from LiDAR scans of scenes containing dynamic objects, which we refer to as Dynamic to Static Translation (DST), is an important area of research in Autonomous Navigation. This problem has been…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Prashant Kumar , Sabyasachi Sahoo , Vanshil Shah , Vineetha Kondameedi , Abhinav Jain , Akshaj Verma , Chiranjib Bhattacharyya , Vinay Viswanathan

We present LiDAR-EDIT, a novel paradigm for generating synthetic LiDAR data for autonomous driving. Our framework edits real-world LiDAR scans by introducing new object layouts while preserving the realism of the background environment.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shing-Hei Ho , Bao Thach , Minghan Zhu