中文
相关论文

相关论文: Dynamic LiDAR Re-simulation using Compositional Ne…

200 篇论文

We introduce ROGR, a novel approach that reconstructs a relightable 3D model of an object captured from multiple views, driven by a generative relighting model that simulates the effects of placing the object under novel environment…

Although neural radiance fields (NeRFs) have achieved triumphs in image novel view synthesis (NVS), LiDAR NVS remains largely unexplored. Previous LiDAR NVS methods employ a simple shift from image NVS methods while ignoring the dynamic…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Zehan Zheng , Fan Lu , Weiyi Xue , Guang Chen , Changjun Jiang

Neural fields have recently enjoyed great success in representing and rendering 3D scenes. However, most state-of-the-art implicit representations model static or dynamic scenes as a whole, with minor variations. Existing work on learning…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Akshay Krishnan , Amit Raj , Xianling Zhang , Alexandra Carlson , Nathan Tseng , Sandhya Sridhar , Nikita Jaipuria , James Hays

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

Neural Radiance Fields (NeRFs) have shown great potential in modeling 3D scenes. Dynamic NeRFs extend this model by capturing time-varying elements, typically using deformation fields. The existing dynamic NeRFs employ a similar Eulerian…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Ancheng Lin , Yusheng Xiang , Jun Li , Mukesh Prasad

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea is to model the dynamic radiance field as a dynamic system…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Yifan Zhan , Zhuoxiao Li , Muyao Niu , Zhihang Zhong , Shohei Nobuhara , Ko Nishino , Yinqiang Zheng

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

计算机视觉与模式识别 · 计算机科学 2021-04-30 Michael Niemeyer , Andreas Geiger

Recent advancements in dynamic neural radiance field methods have yielded remarkable outcomes. However, these approaches rely on the assumption of sharp input images. When faced with motion blur, existing dynamic NeRF methods often struggle…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Huiqiang Sun , Xingyi Li , Liao Shen , Xinyi Ye , Ke Xian , Zhiguo Cao

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Dynamic Neural Radiance Field (NeRF) from monocular videos has recently been explored for space-time novel view synthesis and achieved excellent results. However, defocus blur caused by depth variation often occurs in video capture,…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Xianrui Luo , Huiqiang Sun , Juewen Peng , Zhiguo Cao

Methods for Novel View Synthesis (NVS) have recently found traction in the field of LiDAR simulation and large-scale 3D scene reconstruction. While solutions for faster rendering or handling dynamic scenes have been proposed, LiDAR specific…

机器人学 · 计算机科学 2025-07-18 Richard Marcus , Marc Stamminger

We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture…

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

We present Neural Feature Fusion Fields (N3F), a method that improves dense 2D image feature extractors when the latter are applied to the analysis of multiple images reconstructible as a 3D scene. Given an image feature extractor, for…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Vadim Tschernezki , Iro Laina , Diane Larlus , Andrea Vedaldi

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

Most SLAM algorithms are based on the assumption that the scene is static. However, in practice, most scenes are dynamic which usually contains moving objects, these methods are not suitable. In this paper, we introduce DymSLAM, a dynamic…

计算机视觉与模式识别 · 计算机科学 2020-03-11 Chenjie Wang , Bin Luo , Yun Zhang , Qing Zhao , Lu Yin , Wei Wang , Xin Su , Yajun Wang , Chengyuan Li

Neural scene representations, both continuous and discrete, have recently emerged as a powerful new paradigm for 3D scene understanding. Recent efforts have tackled unsupervised discovery of object-centric neural scene representations.…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Cameron Smith , Hong-Xing Yu , Sergey Zakharov , Fredo Durand , Joshua B. Tenenbaum , Jiajun Wu , Vincent Sitzmann

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have…

机器人学 · 计算机科学 2023-03-01 Dongyu Yan , Xiaoyang Lyu , Jieqi Shi , Yi Lin