English
Related papers

Related papers: DynMF: Neural Motion Factorization for Real-time D…

200 papers

3D Gaussian Splatting (3DGS) has emerged as a powerful explicit representation enabling real-time, high-fidelity 3D reconstruction and novel view synthesis. However, its practical use is hindered by the massive memory and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Seokhyun Youn , Soohyun Lee , Geonho Kim , Weeyoung Kwon , Sung-Ho Bae , Jihyong Oh

Novel view synthesis of urban scenes is essential for autonomous driving-related applications.Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Xu Yan , Hongyu Zhou , Yue Wang , Bingbing Liu , Andreas Geiger , Yiyi Liao

Deep multimodal learning has achieved great progress in recent years. However, current fusion approaches are static in nature, i.e., they process and fuse multimodal inputs with identical computation, without accounting for diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Zihui Xue , Radu Marculescu

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Recent advances in Dense Simultaneous Localization and Mapping (SLAM) have demonstrated remarkable performance in static environments. However, dense SLAM in dynamic environments remains challenging. Most methods directly remove dynamic…

Robotics · Computer Science 2025-12-11 Siting Zhu , Yuxiang Huang , Wenhua Wu , Chaokang Jiang , Yongbo Chen , I-Ming Chen , Hesheng Wang

Combining accurate geometry with rich semantics has been proven to be highly effective for language-guided robotic manipulation. Existing methods for dynamic scenes either fail to update in real-time or rely on additional depth sensors for…

Robotics · Computer Science 2024-10-22 Yu Sheng , Runfeng Lin , Lidian Wang , Quecheng Qiu , YanYong Zhang , Yu Zhang , Bei Hua , Jianmin Ji

Mapping systems with novel view synthesis (NVS) capabilities, most notably 3D Gaussian Splatting (3DGS), are widely used in computer vision, as well as in various applications, including augmented reality, robotics, and autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Vladimir Yugay , Thies Kersten , Luca Carlone , Theo Gevers , Martin R. Oswald , Lukas Schmid

Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Rui Song , Chenwei Liang , Yan Xia , Walter Zimmer , Hu Cao , Holger Caesar , Andreas Festag , Alois Knoll

In monocular videos that capture dynamic scenes, estimating the 3D geometry of video contents has been a fundamental challenge in computer vision. Specifically, the task is significantly challenged by the object motion, where existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Seong Hyeon Park , Jinwoo Shin

We present Knowledge NeRF to synthesize novel views for dynamic scenes. Reconstructing dynamic 3D scenes from few sparse views and rendering them from arbitrary perspectives is a challenging problem with applications in various domains.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenxiao Cai , Xinyue Lei , Xinyu He , Junming Leo Chen , Yangang Wang

In underwater images, most useful features are occluded by water. The extent of the occlusion depends on imaging geometry and can vary even across a sequence of burst images. As a result, 3D reconstruction methods robust on in-air scenes,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Nir Mualem , Roy Amoyal , Oren Freifeld , Derya Akkaynak

Modeling and re-rendering dynamic 3D scenes is a challenging task in 3D vision. Prior approaches build on NeRF and rely on implicit representations. This is slow since it requires many MLP evaluations, constraining real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ang Cao , Justin Johnson

Given just a few glimpses of a scene, can you imagine the movie playing out as the camera glides through it? That's the lens we take on \emph{sparse-input novel view synthesis}, not only as filling spatial gaps between widely spaced views,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yan Xu , Yixing Wang , Stella X. Yu

Simultaneous localization and mapping (SLAM) technology has recently achieved photorealistic mapping capabilities thanks to the real-time, high-fidelity rendering enabled by 3D Gaussian Splatting (3DGS). However, due to the static…

Robotics · Computer Science 2025-12-01 Zhicong Sun , Jacqueline Lo , Jinxing Hu

Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities since their data association usually relies on feature correspondences. Additionally, learning-based SLAM systems often fall short in terms of real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhongche Qu , Zhi Zhang , Cong Liu , Jianhua Yin

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziwen Li , Jiaxin Huang , Runnan Chen , Yunlong Che , Yandong Guo , Tongliang Liu , Fakhri Karray , Mingming Gong

The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Fengyi Zhang , Yadan Luo , Tianjun Zhang , Lin Zhang , Zi Huang

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Current Simultaneous Localization and Mapping (SLAM) methods based on Neural Radiance Fields (NeRF) or 3D Gaussian Splatting excel in reconstructing static 3D scenes but struggle with tracking and reconstruction in dynamic environments,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mingrui Li , Yiming Zhou , Hongxing Zhou , Xinggang Hu , Florian Roemer , Hongyu Wang , Ahmad Osman

Existing NeRF-based methods for large scene reconstruction often have limitations in visual quality and rendering speed. While the recent 3D Gaussian Splatting works well on small-scale and object-centric scenes, scaling it up to large…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiaqi Lin , Zhihao Li , Xiao Tang , Jianzhuang Liu , Shiyong Liu , Jiayue Liu , Yangdi Lu , Xiaofei Wu , Songcen Xu , Youliang Yan , Wenming Yang