English
Related papers

Related papers: M3: 3D-Spatial MultiModal Memory

200 papers

Three-dimensional reconstruction is a fundamental problem in robotics perception. We examine the problem of active view selection to perform 3D Gaussian Splatting reconstructions with as few input images as possible. Although 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Monica M. Q. Li , Pierre-Yves Lajoie , Giovanni Beltrame

Recently, 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for accurately representing scenes. However, despite its superior novel view synthesis capabilities, extracting the geometry of the scene directly from the Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yaniv Wolf , Amit Bracha , Ron Kimmel

3D Gaussian Splatting has demonstrated notable success in large-scale scene reconstruction, but challenges persist due to high training memory consumption and storage overhead. Hybrid representations that integrate implicit and explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jixuan Fan , Wanhua Li , Yifei Han , Tianru Dai , Yansong Tang

3D Gaussian Splatting has recently gained traction for its efficient training and real-time rendering. While its vanilla representation is mainly designed for view synthesis, recent works extended it to scene understanding with language…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siyun Liang , Sen Wang , Kunyi Li , Michael Niemeyer , Stefano Gasperini , Hendrik P. A. Lensch , Nassir Navab , Federico Tombari

Deformable 3D Gaussian Splatting (3D-GS) is limited by missing intermediate motion information due to the low temporal resolution of RGB cameras. To address this, we introduce the first approach combining event cameras, which capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Wenhao Xu , Wenming Weng , Yueyi Zhang , Ruikang Xu , Zhiwei Xiong

3D Gaussian Splatting (3DGS) has made significant strides in scene representation and neural rendering, with intense efforts focused on adapting it for dynamic scenes. Despite delivering remarkable rendering quality and speed, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Sangwoon Kwak , Joonsoo Kim , Jun Young Jeong , Won-Sik Cheong , Jihyong Oh , Munchurl Kim

We propose a novel framework for scene decomposition and static background reconstruction from everyday videos. By integrating the trained motion masks and modeling the static scene as Gaussian splats with dynamics-aware optimization, our…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Kai Xu , Tze Ho Elden Tse , Jizong Peng , Angela Yao

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

3D Gaussian Splatting SLAM has emerged as a widely used technique for high-fidelity mapping in spatial intelligence. However, existing methods often rely on a single representation scheme, which limits their performance in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Wenkai Zhu , Xu Li , Qimin Xu , Benwu Wang , Kun Wei , Yiming Peng , Zihang Wang

The performance of a lifelong learning (L3) model degrades when it is trained on a series of tasks, as the geometrical formation of the embedding space changes while learning novel concepts sequentially. The majority of existing L3…

Machine Learning · Computer Science 2023-08-02 Kaushik Roy , Peyman Moghadam , Mehrtash Harandi

3D Gaussian Splatting (3DGS) has become a state-of-the-art framework for real-time, high-fidelity novel view synthesis. However, its substantial storage requirements and inherently unstructured representation pose challenges for deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqin Lu , Yang Zhou , Yihua Dai , Guiqing Li , Shengfeng He

In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhicheng Lu , Xiang Guo , Le Hui , Tianrui Chen , Min Yang , Xiao Tang , Feng Zhu , Yuchao Dai

In the rapidly evolving field of 3D reconstruction, 3D Gaussian Splatting (3DGS) and 2D Gaussian Splatting (2DGS) represent significant advancements. Although 2DGS compresses 3D Gaussian primitives into 2D Gaussian surfels to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Zhuoxiao Li , Shanliang Yao , Yijie Chu , Angel F. Garcia-Fernandez , Yong Yue , Eng Gee Lim , Xiaohui Zhu

3D Gaussian Splatting (3DGS) has emerged as a powerful representation for neural scene reconstruction, offering high-quality novel view synthesis while maintaining computational efficiency. In this paper, we extend the capabilities of 3DGS…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jens Piekenbrinck , Christian Schmidt , Alexander Hermans , Narunas Vaskevicius , Timm Linder , Bastian Leibe

Recent breakthroughs in radiance fields have significantly advanced 3D scene reconstruction and novel view synthesis (NVS) in autonomous driving. Nevertheless, critical limitations persist: reconstruction-based methods exhibit substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingshuang Zou , Yikang Ding , Chuanrui Zhang , Jiazhe Guo , Bohan Li , Xiaoyang Lyu , Feiyang Tan , Xiaojuan Qi , Haoqian Wang

3D reconstruction and relighting of objects made from scattering materials present a significant challenge due to the complex light transport beneath the surface. 3D Gaussian Splatting introduced high-quality novel view synthesis at…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jan-Niklas Dihlmann , Arjun Majumdar , Andreas Engelhardt , Raphael Braun , Hendrik P. A. Lensch

3D Gaussian Splatting (3DGS) achieves remarkable results in the field of surface reconstruction. However, when Gaussian normal vectors are aligned within the single-view projection plane, while the geometry appears reasonable in the current…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Bo Jia , Yanan Guo , Ying Chang , Benkui Zhang , Ying Xie , Kangning Du , Lin Cao

We propose R3GS, a robust reconstruction and relocalization framework tailored for unconstrained datasets. Our method uses a hybrid representation during training. Each anchor combines a global feature from a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xu yan , Zhaohui Wang , Rong Wei , Jingbo Yu , Dong Li , Xiangde Liu

Reconstructing 3D scenes from unconstrained image collections poses significant challenges due to variations in appearance. In this paper, we propose Scalable Micro-macro Wavelet-based Gaussian Splatting (SMW-GS), a novel method that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yihui Li , Chengxin Lv , Hongyu Yang , Di Huang

Recent advancements in autonomous driving, augmented reality, robotics, and embodied intelligence have necessitated 3D perception algorithms. However, current 3D perception methods, especially specialized small models, exhibit poor…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Fan Yang , Sicheng Zhao , Yanhao Zhang , Hui Chen , Haonan Lu , Jungong Han , Guiguang Ding