English
Related papers

Related papers: M3: 3D-Spatial MultiModal Memory

200 papers

Dynamic scene reconstruction represents a fundamental yet demanding challenge in computer vision and robotics. While recent progress in 3DGS-based methods has advanced dynamic scene modeling, obtaining high-fidelity rendering and accurate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yinan Deng , Jianyu Dou , Jiahui Wang , Jingyu Zhao , Yi Yang , Yufeng Yue

Recent advancements in dynamic 3D scene reconstruction have shown promising results, enabling high-fidelity 3D novel view synthesis with improved temporal consistency. Among these, 4D Gaussian Splatting (4DGS) has emerged as an appealing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Seungjun Oh , Younggeun Lee , Hyejin Jeon , Eunbyung Park

Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Marko Mihajlovic , Sergey Prokudin , Siyu Tang , Robert Maier , Federica Bogo , Tony Tung , Edmond Boyer

Modeling complex rigid motion across large spatiotemporal spans remains an unresolved challenge in dynamic reconstruction. Existing paradigms are mainly confined to short-term, small-scale deformation and offer limited consideration for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yijun Xu , Jingrui Zhang , Yuhan Chen , Dingwen Wang , Lei Yu , Chu He

Recent advances in 3D Gaussian Splatting (3DGS) deliver striking photorealism, and extending it to large scenes opens new opportunities for semantic reasoning and prediction in applications such as autonomous driving. Today's…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Shengkai Zhang , Yuhe Liu , Jianhua He , Xuedou Xiao , Mozi Chen , Kezhong Liu

Sparse-view scene reconstruction often faces significant challenges due to the constraints imposed by limited observational data. These limitations result in incomplete information, leading to suboptimal reconstructions using existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiangyu Sun , Runnan Chen , Mingming Gong , Dong Xu , Tongliang Liu

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in scene reconstruction. However, most existing GS-based surface reconstruction methods focus on 3D objects or limited scenes. Directly applying these methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yuanyuan Gao , Yalun Dai , Hao Li , Weicai Ye , Junyi Chen , Danpeng Chen , Dingwen Zhang , Tong He , Guofeng Zhang , Junwei Han

Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Quentin Herau , Moussab Bennehar , Arthur Moreau , Nathan Piasco , Luis Roldao , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

In this paper, we introduce a new embedding model called M3-Embedding, which is distinguished for its versatility in \textit{Multi-Linguality}, \textit{Multi-Functionality}, and \textit{Multi-Granularity}. It provides a uniform support for…

Computation and Language · Computer Science 2025-12-15 Jianlv Chen , Shitao Xiao , Peitian Zhang , Kun Luo , Defu Lian , Zheng Liu

The online reconstruction of dynamic scenes from multi-view streaming videos faces significant challenges in training, rendering and storage efficiency. Harnessing superior learning speed and real-time rendering capabilities, 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Qiankun Gao , Jiarui Meng , Chengxiang Wen , Jie Chen , Jian Zhang

Generalizable 3D Gaussian Splatting reconstruction showcases advanced Image-to-3D content creation but requires substantial computational resources and large datasets, posing challenges to training models from scratch. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Xiufeng Huang , Ka Chun Cheung , Runmin Cong , Simon See , Renjie Wan

3D Gaussian Splatting showcases notable advancements in photo-realistic and real-time novel view synthesis. However, it faces challenges in modeling mirror reflections, which exhibit substantial appearance variations from different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jiayue Liu , Xiao Tang , Freeman Cheng , Roy Yang , Zhihao Li , Jianzhuang Liu , Yi Huang , Jiaqi Lin , Shiyong Liu , Xiaofei Wu , Songcen Xu , Chun Yuan

3D Gaussian Splatting (3DGS) has begun incorporating rich information from 2D foundation models. However, most approaches rely on a bottom-up optimization process that treats raw 2D features as ground truth, incurring increased…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hyunjoon Lee , Joonkyu Min , Jaesik Park

3D Gaussian Splatting (3DGS) has recently gained popularity for efficient scene rendering by representing scenes as explicit sets of anisotropic 3D Gaussians. However, most existing work focuses primarily on modeling external surfaces. In…

Image and Video Processing · Electrical Eng. & Systems 2026-01-12 Shuxin Liang , Yihan Xiao , Wenlu Tang

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

Recent advancements in 3D Gaussian Splatting (3DGS) have made a significant impact on rendering and reconstruction techniques. Current research predominantly focuses on improving rendering performance and reconstruction quality using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yinlong Bai , Hongxin Zhang , Sheng Zhong , Junkai Niu , Hai Li , Yijia He , Yi Zhou

3D scene stylization extends the work of neural style transfer to 3D. A vital challenge in this problem is to maintain the uniformity of the stylized appearance across multiple views. A vast majority of the previous works achieve this by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Abhishek Saroha , Mariia Gladkova , Cecilia Curreli , Dominik Muhle , Tarun Yenamandra , Daniel Cremers

Reconstructing high-fidelity animatable human avatars from monocular videos remains challenging due to insufficient geometric information in single-view observations. While recent 3D Gaussian Splatting methods have shown promise, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jinlong Fan , Bingyu Hu , Xingguang Li , Yuxiang Yang , Jing Zhang

This study addresses the challenge of online 3D model generation for neural rendering using an RGB image stream. Previous research has tackled this issue by incorporating Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS) as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Byeonggwon Lee , Junkyu Park , Khang Truong Giang , Sungho Jo , Soohwan Song

Scene representations using 3D Gaussian primitives have produced excellent results in modeling the appearance of static and dynamic 3D scenes. Many graphics applications, however, demand the ability to manipulate both the appearance and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ri-Zhao Qiu , Ge Yang , Weijia Zeng , Xiaolong Wang