English
Related papers

Related papers: GaussianVLM: Scene-centric 3D Vision-Language Mode…

200 papers

While current multimodal models can answer questions based on 2D images, they lack intrinsic 3D object perception, limiting their ability to comprehend spatial relationships and depth cues in 3D scenes. In this work, we propose N3D-VLM, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yuxin Wang , Lei Ke , Boqiang Zhang , Tianyuan Qu , Hanxun Yu , Zhenpeng Huang , Meng Yu , Dan Xu , Dong Yu

Visual search in 3D environments requires embodied agents to actively explore their surroundings and acquire task-relevant evidence. However, existing visual search and embodied AI benchmarks, including EQA, typically rely on static…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Koya Sakamoto , Taiki Miyanishi , Daichi Azuma , Shuhei Kurita , Shu Morikuni , Naoya Chiba , Motoaki Kawanabe , Yusuke Iwasawa , Yutaka Matsuo

Neural rendering methods have significantly advanced photo-realistic 3D scene rendering in various academic and industrial applications. The recent 3D Gaussian Splatting method has achieved the state-of-the-art rendering quality and speed…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Tao Lu , Mulin Yu , Linning Xu , Yuanbo Xiangli , Limin Wang , Dahua Lin , Bo Dai

Recent developments in Multimodal Large Language Models (MLLMs) have significantly improved Vision-Language (VL) reasoning in 2D domains. However, extending these capabilities to 3D scene understanding remains a major challenge. Existing 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Haijier Chen , Bo Xu , Shoujian Zhang , Haoze Liu , Jiaxuan Lin , Jingrong Wang

Understanding 3D scenes in open-world settings poses fundamental challenges for vision and robotics, particularly due to the limitations of closed-vocabulary supervision and static annotations. To address this, we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Fei Yu , Quan Deng , Shengeng Tang , Yuehua Li , Lechao Cheng

The recently developed Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have shown encouraging and impressive results for visual SLAM. However, most representative methods require RGBD sensors and are only available for indoor…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Zhe Xin , Chenyang Wu , Penghui Huang , Yanyong Zhang , Yinian Mao , Guoquan Huang

Recent advancements in multi-modal 3D pre-training methods have shown promising efficacy in learning joint representations of text, images, and point clouds. However, adopting point clouds as 3D representation fails to fully capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Haoyuan Li , Yanpeng Zhou , Tao Tang , Jifei Song , Yihan Zeng , Michael Kampffmeyer , Hang Xu , Xiaodan Liang

This paper presents a novel system designed for 3D mapping and visual relocalization using 3D Gaussian Splatting. Our proposed method uses LiDAR and camera data to create accurate and visually plausible representations of the environment.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Peng Jiang , Gaurav Pandey , Srikanth Saripalli

Three-dimensional Gaussian Splatting (3DGS) has recently emerged as an efficient representation for novel-view synthesis, achieving impressive visual quality. However, in scenes dominated by large and low-texture regions, common in indoor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Xirui Jin , Renbiao Jin , Boying Li , Danping Zou , Wenxian Yu

Bridging natural language and 3D geometry is a crucial step toward flexible, language-driven scene understanding. While recent advances in 3D Gaussian Splatting (3DGS) have enabled fast and high-quality scene reconstruction, research has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shaohui Dai , Yansong Qu , Zheyan Li , Xinyang Li , Shengchuan Zhang , Liujuan Cao

Feed-forward 3D Gaussian Splatting (3DGS) has emerged as a highly effective solution for novel view synthesis. Existing methods predominantly rely on a \emph{pixel-aligned} Gaussian prediction paradigm, where each 2D pixel is mapped to a 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Weijie Wang , Yeqing Chen , Zeyu Zhang , Hengyu Liu , Haoxiao Wang , Zhiyuan Feng , Wenkang Qin , Feng Chen , Zheng Zhu , Donny Y. Chen , Bohan Zhuang

Recovering 3D information from scenes via multi-view stereo reconstruction (MVS) and novel view synthesis (NVS) is inherently challenging, particularly in scenarios involving sparse-view setups. The advent of 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Shubhendu Jena , Shishir Reddy Vutukur , Adnane Boukhayma

This survey comprehensively reviews the evolving field of multi-robot collaborative Simultaneous Localization and Mapping (SLAM) using 3D Gaussian Splatting (3DGS). As an explicit scene representation, 3DGS has enabled unprecedented…

Robotics · Computer Science 2025-10-29 Phuc Nguyen Xuan , Thanh Nguyen Canh , Huu-Hung Nguyen , Nak Young Chong , Xiem HoangVan

Recent advancements in 3D editing have highlighted the potential of text-driven methods in real-time, user-friendly AR/VR applications. However, current methods rely on 2D diffusion models without adequately considering multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Dong In Lee , Hyeongcheol Park , Jiyoung Seo , Eunbyung Park , Hyunje Park , Ha Dam Baek , Sangheon Shin , Sangmin Kim , Sangpil Kim

3D Gaussian Splatting (3DGS) has recently unlocked real-time, high-fidelity novel view synthesis by representing scenes using explicit 3D primitives. However, traditional methods often require millions of Gaussians to capture complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Anh Thuan Tran , Jana Kosecka

3D Gaussian splatting (3DGS) has demonstrated impressive performance in synthesizing high-fidelity novel views. Nonetheless, its effectiveness critically depends on the quality of the initialized point cloud. Specifically, achieving uniform…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yikang Zhang , Rui Fan

High-quality reconstruction is crucial for dense SLAM. Recent popular approaches utilize 3D Gaussian Splatting (3D GS) techniques for RGB, depth, and semantic reconstruction of scenes. However, these methods often overlook issues of detail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zhenzhong Cao , Chenyang Zhao , Qianyi Zhang , Jinzheng Guang , Yinuo Song Jingtai Liu

Previous research has investigated the application of Multimodal Large Language Models (MLLMs) in understanding 3D scenes by interpreting them as videos. These approaches generally depend on comprehensive 3D data inputs, such as point…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Duo Zheng , Shijia Huang , Yanyang Li , Liwei Wang

Recently, 3D Gaussian splatting has gained attention for its capability to generate high-fidelity rendering results. At the same time, most applications such as games, animation, and AR/VR use mesh-based representations to represent and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jaehoon Choi , Yonghan Lee , Hyungtae Lee , Heesung Kwon , Dinesh Manocha

Recent advances in 3D scene-language understanding have leveraged Large Language Models (LLMs) for 3D reasoning by transferring their general reasoning ability to 3D multi-modal contexts. However, existing methods typically adopt standard…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yerim Jeon , Miso Lee , WonJun Moon , Jae-Pil Heo