English
Related papers

Related papers: UniGS: Unified Language-Image-3D Pretraining with …

200 papers

3D Gaussian splatting (3DGS) has recently emerged as an alternative representation that leverages a 3D Gaussian-based representation and introduces an approximated volumetric rendering, achieving very fast rendering speed and promising…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Joo Chan Lee , Daniel Rho , Xiangyu Sun , Jong Hwan Ko , Eunbyung Park

Robust 3D representation learning forms the perceptual foundation of spatial intelligence, enabling downstream tasks in scene understanding and embodied AI. However, learning such representations directly from unposed multi-view images…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bo Zhou , Qiuxia Lai , Zeren Sun , Xiangbo Shu , Yazhou Yao , Wenguan Wang

Progress in 3D vision-language learning has been hindered by the scarcity of large-scale 3D datasets. We introduce UniVLG, a unified architecture for 2D and 3D vision-language understanding that bridges the gap between existing 2D-centric…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ayush Jain , Alexander Swerdlow , Yuzhou Wang , Sergio Arnaud , Ada Martin , Alexander Sax , Franziska Meier , Katerina Fragkiadaki

Modern vision language pipelines are driven by RGB vision encoders trained on massive image text corpora. While these pipelines have enabled impressive zero-shot capabilities and strong transfer across tasks, they still inherit two…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yasmine Omri , Connor Ding , Tsachy Weissman , Thierry Tambe

3D Gaussian splatting (3DGS) is an innovative rendering technique that surpasses the neural radiance field (NeRF) in both rendering speed and visual quality by leveraging an explicit 3D scene representation. Existing 3DGS approaches require…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Lintao Xiang , Hongpei Zheng , Yating Huang , Qijun Yang , Hujun Yin

3D Gaussian Splatting is renowned for its high-fidelity reconstructions and real-time novel view synthesis, yet its lack of semantic understanding limits object-level perception. In this work, we propose ObjectGS, an object-aware framework…

Graphics · Computer Science 2025-07-22 Ruijie Zhu , Mulin Yu , Linning Xu , Lihan Jiang , Yixuan Li , Tianzhu Zhang , Jiangmiao Pang , Bo Dai

While 3DGS has emerged as a high-fidelity scene representation, encoding rich, general-purpose features directly from its primitives remains under-explored. We address this gap by introducing Chorus, a multi-teacher pretraining framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yue Li , Qi Ma , Runyi Yang , Mengjiao Ma , Bin Ren , Nikola Popovic , Nicu Sebe , Theo Gevers , Luc Van Gool , Danda Pani Paudel , Martin R. Oswald

Recent advancements in 3D editing have highlighted the potential of text-driven methods in real-time, user-friendly AR/VR applications. However, current methods rely on 2D diffusion models without adequately considering multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Dong In Lee , Hyeongcheol Park , Jiyoung Seo , Eunbyung Park , Hyunje Park , Ha Dam Baek , Sangheon Shin , Sangmin Kim , Sangpil Kim

Scene understanding based on 3D Gaussian Splatting (3DGS) has recently achieved notable advances. Although 3DGS related methods have efficient rendering capabilities, they fail to address the inherent contradiction between the anisotropic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Q. G. Duan , Benyun Zhao , Mingqiao Han Yijun Huang , Ben M. Chen

Self-supervised learning (SSL) for point cloud pre-training has become a cornerstone for many 3D vision tasks, enabling effective learning from large-scale unannotated data. At the scene level, existing SSL methods often incorporate volume…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Keyi Liu , Weidong Yang , Ben Fei , Ying He

While visual-language models have profoundly linked features between texts and images, the incorporation of 3D modality data, such as point clouds and 3D Gaussians, further enables pretraining for 3D-related tasks, e.g., cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Jiarun Liu , Qifeng Chen , Yiru Zhao , Minghua Liu , Baorui Ma , Sheng Yang

3D Gaussian Splatting has recently gained traction for its efficient training and real-time rendering. While its vanilla representation is mainly designed for view synthesis, recent works extended it to scene understanding with language…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siyun Liang , Sen Wang , Kunyi Li , Michael Niemeyer , Stefano Gasperini , Hendrik P. A. Lensch , Nassir Navab , Federico Tombari

3D Gaussian Splatting (3DGS) has emerged as a mainstream solution for novel view synthesis and 3D reconstruction. By explicitly encoding a 3D scene using a collection of Gaussian kernels, 3DGS achieves high-quality rendering with superior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Lei Lan , Tianjia Shao , Zixuan Lu , Yu Zhang , Chenfanfu Jiang , Yin Yang

3D Gaussian splatting (3DGS) offers the capability to achieve real-time high quality 3D scene rendering. However, 3DGS assumes that the scene is in a clear medium environment and struggles to generate satisfactory representations in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Haoran Wang , Nantheera Anantrasirichai , Fan Zhang , David Bull

Reconstructing dynamic 3D scenes from monocular video has broad applications in AR/VR, robotics, and autonomous navigation, but often fails due to severe motion blur caused by camera and object motion. Existing methods commonly follow a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhijing Wu , Longguang Wang

In this work, we propose a novel method to supervise 3D Gaussian Splatting (3DGS) scenes using optical tactile sensors. Optical tactile sensors have become widespread in their use in robotics for manipulation and object representation;…

Robotics · Computer Science 2024-08-19 Aiden Swann , Matthew Strong , Won Kyung Do , Gadiel Sznaier Camps , Mac Schwager , Monroe Kennedy

Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Quentin Herau , Moussab Bennehar , Arthur Moreau , Nathan Piasco , Luis Roldao , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

3D Gaussian Splatting has shown remarkable capabilities in novel view rendering tasks and exhibits significant potential for multi-view optimization.However, the original 3D Gaussian Splatting lacks color representation for inputs in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoran Wang , Jingwei Huang , Lu Yang , Tianchen Deng , Gaojing Zhang , Mingrui Li

Recent advancements in Generalizable Gaussian Splatting have enabled robust 3D reconstruction from sparse input views by utilizing feed-forward Gaussian Splatting models, achieving superior cross-scene generalization. However, while many…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Zhicong Wu , Hongbin Xu , Gang Xu , Ping Nie , Zhixin Yan , Jinkai Zheng , Liangqiong Qu , Ming Li , Liqiang Nie

3D Gaussian Splatting (3DGS) has emerged as a promising 3D reconstruction technique. The traditional 3DGS training pipeline follows three sequential steps: Gaussian densification, Gaussian projection, and color splatting. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Junyi Wu , Jiaming Xu , Jinhao Li , Yongkang Zhou , Jiayi Pan , Xingyang Li , Guohao Dai