English
Related papers

Related papers: SemanticSplat: Feed-Forward 3D Scene Understanding…

200 papers

Recent advancements in 3D editing have highlighted the potential of text-driven methods in real-time, user-friendly AR/VR applications. However, current methods rely on 2D diffusion models without adequately considering multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Dong In Lee , Hyeongcheol Park , Jiyoung Seo , Eunbyung Park , Hyunje Park , Ha Dam Baek , Sangheon Shin , Sangmin Kim , Sangpil Kim

Reconstructing 3D scenes from sparse viewpoints is a long-standing challenge with wide applications. Recent advances in feed-forward 3D Gaussian sparse-view reconstruction methods provide an efficient solution for real-time novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Yang Xiao , Guoan Xu , Qiang Wu , Wenjing Jia

Empowering 3D Gaussian Splatting with generalization ability is appealing. However, existing generalizable 3D Gaussian Splatting methods are largely confined to narrow-range interpolation between stereo images due to their heavy backbones,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yunsong Wang , Tianxin Huang , Hanlin Chen , Gim Hee Lee

Injecting semantics into 3D Gaussian Splatting (3DGS) has recently garnered significant attention. While current approaches typically distill 3D semantic features from 2D foundational models (e.g., CLIP and SAM) to facilitate novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenbo Zhang , Lu Zhang , Ping Hu , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

The recent development of feedforward 3D Gaussian Splatting (3DGS) presents a new paradigm to reconstruct 3D scenes. Using neural networks trained on large-scale multi-view datasets, it can directly infer 3DGS representations from sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Zetian Song , Jiaye Fu , Jiaqi Zhang , Xiaohan Lu , Chuanmin Jia , Siwei Ma , Wen Gao

Feed-forward 3D Gaussian Splatting (3DGS) has emerged as a highly effective solution for novel view synthesis. Existing methods predominantly rely on a \emph{pixel-aligned} Gaussian prediction paradigm, where each 2D pixel is mapped to a 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Weijie Wang , Yeqing Chen , Zeyu Zhang , Hengyu Liu , Haoxiao Wang , Zhiyuan Feng , Wenkang Qin , Feng Chen , Zheng Zhu , Donny Y. Chen , Bohan Zhuang

3D Gaussian Splatting has recently gained traction for its efficient training and real-time rendering. While its vanilla representation is mainly designed for view synthesis, recent works extended it to scene understanding with language…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siyun Liang , Sen Wang , Kunyi Li , Michael Niemeyer , Stefano Gasperini , Hendrik P. A. Lensch , Nassir Navab , Federico Tombari

3D Gaussian Splatting (3DGS) techniques have achieved satisfactory 3D scene representation. Despite their impressive performance, they confront challenges due to the limitation of structure-from-motion (SfM) methods on acquiring accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Ao Gao , Luosong Guo , Tao Chen , Zhao Wang , Ying Tai , Jian Yang , Zhenyu Zhang

3D semantic field learning is crucial for applications like autonomous navigation, AR/VR, and robotics, where accurate comprehension of 3D scenes from limited viewpoints is essential. Existing methods struggle under sparse view conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Kangjie Chen , BingQuan Dai , Minghan Qin , Dongbin Zhang , Peihao Li , Yingshuang Zou , Haoqian Wang

3D scene reconstruction is fundamental for spatial intelligence applications such as AR, robotics, and digital twins. Traditional multi-view stereo struggles with sparse viewpoints or low-texture regions, while neural rendering approaches,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiaqi Yao , Zhongmiao Yan , Jingyi Xu , Songpengcheng Xia , Yan Xiang , Ling Pei

Understanding 3D scenes is pivotal for autonomous driving, robotics, and augmented reality. Recent semantic Gaussian Splatting approaches leverage large-scale 2D vision models to project 2D semantic features onto 3D scenes. However, they…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tianyu Huang , Runnan Chen , Dongting Hu , Fengming Huang , Mingming Gong , Tongliang Liu

We present ViewSplat, a view-adaptive 3D Gaussian splatting network for novel view synthesis from unposed images. While recent feed-forward 3D Gaussian splatting has significantly accelerated 3D scene reconstruction by bypassing per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Moonyeon Jeong , Seunggi Min , Suhyeon Lee , Hongje Seong

Understanding open-vocabulary 3D scenes with Gaussian-based representations remains challenging due to fragmented and spatially inconsistent semantic predictions across multi-view observations. In this paper, we present OpenGaFF, a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Kunyi Li , Michael Niemeyer , Sen Wang , Stefano Gasperini , Nassir Navab , Federico Tombari

Feed-forward 3D reconstruction from sparse, low-resolution (LR) images is a crucial capability for real-world applications, such as autonomous driving and embodied AI. However, existing methods often fail to recover fine texture details.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xinyuan Hu , Changyue Shi , Chuxiao Yang , Minghao Chen , Jiajun Ding , Tao Wei , Chen Wei , Zhou Yu , Min Tan

3D Gaussian Splatting (3DGS) has recently unlocked real-time, high-fidelity novel view synthesis by representing scenes using explicit 3D primitives. However, traditional methods often require millions of Gaussians to capture complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Anh Thuan Tran , Jana Kosecka

Lifting 2D open-vocabulary understanding into 3D Gaussian Splatting (3DGS) scenes is a critical challenge. Mainstream methods, built on an embedding paradigm, suffer from three key flaws: (i) geometry-semantic inconsistency, where points,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiayu Ding , Xinpeng Liu , Zhiyi Pan , Shiqiang Long , Ge Li

Recent advancements in 3D Gaussian Splatting (3D-GS) enable high-quality 3D scene reconstruction from RGB images. Many studies extend this paradigm for language-driven open-vocabulary scene understanding. However, most of them simply…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiazhong Cen , Xudong Zhou , Jiemin Fang , Changsong Wen , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

Feedforward 3D Gaussian Splatting (3DGS) overcomes the limitations of optimization-based 3DGS by enabling fast and high-quality reconstruction without the need for per-scene optimization. However, existing feedforward approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Anran Wu , Long Peng , Xin Di , Xueyuan Dai , Chen Wu , Yang Wang , Xueyang Fu , Yang Cao , Zheng-Jun Zha

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quentin Herau , Tianshuo Xu , Depu Meng , Jiezhi Yang , Chensheng Peng , Spencer Sherk , Yihan Hu , Wei Zhan

Reconstructing and understanding 3D scenes from unposed sparse views in a feed-forward manner remains as a challenging task in 3D computer vision. Recent approaches use per-pixel 3D Gaussian Splatting for reconstruction, followed by a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Honggyu An , Jaewoo Jung , Mungyeom Kim , Chaehyun Kim , Minkyeong Jeon , Jisang Han , Kazumi Fukuda , Takuya Narihira , Hyuna Ko , Junsu Kim , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim