English
Related papers

Related papers: LiteVGGT: Boosting Vanilla VGGT via Geometry-aware…

200 papers

Foundation models for 3D vision have recently demonstrated remarkable capabilities in 3D perception. However, extending these models to large-scale RGB stream 3D reconstruction remains challenging due to memory limitations. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Kai Deng , Zexin Ti , Jiawei Xu , Jian Yang , Jin Xie

The grand vision of enabling persistent, large-scale 3D visual geometry understanding is shackled by the irreconcilable demands of scalability and long-term stability. While offline models like VGGT achieve inspiring geometry capability,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Shuai Yuan , Yantai Yang , Xiaotian Yang , Xupeng Zhang , Zhonghao Zhao , Lingming Zhang , Zhipeng Zhang

We present a scalable 3D reconstruction model that addresses a critical limitation in offline feed-forward methods: their computational and memory requirements grow quadratically w.r.t. the number of input images. Our approach is built on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Sven Elflein , Ruilong Li , Sérgio Agostinho , Zan Gojcic , Laura Leal-Taixé , Qunjie Zhou , Aljosa Osep

3D instance segmentation methods typically rely on high-quality point clouds or posed RGB-D scans, requiring complex multi-stage processing pipelines, and are highly sensitive to reconstruction noise. While recent feed-forward transformers…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jinyuan Qu , Hongyang Li , Lei Zhang

Computing geodesic distances on 3D surfaces is fundamental to many tasks in 3D vision and geometry processing, with deep connections to tasks such as shape correspondence. Recent learning-based methods achieve strong performance but rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yohanes Yudhi Adikusuma , Qixing Huang , Ying He

Recent advancements in neural visual geometry, including transformer-based models such as VGGT and Pi3, have achieved impressive accuracy on 3D reconstruction tasks. However, their reliance on full attention makes them fundamentally limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Leo Kaixuan Cheng , Abdus Shaikh , Ruofan Liang , Zhijie Wu , Yushi Guan , Nandita Vijaykumar

In this paper, we introduce LightVLM, a simple but effective method that can be seamlessly deployed upon existing Vision-Language Models (VLMs) to greatly accelerate the inference process in a training-free manner. We divide the inference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lianyu Hu , Fanhua Shang , Wei Feng , Liang Wan

The computational expense of redundant vision tokens in Large Vision-Language Models (LVLMs) has led many existing methods to compress them via a vision projector. However, this compression may lose visual information that is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Ze Feng , Jiang-jiang Liu , Sen Yang , Lingyu Xiao , Zhibin Quan , Zhenhua Feng , Wankou Yang , Jingdong Wang

Despite significant progress in Vision-Language Navigation (VLN), existing approaches still rely on dense RGB videos that produce excessive patch tokens and lack explicit spatial structure, resulting in substantial computational overhead…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Jiahao Yang , Zihan Wang , Xiangyang Li , Xing Zhu , Yujun Shen , Yinghao Xu , Shuqiang Jiang

Streaming visual transformers like StreamVGGT achieve strong 3D perception but suffer from unbounded growth of key value (KV) memory, which limits scalability. We propose a training-free, inference-time token eviction policy that bounds…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Soroush Mahdi , Fardin Ayar , Ehsan Javanmardi , Manabu Tsukada , Mahdi Javanmardi

Vision Transformers (ViTs) have achieved strong performance in visual recognition, yet their deployment in resource-constrained industrial environments remains limited. Some main challenges are their high computational cost, memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Phat Nguyen , Xue Geng , Kaixin Xu , Wang Zhe , Xulei Yang , Ngai-Man Cheung

Transformer-based general visual geometry frameworks have shown promising performance in camera pose estimation and 3D scene understanding. Recent advancements in Visual Geometry Grounded Transformer (VGGT) models have shown great promise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yangfan Xu , Lilian Zhang , Xiaofeng He , Pengdong Wu , Wenqi Wu , Jun Mao

Visual Geometry Grounded Transformer (VGGT) delivers state-of-the-art feed-forward 3D reconstruction, yet its global self-attention layer suffers from a drastic collapse phenomenon when the input sequence exceeds a few hundred frames:…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Huan Li , Longjun Luo , Yuling Shi , Xiaodong Gu

Recently, linear complexity sequence modeling networks have achieved modeling capabilities similar to Vision Transformers on a variety of computer vision tasks, while using fewer FLOPs and less memory. However, their advantage in terms of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Bencheng Liao , Xinggang Wang , Lianghui Zhu , Qian Zhang , Chang Huang

Vector graphics (VG) have been ubiquitous in our daily life with vast applications in engineering, architecture, designs, etc. The VG recognition process of most existing methods is to first render the VG into raster graphics (RG) and then…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoxi Shi , Xinyang Jiang , Caihua Shan , Yansen Wang , Dongsheng Li

We present a fast, spatio-temporal scene understanding framework based on Visual Geometry Grounded Transformer (VGGT). The proposed pipeline is designed to enable efficient, close to real-time performance, supporting applications including…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Gergely Dinya , Péter Halász , András Lőrincz , Kristóf Karacs , Anna Gelencsér-Horváth

Many modern ViT backbones adopt spatial architectural designs, such as window attention, decomposed relative positional embeddings in SAM, and RoPE in DINOv3. Such architectures impose new challenges on token reduction, as the vast majority…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wenyi Gong , Mieszko Lis

Visual Geometry Transformer (VGGT) is a strong feed-forward model for multiple 3D tasks, but its Alternating-Attention (AA) stack scales quadratically in the total token count, making long clips expensive. Existing token-reduction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haotang Li , Zhenyu Qi , Shaohan Henry Wang , Kebin Peng , Zi Wang , Qing Guo , Sen He , Huanrui Yang

Efficient and scalable 3D surface reconstruction from range data remains a core challenge in computer graphics and vision, particularly in real-time and resource-constrained scenarios. Traditional volumetric methods based on…

Graphics · Computer Science 2025-11-27 Lorenzo De Rebotti , Emanuele Giacomini , Giorgio Grisetti , Luca Di Giammarino

Feed-forward reconstruction has been progressed rapidly, with the Visual Geometry Grounded Transformer (VGGT) being a notable baseline. However, directly applying VGGT to autonomous driving (AD) fails to capture three domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xiaosong Jia , Yanhao Liu , Yu Hong , Renqiu Xia , Junqi You , Bin Sun , Zhihui Hao , Junchi Yan