English
Related papers

Related papers: Spatio-Temporal Token Pruning for Efficient High-R…

200 papers

This paper presents a novel approach to neural network pruning by integrating a graph-based observation space into an AutoML framework to address the limitations of existing methods. Traditional pruning approaches often depend on…

Machine Learning · Computer Science 2025-09-16 Dieter Balemans , Thomas Huybrechts , Jan Steckel , Siegfried Mercelis

Recent progress in Multimodal Large Language Models(MLLMs) often use large image tokens to compensate the visual shortcoming of MLLMs, which not only exhibits obvious redundancy but also greatly exacerbates the already high computation.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Weihao Ye , Qiong Wu , Wenhao Lin , Yiyi Zhou

Recent research in language-guided visual navigation has demonstrated a significant demand for the diversity of traversable environments and the quantity of supervision for training generalizable agents. To tackle the common data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Zun Wang , Jialu Li , Yicong Hong , Yi Wang , Qi Wu , Mohit Bansal , Stephen Gould , Hao Tan , Yu Qiao

Multimodal large language models (MLLMs) have shown remarkable capabilities in a wide range of vision-language tasks. However, the large number of visual tokens introduces significant computational overhead. To address this issue, visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yuxiang Duan , Ao Li , Yingqin Li , Luyu Li , Pengwei Wang

Token pruning is essential for enhancing the computational efficiency of vision-language models (VLMs), particularly for video-based tasks where temporal redundancy is prevalent. Prior approaches typically prune tokens either (1) within the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Jianrui Zhang , Yue Yang , Rohun Tripathi , Winson Han , Ranjay Krishna , Christopher Clark , Yong Jae Lee , Sangho Lee

Advances in Multimodal Large Language Models have significantly enhanced Graphical User Interface (GUI) automation. Equipping GUI agents with reliable episodic reasoning capabilities is essential for bridging the gap between users' concise…

Artificial Intelligence · Computer Science 2025-11-13 Ziwei Wang , Leyang Yang , Xiaoxuan Tang , Sheng Zhou , Dajun Chen , Wei Jiang , Yong Li

Multimodal Large Language Models (MLLMs) have demonstrated immense potential in Earth observation. However, the massive visual tokens generated when processing Ultra-High-Resolution (UHR) imagery introduce prohibitive computational…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yueying Li , Fengxiang Wang , Yan Li , Mingshuo Chen , Mengying Zhao , Long Lan

Large Multimodal Models (LMMs) have achieved significant success across various tasks. These models usually encode visual inputs into dense token sequences, which are then concatenated with textual tokens and jointly processed by a language…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Hao Zhang , Mengsi Lyu , Chenrui He , Yulong Ao , Yonghua Lin

Multimodal encoders have pushed the boundaries of visual document retrieval, matching textual query tokens directly to image patches and achieving state-of-the-art performance on public benchmarks. Recent models relying on this paradigm…

Computation and Language · Computer Science 2026-04-08 Omri Uzan , Asaf Yehudai , Roi pony , Eyal Shnarch , Ariel Gera

Token pruning has emerged as an effective approach to reduce the substantial computational overhead of Large Vision-Language Models (LVLMs) by discarding less informative visual tokens while preserving performance. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Kexin Ma , Jing Xiao , Chaofeng Chen , Geyong Min , Guibo Zhu , Jinqiao Wang , Liang Liao

Structured pruning greatly eases the deployment of large neural networks in resource-constrained environments. However, current methods either involve strong domain expertise, require extra hyperparameter tuning, or are restricted only to a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Qingyuan Li , Bo Zhang , Xiangxiang Chu

Token compression is essential for reducing the computational and memory requirements of transformer models, enabling their deployment in resource-constrained environments. In this work, we propose an efficient and hardware-compatible token…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Junzhu Mao , Yang Shen , Jinyang Guo , Yazhou Yao , Xiansheng Hua

Visual token pruning reduces the computational cost of Vision-Language Models (VLMs) by removing redundant visual tokens. Existing methods typically rely on Gumbel-Softmax to approximate discrete selection during training. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Landi He , Mingde Yao , Shawn Young , Lijian Xu

Channel pruning is a powerful technique to reduce the computational overhead of deep neural networks, enabling efficient deployment on resource-constrained devices. However, existing pruning methods often rely on local heuristics or…

Artificial Intelligence · Computer Science 2025-06-16 Zifan Liu , Yuan Cao , Yanwei Yu , Heng Qi , Jie Gui

Although dynamic scene reconstruction has long been a fundamental challenge in 3D vision, the recent emergence of 3D Gaussian Splatting (3DGS) offers a promising direction by enabling high-quality, real-time rendering through explicit…

Graphics · Computer Science 2025-05-29 Zehao Li , Hao Jiang , Yujun Cai , Jianing Chen , Baolong Bi , Shuqin Gao , Honglong Zhao , Yiwei Wang , Tianlu Mao , Zhaoqi Wang

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains.…

Computation and Language · Computer Science 2025-05-23 Yuqi Zhou , Sunhao Dai , Shuai Wang , Kaiwen Zhou , Qinglin Jia , Jun Xu

Existing GUI grounding methods often struggle with fine-grained localization in high-resolution screenshots. To address this, we propose GUI-ARP, a novel framework that enables adaptive multi-stage inference. Equipped with the proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Xianhang Ye , Yiqing Li , Wei Dai , Miancan Liu , Ziyuan Chen , Zhangye Han , Hongbo Min , Jinkui Ren , Xiantao Zhang , Wen Yang , Zhi Jin

The rise of large language models (LLMs) has significantly advanced various natural language processing (NLP) tasks. However, the resource demands of these models pose substantial challenges. Structured pruning is an effective approach to…

Machine Learning · Computer Science 2024-12-17 Changhai Zhou , Yuhua Zhou , Shijie Han , Qian Qiao , Hongguang Li

Structural pruning enhances hardware-agnostic inference efficiency for large language models (LLMs) yet often fails to maintain comparable performance. Local pruning performs efficient layer-by-layer compression but ignores global topology.…

Machine Learning · Computer Science 2025-10-22 Guanchen Li , Yixing Xu , Zeping Li , Ji Liu , Xuanwu Yin , Dong Li , Emad Barsoum

This paper presents a novel framework combining group equivariant convolutional neural networks (G-CNNs) with equivariant-aware structured pruning to produce compact, transformation-invariant models for resource-constrained environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Mohammed Alnemari