中文
相关论文

相关论文: Spatio-Temporal Token Pruning for Efficient High-R…

200 篇论文

Visual Autoregressive modeling (VAR) has emerged as a highly efficient alternative to diffusion-based frameworks, achieving comparable synthesis quality. However, as this paradigm extends to Spacetime Autoregressive modeling (STAR) for…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Sungwoong Yune , Suheon Jeong , Joo-Young Kim

Despite achieving remarkable performance on various vision-language tasks, Transformer-based Vision-Language Models (VLMs) suffer from redundancy in inputs and parameters, significantly hampering their efficiency in real-world applications.…

计算与语言 · 计算机科学 2024-02-27 Zekun Wang , Jingchang Chen , Wangchunshu Zhou , Haichao Zhu , Jiafeng Liang , Liping Shan , Ming Liu , Dongliang Xu , Qing Yang , Bing Qin

For multimodal large language models (MLLMs), visual information is relatively sparse compared with text. As a result, research on visual pruning emerges for efficient inference. Current approaches typically measure token importance based…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Jiameng Li , Aleksei Tiulpin , Matthew B. Blaschko

GUI grounding, the task of mapping natural-language instructions to pixel coordinates, is crucial for autonomous agents, yet remains difficult for current VLMs. The core bottleneck is reliable patch-to-pixel mapping, which breaks when…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Suyuchen Wang , Tianyu Zhang , Ahmed Masry , Christopher Pal , Spandana Gella , Bang Liu , Perouz Taslakian

Large models achieve strong performance on Vision-and-Language Navigation (VLN) tasks, but are costly to run in resource-limited environments. Token pruning offers appealing tradeoffs for efficiency with minimal performance loss by reducing…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Wenda Qin , Andrea Burns , Bryan A. Plummer , Margrit Betke

Visual Place Recognition (VPR) aims to match a query image to reference images of the same place in a large-scale database. Recent state-of-the-art methods employ Vision Transformers (ViTs) as backbone foundation models to extract…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Zichao Zeng , June Moh Goo , Junwei Zheng , Weijia Fan , Jiaming Zhang , Rainer Stiefelhagen , Jan Boehm

Graphical User Interface (GUI) grounding, the task of mapping natural language instructions to precise screen coordinates, is fundamental to autonomous GUI agents. While existing methods achieve strong performance through extensive…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Yong Du , Yuchen Yan , Fei Tang , Zhengxi Lu , Chang Zong , Weiming Lu , Shengpei Jiang , Yongliang Shen

Recent multimodal large language models are computationally expensive because Transformers must process a large number of visual tokens. We present ReDiPrune, a training-free token pruning method applied before the vision-language…

计算机视觉与模式识别 · 计算机科学 2026-04-01 An Yu , Ting Yu Tsai , Zhenfei Zhang , Weiheng Lu , Felix X. -F. Ye , Ming-Ching Chang

Visual navigation requires the robot to reach a specified goal such as an image, based on a sequence of first-person visual observations. While recent learning-based approaches have made significant progress, they often focus on improving…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Hao Ren , Zetong Bi , Yiming Zeng , Zhaoliang Wan , Lu Qi , Hui Cheng

Multimodal Large Language Models (MLLMs) have achieved strong performance across vision-language tasks, but suffer from significant computational overhead due to the quadratic growth of attention computations with the number of multimodal…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Yingqi Fan , Anhao Zhao , Jinlan Fu , Junlong Tong , Hui Su , Yijie Pan , Wei Zhang , Xiaoyu Shen

Robotic manipulation with Vision-Language-Action models requires efficient inference over long-horizon multi-modal context, where attention to dense visual tokens dominates computational cost. Existing methods optimize inference speed by…

机器人学 · 计算机科学 2025-09-29 Xiaohuan Pei , Yuxing Chen , Siyu Xu , Yunke Wang , Yuheng Shi , Chang Xu

Large-scale neural networks have demonstrated remarkable performance in different domains like vision and language processing, although at the cost of massive computation resources. As illustrated by compression literature, structural model…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Tianjin Huang , Fang Meng , Li Shen , Fan Liu , Yulong Pei , Mykola Pechenizkiy , Shiwei Liu , Tianlong Chen

Deep learning models for Time Series Classification (TSC) have achieved strong predictive performance but their high computational and memory requirements often limit deployment on resource-constrained devices. While structured pruning can…

机器学习 · 计算机科学 2026-02-16 Javidan Abdullayev , Maxime Devanne , Cyril Meyer , Ali Ismail-Fawaz , Jonathan Weber , Germain Forestier

Two-view correspondence pruning aims to identify reliable correspondences for camera pose estimation, serving as a fundamental step in many 3D vision tasks. Existing methods rely on geometric consistency to seek true correspondences…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Tangfei Liao , Xiaoqin Zhang , Tao Wang , Hao Ye , Min Li , Guobao Xiao , Mang Ye

Vision-Language Models (VLMs) encode images and videos into abundant tokens, which contain substantial redundancy and computation cost. While visual token pruning mitigates the issue, most existing methods lack insight into the intrinsic…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Jizhihui Liu , Feiyi Du , Guangdao Zhu , Niu Lian , Jun Li , Bin Chen , Weili Guan , Yaowei Wang

Identity-preserving text-to-video (IPT2V) generation, which aims to create high-fidelity videos with consistent human identity, has become crucial for downstream applications. However, current end-to-end frameworks suffer a critical…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Yuji Wang , Moran Li , Xiaobin Hu , Ran Yi , Jiangning Zhang , Han Feng , Weijian Cao , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Remote sensing spatiotemporal fusion (STF) addresses the fundamental trade-off between temporal and spatial resolution by combining high temporal-low spatial and high spatial-low temporal imagery. This paper presents the first comprehensive…

计算机视觉与模式识别 · 计算机科学 2025-07-14 Enzhe Sun , Yongchuan Cui , Peng Liu , Jining Yan

Imaging across both the full transverse spatial and temporal dimensions of a scene with high precision in all three coordinates is key to applications ranging from LIDAR to fluorescence lifetime imaging. However, compromises that sacrifice,…

图像与视频处理 · 电气工程与系统科学 2021-01-12 C. Callenberg , A. Lyons , D. den Brok , A. Fatima , A. Turpin , V. Zickus , L. Machesky , J. Whitelaw , D. Faccio , M. B. Hullin

Vision Language Models (VLMs) struggle with long-form videos due to the quadratic complexity of attention mechanisms. We propose Language-Guided Temporal Token Pruning (LGTTP), which leverages temporal cues from queries to adaptively prune…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Yogesh Kumar

Visual AutoRegressive (VAR) models based on next-scale prediction enable efficient hierarchical generation, yet the inference cost grows quadratically at high resolutions. We observe that the computationally intensive later scales…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Keli Liu , Zhendong Wang , Wengang Zhou , Houqiang Li