English
Related papers

Related papers: UHR-BAT: Budget-Aware Token Compression Vision-Lan…

200 papers

Image super-resolution (SR) aims to reconstruct high-quality, high-resolution (HR) images from low-resolution (LR) inputs and plays a critical role in various downstream applications. Despite recent advancements, balancing reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Hanli Zhao , Binhao Wang , Shihao Zhao , Tao Wang , Kaihao Zhang , Wanglong Lu

Tokenizing raw texts into word units is an essential pre-processing step for critical tasks in the NLP pipeline such as tagging, parsing, named entity recognition, and more. For most languages, this tokenization step straightforward.…

Computation and Language · Computer Science 2022-03-22 Idan Brusilovsky , Reut Tsarfaty

LLM-based agents show strong potential for long-horizon reasoning, yet their context size is limited by deployment factors (e.g., memory, latency, and cost), yielding a constrained context budget. As interaction histories grow, this induces…

Artificial Intelligence · Computer Science 2026-04-03 Yong Wu , YanZhao Zheng , TianZe Xu , ZhenTao Zhang , YuanQiang Yu , JiHuai Zhu , Chao Ma , BinBin Lin , BaoHua Dong , HangCheng Zhu , RuoHui Huang , Gang Yu

Visual encoding constitutes a major computational bottleneck in Multimodal Large Language Models (MLLMs), especially for high-resolution image inputs. The prevailing practice typically adopts global encoding followed by post-ViT…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Kechen Fang , Yihua Qin , Chongyi Wang , Wenshuo Ma , Tianyu Yu , Yuan Yao

The spatial attention is a straightforward approach to enhance the performance for remote sensing image captioning. However, conventional spatial attention approaches consider only the attention distribution on one fixed coarse grid,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Chengze Wang , Zhiyu Jiang , Yuan Yuan

To enhance perception in autonomous vehicles (AVs), recent efforts are concentrating on 3D object detectors, which deliver more comprehensive predictions than traditional 2D object detectors, at the cost of increased memory footprint and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Abhishek Balasubramaniam , Febin P Sunny , Sudeep Pasricha

The exponential expansion of context windows in LLMs has unlocked capabilities for long-document understanding but introduced severe bottlenecks in inference latency and information utilization. Existing compression methods often suffer…

Computation and Language · Computer Science 2026-03-23 Zhengpei Hu , Kai Li , Dapeng Fu , Chang Zeng , Yue Li , Yuanhao Tang , Jianqiang Huang

In this paper, we propose a novel approach to address the challenges of printed Urdu text recognition using high-resolution, multi-scale semantic feature extraction. Our proposed UTRNet architecture, a hybrid CNN-RNN model, demonstrates…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Abdur Rahman , Arjun Ghosh , Chetan Arora

Current high-resolution vision-language models encode images as high-resolution image tokens and exhaustively take all these tokens to compute attention, which significantly increases the computational cost. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Junyan Li , Delin Chen , Tianle Cai , Peihao Chen , Yining Hong , Zhenfang Chen , Yikang Shen , Chuang Gan

As the capabilities of Vision-Language Models (VLMs) advance, they can process increasingly large inputs, which, unlike in LLMs, generates significant visual token redundancy and leads to prohibitive inference costs. While many methods aim…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pu Zhang , Yuwei Li , Xingyuan Xian , Guoming Tang

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chong Liu , Yuqi Zhang , Hongsong Wang , Weihua Chen , Fan Wang , Yan Huang , Yi-Dong Shen , Liang Wang

Vision Transformers (ViTs) have achieved strong performance in visual recognition, yet their deployment in resource-constrained industrial environments remains limited. Some main challenges are their high computational cost, memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Phat Nguyen , Xue Geng , Kaixin Xu , Wang Zhe , Xulei Yang , Ngai-Man Cheung

Semantic segmentation of remotely sensed images plays an important role in land resource management, yield estimation, and economic assessment. U-Net, a deep encoder-decoder architecture, has been used frequently for image segmentation with…

Image and Video Processing · Electrical Eng. & Systems 2022-05-06 Rui Li , Chenxi Duan , Shunyi Zheng , Ce Zhang , Peter M. Atkinson

Long-context reasoning has significantly empowered large language models (LLMs) to tackle complex tasks, yet it introduces severe efficiency bottlenecks due to the computational complexity. Existing efficient approaches often rely on…

Computation and Language · Computer Science 2026-02-03 Yibo Wang , Yongcheng Jing , Shunyu Liu , Hao Guan , Rong-cheng Tu , Chengyu Wang , Jun Huang , Dacheng Tao

Real-world data typically contain repeated and periodic patterns. This suggests that they can be effectively represented and compressed using only a few coefficients of an appropriate basis (e.g., Fourier, Wavelets, etc.). However, distance…

Machine Learning · Statistics 2014-05-26 Michail Vlachos , Nikolaos Freris , Anastasios Kyrillidis

Existing Multimodal Large Language Models (MLLMs) process a large number of visual tokens, leading to significant computational costs and inefficiency. Instruction-related visual token compression demonstrates strong task relevance, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Lei Lei , Jie Gu , Xiaokang Ma , Chu Tang , Jingmin Chen , Tong Xu

As Large Language Models (LLMs) scale to support context windows exceeding one million tokens, the linear growth of Key-Value (KV) cache imposes severe memory capacity and bandwidth bottlenecks, constraining the efficiency of long-context…

Computation and Language · Computer Science 2026-04-09 Zhirui Chen , Peiyang Liu , Ling Shao

Visual inspection is the predominant technique for evaluating the condition of civil infrastructure. The recent advances in unmanned aerial vehicles (UAVs) and artificial intelligence have made the visual inspections faster, safer, and more…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 Kareem Eltouny , Seyedomid Sajedi , Xiao Liang

Chain-of-Thought (CoT) reasoning enhances large language models (LLMs) by enabling step-by-step problem-solving, yet its extension to Long-CoT introduces substantial computational overhead due to increased token length. Existing compression…

Computation and Language · Computer Science 2025-11-14 Yibo Wang , Haotian Luo , Huanjin Yao , Tiansheng Huang , Haiying He , Rui Liu , Naiqiang Tan , Jiaxing Huang , Xiaochun Cao , Dacheng Tao , Li Shen

Long-context large language models remain computationally expensive to run and often fail to reliably process very long inputs, which makes context compression an important component of many systems. Existing compression approaches…

Computation and Language · Computer Science 2026-04-28 Yitian Zhou , Chaoning Zhang , Jiaquan Zhang , Zhenzhen Huang , Jinyu Guo , Sung-Ho Bae , Lik-Hang Lee , Caiyan Qin , Yang Yang