English
Related papers

Related papers: UHR-BAT: Budget-Aware Token Compression Vision-Lan…

200 papers

High-resolution (HR) 3D magnetic resonance imaging (MRI) can provide detailed anatomical structural information, enabling precise segmentation of regions of interest for various medical image analysis tasks. Due to the high demands of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Zhiyun Song , Yinjie Zhao , Xiaomin Li , Manman Fei , Xiangyu Zhao , Mengjun Liu , Cunjian Chen , Chung-Hsing Yeh , Qian Wang , Guoyan Zheng , Songtao Ai , Lichi Zhang

Transformer-based methods have demonstrated impressive performance in low-level visual tasks such as Image Super-Resolution (SR). However, its computational complexity grows quadratically with the spatial resolution. A series of works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xin Liu , Jie Liu , Jie Tang , Gangshan Wu

Large language models (LLMs) increasingly rely on long-context modeling for tasks such as document understanding, code analysis, and multi-step reasoning. However, scaling context windows to the million-token level brings prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiale Cheng , Yusen Liu , Xinyu Zhang , Yulin Fei , Wenyi Hong , Ruiliang Lyu , Weihan Wang , Zhe Su , Xiaotao Gu , Xiao Liu , Yushi Bai , Jie Tang , Hongning Wang , Minlie Huang

Modern change detection (CD) has achieved remarkable success by the powerful discriminative ability of deep convolutions. However, high-resolution remote sensing CD remains challenging due to the complexity of objects in the scene. Objects…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hao Chen , Zipeng Qi , Zhenwei Shi

We present DeepSeek-OCR as an initial investigation into the feasibility of compressing long contexts via optical 2D mapping. DeepSeek-OCR consists of two components: DeepEncoder and DeepSeek3B-MoE-A570M as the decoder. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Haoran Wei , Yaofeng Sun , Yukun Li

A major challenge for high dynamic range (HDR) image reconstruction from multi-exposed low dynamic range (LDR) images, especially with dynamic scenes, is the extraction and merging of relevant contextual features in order to suppress any…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Lingkai Zhu , Fei Zhou , Bozhi Liu , Orcun Göksel

Embedding image features into a binary Hamming space can improve both the speed and accuracy of large-scale query-by-example image retrieval systems. Supervised hashing aims to map the original features to compact binary codes in a manner…

Machine Learning · Computer Science 2016-11-17 Guosheng Lin , Chunhua Shen , Anton van den Hengel

It has long been considered a significant problem to improve the visual quality of lossy image and video compression. Recent advances in computing power together with the availability of large training data sets has increased interest in…

Multimedia · Computer Science 2017-03-30 Aaditya Prakash , Nick Moran , Solomon Garber , Antonella DiLillo , James Storer

The encoding of the target in object tracking moves from the coarse bounding-box to fine-grained segmentation map recently. Revisiting de facto real-time approaches that are capable of predicting mask during tracking, we observed that they…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Zhipeng Zhang , Bing Li , Weiming Hu , Houwen Peng

Vision Transformers (ViTs) achieve state-of-the-art performance in semantic segmentation but are hindered by high computational and memory costs. To address this, we propose STEP (SuperToken and Early-Pruning), a hybrid token-reduction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Michal Szczepanski , Martyna Poreba , Karim Haroun

Large vision-language models (VLMs) typically process hundreds or thousands of visual tokens per image or video frame, incurring quadratic attention cost and substantial redundancy. Existing token reduction methods often ignore the textual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Kaitong Cai , Jusheng Zhang , Jing Yang , Yijia Fan , Pengtao Xie , Jian Wang , Keze Wang

Vision Language Models (VLMs) have demonstrated strong capabilities across various visual understanding and reasoning tasks, driven by incorporating image representations into the token inputs of Large Language Models (LLMs). However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kevin Y. Li , Sachin Goyal , Joao D. Semedo , J. Zico Kolter

The emerging and existing light field displays are highly capable of realistic presentation of 3D scenes on auto-stereoscopic glasses-free platforms. The light field size is a major drawback while utilising 3D displays and streaming…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Sally Khaidem , Mansi Sharma

Obtaining high-resolution (HR) segmentations from coarse annotations is a pervasive challenge in computer vision. Applications include inferring pixel-level segmentations from token-level labels in vision transformers, upsampling coarse…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xiaoling Hu , Peirong Liu , Dina Zemlyanker , Jonathan Williams Ramirez , Oula Puonti , Juan Eugenio Iglesias

Large vision-language models (LVLMs) excel at visual understanding, but face efficiency challenges due to quadratic complexity in processing long multi-modal contexts. While token compression can reduce computational costs, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xuyang Liu , Ziming Wang , Junjie Chen , Yuhang Han , Yingyao Wang , Jiale Yuan , Jun Song , Siteng Huang , Honggang Chen

This work introduces composed image retrieval to remote sensing. It allows to query a large image archive by image examples alternated by a textual description, enriching the descriptive power over unimodal queries, either visual or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bill Psomas , Ioannis Kakogeorgiou , Nikos Efthymiadis , Giorgos Tolias , Ondrej Chum , Yannis Avrithis , Konstantinos Karantzalos

Recent large audio language models (LALMs) demonstrate remarkable capabilities in processing extended multi-modal sequences, yet incur high inference costs. Token compression is an effective method that directly reduces redundant tokens in…

Hybrid CNN-Transformer architectures achieve strong results in image super-resolution, but scaling attention windows or convolution kernels significantly increases computational cost, limiting deployment on resource-constrained devices. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Cao Thien Tan , Phan Thi Thu Trang , Do Nghiem Duc , Ho Ngoc Anh , Hanyang Zhuang , Nguyen Duc Dung

Fine-grained hashing has become a powerful solution for rapid and efficient image retrieval, particularly in scenarios requiring high discrimination between visually similar categories. To enable each hash bit to correspond to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Peng Wang , Yong Li , Lin Zhao , Xiu-Shen Wei

Long video understanding poses a significant challenge for current Multi-modal Large Language Models (MLLMs). Notably, the MLLMs are constrained by their limited context lengths and the substantial costs while processing long videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yan Shu , Zheng Liu , Peitian Zhang , Minghao Qin , Junjie Zhou , Zhengyang Liang , Tiejun Huang , Bo Zhao