English
Related papers

Related papers: Task-Oriented Feature Compression for Multimodal U…

200 papers

Fine-grained image recognition is challenging because discriminative clues are usually fragmented, whether from a single image or multiple images. Despite their significant improvements, most existing methods still focus on the most…

Multimedia · Computer Science 2022-06-07 Xinda Liu , Lili Wang , Xiaoguang Han

Large Language Models (LLMs) achieve strong performance across tasks, but face storage and compute challenges on edge devices. We propose EntroLLM, a compression framework combining mixed quantization and entropy coding to reduce storage…

Machine Learning · Computer Science 2026-05-05 Arnab Sanyal , Gourav Datta , Prithwish Mukherjee , Sandeep P. Chinchali , Michael Orshansky

Recent developments in Transformers have achieved notable strides in enhancing video comprehension. Nonetheless, the O($N^2$) computation complexity associated with attention mechanisms presents substantial computational hurdles when…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Yukun Feng , Yangming Shi , Fengze Liu , Tan Yan

Surveillance and security scenarios usually require high efficient facial image compression scheme for face recognition and identification. While either traditional general image codecs or special facial image compression schemes only…

Multimedia · Computer Science 2019-03-08 Zhibo Chen , Tianyu He

Anchor-based large-scale multi-view clustering has attracted considerable attention for its effectiveness in handling massive datasets. However, current methods mainly seek the consensus embedding feature for clustering by exploring global…

Machine Learning · Computer Science 2024-04-12 Zhen Long , Qiyuan Wang , Yazhou Ren , Yipeng Liu , Ce Zhu

This paper proposes a method that enhances the compression performance of the current model under development for the upcoming MPEG standard on Feature Coding for Machines (FCM). This standard aims at providing inter-operable compressed…

Image and Video Processing · Electrical Eng. & Systems 2025-12-15 Juan Merlos , Fabien Racapé , Hyomin Choi , Mateen Ulhaq , Hari Kalva

Recent advances on Multi-modal Large Language Models have demonstrated that high-resolution image input is crucial for model capabilities, especially for fine-grained tasks. However, high-resolution images lead to a quadratic increase in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Yuke Zhu , Chi Xie , Shuang Liang , Bo Zheng , Sheng Guo

With the development of artificial intelligence (AI) techniques and the increasing popularity of camera-equipped devices, many edge video analytics applications are emerging, calling for the deployment of computation-intensive AI models at…

Signal Processing · Electrical Eng. & Systems 2024-04-02 Jiawei Shao , Xinjie Zhang , Jun Zhang

As the volume of image data grows, data-oriented cloud computing in Internet of Video Things (IoVT) systems encounters latency issues. Task-oriented edge computing addresses this by shifting data analysis to the edge. However, limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jiaqi Wu , Simin Chen , Zehua Wang , Wei Chen , Zijian Tian , F. Richard Yu , Victor C. M. Leung

In recent years, large-scale vision-language models (VLMs) have demonstrated remarkable performance on multimodal understanding and reasoning tasks. However, handling high-dimensional visual features often incurs substantial computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Xiaoyang Guo , Keze Wang

This paper proposes a neural rendering approach that represents a scene as "compressed light-field tokens (CLiFTs)", retaining rich appearance and geometric information of a scene. CLiFT enables compute-efficient rendering by compressed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhengqing Wang , Yuefan Wu , Jiacheng Chen , Fuyang Zhang , Yasutaka Furukawa

The deployment of artificial intelligence in medical imaging is hindered by high computational complexity and resource-intensive processing of volumetric data. Although chest computed tomography (CT) volumes offer richer diagnostic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Shadid Yousuf , S. M. Mahbubur Rahman , Mohammed Imamul Hassan Bhuiyan

Token compression techniques have recently emerged as powerful tools for accelerating Vision Transformer (ViT) inference in computer vision. Due to the quadratic computational complexity with respect to the token sequence length, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Phat Nguyen , Ngai-Man Cheung

The recent advances of hardware technology have made the intelligent analysis equipped at the front-end with deep learning more prevailing and practical. To better enable the intelligent sensing at the front-end, instead of compressing and…

Multimedia · Computer Science 2018-09-18 Zhuo Chen , Weisi Lin , Shiqi Wang , Lingyu Duan , Alex C. Kot

This paper proposes a novel communication-efficient split learning (SL) framework, named SplitFC, which reduces the communication overhead required for transmitting intermediate feature and gradient vectors during the SL training process.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Yongjeong Oh , Jaeho Lee , Christopher G. Brinton , Yo-Seb Jeon

Split computing ($\neq$ split learning) is a promising approach to deep learning models for resource-constrained edge computing systems, where weak sensor (mobile) devices are wirelessly connected to stronger edge servers through channels…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yoshitomo Matsubara , Matteo Mendula , Marco Levorato

Video analytics are often performed as cloud services in edge settings, mainly to offload computation, and also in situations where the results are not directly consumed at the video sensors. Sending high-quality video data from the edge…

Image and Video Processing · Electrical Eng. & Systems 2023-07-27 Quazi Mishkatul Alam , Israat Haque , Nael Abu-Ghazaleh

Nowadays, more and more video transmissions primarily aim at downstream machine vision tasks rather than humans. While widely deployed Human Visual System (HVS) oriented video coding standards like H.265/HEVC and H.264/AVC are efficient,…

Image and Video Processing · Electrical Eng. & Systems 2025-10-20 Yuxiao Sun , Yao Zhao , Meiqin Liu , Chao Yao , Huihui Bai , Chunyu Lin , Weisi Lin

Task-oriented communication presents a promising approach to improve the communication efficiency of edge inference systems by optimizing learning-based modules to extract and transmit relevant task information. However, real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Songjie Xie , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

The performance of multi-modal 3D occupancy prediction is limited by ineffective fusion, mainly due to geometry-semantics mismatch from fixed fusion strategies and surface detail loss caused by sparse, noisy annotations. The mismatch stems…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Luyao Lei , Shuo Xu , Yifan Bai , Xing Wei