English
Related papers

Related papers: Lightweight Correlation-Aware Table Compression

200 papers

We propose a novel cost aggregation network, called Cost Aggregation Transformers (CATs), to find dense correspondences between semantically similar images with additional challenges posed by large intra-class appearance and geometric…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Seokju Cho , Sunghwan Hong , Sangryul Jeon , Yunsung Lee , Kwanghoon Sohn , Seungryong Kim

Visual text compression (VTC) promises efficient long-context processing by rendering text into an image and re-encoding it with a vision-language model, often producing $3$--$20\times$ fewer decoder tokens than subword tokenization. Yet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Lv Tang , Tianyi Zheng , Yang Liu , Bo Li , Xingyu Li

Scientific applications in fields such as high energy physics, computational fluid dynamics, and climate science generate vast amounts of data at high velocities. This exponential growth in data production is surpassing the advancements in…

Machine Learning · Computer Science 2024-09-10 Xiao Li , Jaemoon Lee , Anand Rangarajan , Sanjay Ranka

Among many current data processing systems, the objectives are often not the reproduction of data, but to compute some answers based on the data resulting from queries. The similarity identification task is to identify the items in a…

Signal Processing · Electrical Eng. & Systems 2020-01-23 Hanwei Wu , Qiwen Wang , Markus Flierl

In-memory columnar databases have become mainstream over the last decade and have vastly improved the fast processing of large volumes of data through multi-core parallelism and in-memory compression thereby eliminating the usual…

Databases · Computer Science 2016-09-27 Jayanth Jayanth

Specific data compression techniques, formalized by the concept of coresets, proved to be powerful for many optimization problems. In fact, while tightly controlling the approximation error, coresets may lead to significant speed up of the…

Optimization and Control · Mathematics 2022-04-05 Maximilian Fiedler , Peter Gritzmann , Fabian Klemm

Transformer-based large language models (LLMs) have demonstrated remarkable potential across a wide range of practical applications. However, long-context inference remains a significant challenge due to the substantial memory requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-09 Bo Jiang , Taolue Yang , Youyuan Liu , Xubin He , Sheng Di , Sian Jin

With the increasing number and enhanced capabilities of IoT devices in smart buildings, these devices are evolving beyond basic data collection and control to actively participate in deep learning tasks. Federated Learning (FL), as a…

Machine Learning · Computer Science 2025-04-15 Heqiang Wang , Xiang Liu , Yucheng Liu , Jia Zhou , Weihong Yang , Xiaoxiong Zhong

Large Language Models (LLMs) face computational inefficiencies and redundant processing when handling long context inputs, prompting a focus on compression techniques. While existing semantic vector-based compression methods achieve…

Computation and Language · Computer Science 2025-02-18 Shaoshen Chen , Yangning Li , Zishan Xu , Yinghui Li , Xin Su , Zifei Shan , Hai-tao Zheng

Medical image segmentation is one of the domains where sufficient annotated data is not available. This necessitates the application of low-data frameworks like few-shot learning. Contemporary prototype-based frameworks often do not account…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Siladittya Manna , Saumik Bhattacharya , Umapada Pal

Recent Vision-Language Models (VLMs) have demonstrated remarkable multimodal understanding capabilities, yet the redundant visual tokens incur prohibitive computational overhead and degrade inference efficiency. Prior studies typically…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Qiankun Ma , Ziyao Zhang , Haofei Wang , Jie Chen , Zhen Song , Hairong Zheng

Communication overhead is a critical challenge in federated learning, particularly in bandwidth-constrained networks. Although many methods have been proposed to reduce communication overhead, most focus solely on compressing individual…

Machine Learning · Computer Science 2026-01-16 Shenlong Zheng , Zhen Zhang , Yuhui Deng , Geyong Min , Lin Cui

The WARC file format is widely used by web archives to preserve collected web content for future use. With the rapid growth of web archives and the increasing interest to reuse these archives as big data sources for statistical and…

Digital Libraries · Computer Science 2020-05-28 Xinyue Wang , Zhiwu Xie

Multi-modal Large Language Models (MLLMs) serving systems commonly employ KV-cache compression to reduce memory footprint. However, existing compression methods introduce significant processing overhead and queuing delays, particularly in…

Multimedia · Computer Science 2025-03-12 Jianian Zhu , Hang Wu , Haojie Wang , Yinghui Li , Biao Hou , Ruixuan Li , Jidong Zhai

Large vision-language models (LVLMs) achieve strong multimodal understanding, but their inference cost grows rapidly with the number of visual tokens, especially for high-resolution images and long videos. Existing attention-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Hongyu Lu , Feng Zhang , Wenwei Jin , Huanling Hu , Tianjun Shi , Shikai Jiang , Yao Hu , Jiawei Li

We present a machine learning-based approach to lossy image compression which outperforms all existing codecs, while running in real-time. Our algorithm typically produces files 2.5 times smaller than JPEG and JPEG 2000, 2 times smaller…

Machine Learning · Statistics 2017-05-17 Oren Rippel , Lubomir Bourdev

Most existing image tokenizers encode images into a fixed number of tokens or patches, overlooking the inherent variability in image complexity. To address this, we introduce Content-Adaptive Tokenizer (CAT), which dynamically adjusts…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Junhong Shen , Kushal Tirumala , Michihiro Yasunaga , Ishan Misra , Luke Zettlemoyer , Lili Yu , Chunting Zhou

Large-scale simulations of time-dependent problems generate a massive amount of data and with the explosive increase in computational resources the size of the data generated by these simulations has increased significantly. This has…

Computational Engineering, Finance, and Science · Computer Science 2022-01-19 Shaghayegh Zamani Ashtiani , Mujeeb R. Malik , Hessam Babaee

We present a data compression and dimensionality reduction scheme for data fusion and aggregation applications to prevent data congestion and reduce energy consumption at network connecting points such as cluster heads and gateways. Our…

Networking and Internet Architecture · Computer Science 2014-08-14 Mohammad Abu Alsheikh , Puay Kai Poh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

As memory capacity has outstripped TLB coverage, large data applications suffer from frequent page table walks. We investigate two complementary techniques for addressing this cost: reducing the number of accesses required and reducing the…

Hardware Architecture · Computer Science 2021-09-03 Chang Hyun Park , Ilias Vougioukas , Andreas Sandberg , David Black-Schaffer