English
Related papers

Related papers: A multi-dimensional extension of the Lightweight T…

200 papers

Existing work on prompt compression for Large Language Models (LLM) focuses on lossy methods that try to maximize the retention of semantic information that is relevant to downstream tasks while significantly reducing the sequence length.…

Computation and Language · Computer Science 2025-08-22 John Harvill , Ziwei Fan , Hao Wang , Luke Huan , Anoop Deoras , Yizhou Sun , Hao Ding

In this paper, a Line based Compressive Sensing (LCS) scheme is discussed and proposed for low power visual applications, in which image acquisition is performed in a line-by-line manner at the encoder side using same measurement operator.…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Mansoor Ebrahim , Syed Hasan Adil , Daniyal Nawaz , Kamran Raza

Large Language Models (LLMs) have pushed the frontier of artificial intelligence but are comprised of hundreds of billions of parameters and operations. For faster inference latency, LLMs are deployed on multiple hardware accelerators…

Machine Learning · Computer Science 2026-01-07 Jan Hansen-Palmus , Michael Truong Le , Oliver Hausdörfer , Alok Verma

Present day computational fluid dynamics simulations generate extremely large amounts of data, sometimes on the order of TB/s. Often, a significant fraction of this data is discarded because current storage systems are unable to keep pace.…

Computational Engineering, Finance, and Science · Computer Science 2021-03-03 Heather Pacella , Alec Dunton , Alireza Doostan , Gianluca Iaccarino

Temporal logic is a concise way of specifying complex tasks. But motion planning to achieve temporal logic specifications is difficult, and existing methods struggle to scale to complex specifications and high-dimensional system dynamics.…

Robotics · Computer Science 2023-06-02 Vince Kurtz , Hai Lin

Scientific simulations and observations are producing vast amounts of time-varying vector field data, making it hard to store them for archival purposes and transmit them for analysis. Lossy compression is considered a promising approach to…

Databases · Computer Science 2026-03-17 Mingze Xia , Yuxiao Li , Pu Jiao , Bei Wang , Xin Liang , Hanqi Guo

Trajectories represent the mobility of moving objects and thus is of great value in data mining applications. However, trajectory data is enormous in volume, so it is expensive to store and process the raw data directly. Trajectories are…

Databases · Computer Science 2020-10-20 Yunheng Han , Hanan Samet

Recent developments in Transformers have achieved notable strides in enhancing video comprehension. Nonetheless, the O($N^2$) computation complexity associated with attention mechanisms presents substantial computational hurdles when…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Yukun Feng , Yangming Shi , Fengze Liu , Tan Yan

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

Binary quantization represents the most extreme form of compression, reducing weights to +/-1 for maximal memory and computational efficiency. While recent sparsity-aware binarization achieves sub-1-bit compression via weight pruning, it…

Machine Learning · Computer Science 2026-04-10 Hao Gu , Lujun Li , Hao Wang , Lei Wang , Zheyu Wang , Bei Liu , Jiacheng Liu , Qiyuan Zhu , Sirui Han , Yike Guo

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-09 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , James Ahrens , Dingwen Tao

Memory and network bandwidth are decisive bottlenecks when handling high-resolution multidimensional data sets in visualization applications, and they increasingly demand suitable data compression strategies. We introduce a novel lossy…

Graphics · Computer Science 2019-03-12 Rafael Ballester-Ripoll , Peter Lindstrom , Renato Pajarola

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

Several emerging non-volatile (NV) memory technologies are rising as interesting alternatives to build the Last-Level Cache (LLC). Their advantages, compared to SRAM memory, are higher density and lower static power, but write operations…

Hardware Architecture · Computer Science 2022-06-09 Carlos Escuin , Pablo Ibañez , Teresa Monreal , Jose M. Llaberia , Victor Viñals

Location-aware devices continuously generate massive volumes of trajectory data, creating demand for efficient compression. Line simplification is a common solution but typically assumes 2D trajectories and ignores time synchronization and…

Machine Learning · Computer Science 2025-08-07 Kefei Wu , Baihua Zheng , Weiwei Sun

Our increasingly digital and connected world has led to the generation of unprecedented amounts of data. This data must be efficiently managed, transmitted, and stored to preserve resources and allow scalability. Data compression has…

Information Theory · Computer Science 2025-10-09 Jonas G. Matt , Pengcheng Huang , Balz Maag

Non-parametric entropy estimation on sequential data is a fundamental tool in signal processing, capturing information flow within or between processes to measure predictability, redundancy, or similarity. Methods based on longest common…

Data Structures and Algorithms · Computer Science 2025-10-16 Bridget Smart , Max Ward , Matthew Roughan

Electron tomography has achieved higher resolution and quality at reduced doses with recent advances in compressed sensing. Compressed sensing (CS) theory exploits the inherent sparse signal structure to efficiently reconstruct…

Computational Physics · Physics 2020-12-02 Jonathan Schwartz , Huihuo Zheng , Marcus Hanwell , Yi Jiang , Robert Hovden

Lossy image compression is one of the most commonly used operators for digital images. Most recently proposed deep-learning-based image compression methods leverage the auto-encoder structure, and reach a series of promising results in this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Yaolong Wang , Mingqing Xiao , Chang Liu , Shuxin Zheng , Tie-Yan Liu

Modern sensors produce increasingly rich streams of high-resolution data. Due to resource constraints, machine learning systems discard the vast majority of this information via resolution reduction. Compressed-domain learning allows models…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Dan Jacobellis , Neeraja J. Yadwadkar