English
Related papers

Related papers: Understanding The Effectiveness of Lossy Compressi…

200 papers

Despite the increasing prevalence of large language models (LLMs), we still have a limited understanding of how their representational spaces are structured. This limits our ability to interpret how and what they learn or relate them to…

The advancement of large language models (LLMs) and multi-modal LLMs (MLLMs) has historically relied on scaling model parameters. However, as hardware limits constrain further model growth, the primary computational bottleneck has shifted…

The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical.…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Markus Stroot , Stefan Seiler , Philipp Lutat , Andreas Ulbig

Data-driven artificial intelligence (AI) techniques are becoming prominent for learning in support of data compression, but are focused on standard problems such as text compression. To instead address the emerging problem of semantic…

Information Theory · Computer Science 2024-04-05 Haizi Yu , Lav R. Varshney

Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Daoce Wang , Pascal Grosset , Jesus Pulido , Tushar M. Athawale , Jiannan Tian , Kai Zhao , Zarija Lukić , Axel Huebl , Zhe Wang , James Ahrens , Dingwen Tao

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-26 Noah Lewis , Jean Luca Bez , Surendra Byna

As large language models (LLMs) continue to be deployed and utilized across domains, the volume of LLM-generated data is growing rapidly. This trend highlights the increasing importance of effective and lossless compression for such data in…

Machine Learning · Computer Science 2025-05-13 Yu Mao , Holger Pirk , Chun Jason Xue

This survey articles focuses on emerging connections between the fields of machine learning and data compression. While fundamental limits of classical (lossy) data compression are established using rate-distortion theory, the connections…

Information Theory · Computer Science 2024-06-17 Jun Chen , Yong Fang , Ashish Khisti , Ayfer Ozgur , Nir Shlezinger , Chao Tian

Error-bounded lossy compression is one of the most effective techniques for scientific data reduction. However, the traditional trial-and-error approach used to configure lossy compressors for finding the optimal trade-off between…

Databases · Computer Science 2022-05-09 Sian Jin , Sheng Di , Jiannan Tian , Suren Byna , Dingwen Tao , Franck Cappello

Lossy Image compression is necessary for efficient storage and transfer of data. Typically the trade-off between bit-rate and quality determines the optimal compression level. This makes the image quality metric an integral part of any…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Juan Carlos Mier , Eddie Huang , Hossein Talebi , Feng Yang , Peyman Milanfar

Deep neural networks have delivered remarkable performance and have been widely used in various visual tasks. However, their huge size causes significant inconvenience for transmission and storage. Many previous studies have explored model…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yumeng Shi , Shihao Bai , Xiuying Wei , Ruihao Gong , Jianlei Yang

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Multilinear Compressive Learning (MCL) is an efficient signal acquisition and learning paradigm for multidimensional signals. The level of signal compression affects the detection or classification performance of a MCL model, with higher…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Large Language Models (LLMs) need to adapt to the continuous changes in data, tasks, and user preferences. Due to their massive size and the high costs associated with training, LLMs are not suitable for frequent retraining. However,…

Computation and Language · Computer Science 2024-12-11 Dongfang Li , Zetian Sun , Xinshuo Hu , Baotian Hu , Min Zhang

Image compression is a critical tool in decreasing the cost of storage and improving the speed of transmission over the internet. While deep learning applications for natural images widely adopts the usage of lossy compression techniques,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Anvar Kurmukov , Bogdan Zavolovich , Aleksandra Dalechina , Vladislav Proskurov , Boris Shirokikh

The development of deep learning algorithms has extensively empowered humanity's task automatization capacity. However, the huge improvement in the performance of these models is highly correlated with their increasing level of complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Eduarda Caldeira , Pedro C. Neto , Marco Huber , Naser Damer , Ana F. Sequeira

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

In the field of neural data compression, the prevailing focus has been on optimizing algorithms for either classical distortion metrics, such as PSNR or SSIM, or human perceptual quality. With increasing amounts of data consumed by machines…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Dan Jacobellis , Daniel Cummings , Neeraja J. Yadwadkar

The performance and efficiency of distributed machine learning (ML) depends significantly on how long it takes for nodes to exchange state changes. Overly-aggressive attempts to reduce communication often sacrifice final model accuracy and…

Machine Learning · Computer Science 2018-02-22 Hyeontaek Lim , David G. Andersen , Michael Kaminsky

Large Language Models (LLMs) have revolutionized many areas of artificial intelligence (AI), but their substantial resource requirements limit their deployment on mobile and edge devices. This survey paper provides a comprehensive overview…

Machine Learning · Computer Science 2025-09-03 Sanjay Surendranath Girija , Shashank Kapoor , Lakshit Arora , Dipen Pradhan , Aman Raj , Ankit Shetgaonkar
‹ Prev 1 2 3 10 Next ›