English
Related papers

Related papers: A new technique for compression of data sets

200 papers

Compressed file formats are the corner stone of efficient data storage and transmission, yet their potential for representation learning remains largely underexplored. We introduce TEMPEST (TransformErs froM comPressed rEpreSenTations), a…

New directions in computing and algorithms has lead to some new applications that have tolerance to imprecision. Although, These applications are creating large volumes of data which exceeds the capability of today's computing systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-16 Navid Mirnouri

In this work, we present a comparison between different techniques of image compression. First, the image is divided in blocks which are organized according to a certain scan. Later, several compression techniques are applied, combined or…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Mario Mastriani

How can we compress language models without sacrificing accuracy? The number of compression algorithms for language models is rapidly growing to benefit from remarkable advances of recent language models without side effects due to the…

Computation and Language · Computer Science 2024-01-30 Seungcheol Park , Jaehyeon Choi , Sojin Lee , U Kang

With time, machine learning models have increased in their scope, functionality and size. Consequently, the increased functionality and size of such models requires high-end hardware to both train and provide inference after the fact. This…

Machine Learning · Computer Science 2021-09-07 Arhum Ishtiaq , Sara Mahmood , Maheen Anees , Neha Mumtaz

Communication efficiency is a widely recognised research problem in Federated Learning (FL), with recent work focused on developing techniques for efficient compression, distribution and aggregation of model parameters between clients and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Chamath Palihawadana , Nirmalie Wiratunga , Anjana Wijekoon , Harsha Kalutarage

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu

A general method for compressing the modulation time-bandwidth product of analog signals is introduced and experimentally demonstrated. As one of its applications, this physics-based signal grooming performs feature-selective stretch,…

Optics · Physics 2015-06-16 Mohammad H. Asghari , Bahram Jalali

We introduce a protocol called ENCORE which simultaneously compresses and encrypts data in a one-pass process that can be implemented efficiently and possesses a number of desirable features as a streaming encoder/decoder. Motivated by the…

Cryptography and Security · Computer Science 2025-01-28 Joshua Cooper , Grant Fickes

This paper proposes a novel entropy encoding technique for lossless data compression. Representing a message string by its lexicographic index in the permutations of its symbols results in a compressed version matching Shannon entropy of…

Information Theory · Computer Science 2017-03-24 Abu Bakar Siddique

Modern scientific simulations, observations, and large-scale experiments generate data at volumes that often exceed the limits of storage, processing, and analysis. This challenge drives the development of data reduction methods that…

Machine Learning · Computer Science 2025-11-18 Minh Vu , Andrey Lokhov

Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

Modern smart distribution system requires storage, transmission and processing of big data generated by sensors installed in electric meters. On one hand, this data is essentially required for intelligent decision making by smart grid but…

Signal Processing · Electrical Eng. & Systems 2018-07-19 Syed Muhammad Atif , Anees Ahmed , Sameer Qazi

We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce…

Cryptography and Security · Computer Science 2024-02-02 Richeng Jin , Zhonggen Su , Caijun Zhong , Zhaoyang Zhang , Tony Quek , Huaiyu Dai

Transform image processing methods are methods that work in domains of image transforms, such as Discrete Fourier, Discrete Cosine, Wavelet and alike. They are the basic tool in image compression, in image restoration, in image re-sampling…

Computer Vision and Pattern Recognition · Computer Science 2014-08-28 Leonid Yaroslavsky

Variational inequalities are an important tool, which includes minimization, saddles, games, fixed-point problems. Modern large-scale and computationally expensive practical applications make distributed methods for solving these problems…

Optimization and Control · Mathematics 2023-03-01 Aleksandr Beznosikov , Alexander Gasnikov

Floating-point data is widely used across various domains. Depending on the required precision, each floating-point value can occupy several bytes. Lossless storage of this information is crucial due to its critical accuracy, as seen in…

Databases · Computer Science 2025-08-11 Samirasadat Jamalidinan , Kazem Cheshmi

We study the problem of multi-compression and reconstructing a stochastic signal observed by several independent sensors (or compressors) that transmit compressed information to a fusion center. { The key aspect of this problem is to find…

Information Theory · Computer Science 2021-11-08 Pablo Soto-Quiros , Anatoli Torokhti , Stanley J. Miklavcic

Data compression has become a necessity not only the in the field of communication but also in various scientific experiments. The data that is being received is more and the processing time required has also become more. A significant…

Information Theory · Computer Science 2016-07-29 Gautam R , S Murali

Transformer-based self-supervised models have achieved remarkable success in speech processing, but their large size and high inference cost present significant challenges for real-world deployment. While numerous compression techniques…

Computation and Language · Computer Science 2025-08-19 Tzu-Quan Lin , Tsung-Huan Yang , Chun-Yao Chang , Kuang-Ming Chen , Tzu-hsun Feng , Hung-yi Lee , Hao Tang