English
Related papers

Related papers: A new technique for compression of data sets

200 papers

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

We present an informal survey (meant to accompany another paper) on graph compression methods. We focus on lossless methods, briefly list available pproaches, and compare them where possible or give some indicators on their compression…

Data Structures and Algorithms · Computer Science 2015-04-03 Sebastian Maneth , Fabian Peternek

Compression of floating-point data, both lossy and lossless, is a topic of increasing interest in scientific computing. Developing and evaluating suitable compression algorithms requires representative samples of data from real-world…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-06 Fabian Knorr , Peter Thoman , Thomas Fahringer

Training and deploying deepfake detection models on edge devices offers the advantage of maintaining data privacy and confidentiality by processing it close to its source. However, this approach is constrained by the limited computational…

Machine Learning · Computer Science 2025-05-01 Andreas Karathanasis , John Violos , Ioannis Kompatsiaris , Symeon Papadopoulos

This article shows that any type of binary data can be defined as a collection from codewords of variable length. This feature helps us to define an Injective and surjective function from the suggested codewords to the required codewords.…

Information Theory · Computer Science 2021-10-05 Parviz Gharehbagheri , Sayeed Hamid Haji Sayeed Javadi , Parvaneh Asghari , Naser Gharehbagheri

Given a real closed polytope $P$, we first describe the Fourier transform of its indicator function by using iterations of Stokes' theorem. We then use the ensuing Fourier transform formulations, together with the Poisson summation formula,…

Combinatorics · Mathematics 2018-08-02 Ricardo Diaz , Quang-Nhat Le , Sinai Robins

Many interesting and fundamentally practical optimization problems, ranging from optics, to signal processing, to radar and acoustics, involve constraints on the Fourier transform of a function. It is well-known that the {\em fast Fourier…

Optimization and Control · Mathematics 2012-09-05 Robert J. Vanderbei

The FFT algorithm that implements the discrete Fourier transform is considered one of the top ten algorithms of the $20$th century. Its main strengths are the low computational cost of $\mathcal{O}(n \log n$) and its stability. It is one of…

Numerical Analysis · Mathematics 2017-06-15 Matteo Briani , Annie Cuyt , Wen-shin Lee

Compression plays a significant role in a data storage and a transmission. If we speak about a generall data compression, it has to be a lossless one. It means, we are able to recover the original data 1:1 from the compressed file.…

Graphics · Computer Science 2014-10-10 Martin Prantl

This thesis concerns sequential-access data compression, i.e., by algorithms that read the input one or more times from beginning to end. In one chapter we consider adaptive prefix coding, for which we must read the input character by…

Information Theory · Computer Science 2009-02-03 Travis Gagie

The paper focuses on Image Compression, explaining efficient approaches based on Frequent Pattern Mining(FPM). The proposed compression mechanism is based on clustering similar pixels in the image and thus using cluster identifiers in image…

Image and Video Processing · Electrical Eng. & Systems 2026-02-03 Avinash Kadimisetty , C. Oswald , B. Sivalselvan

We propose a scheme for multi-layer representation of images. The problem is first treated from an information-theoretic viewpoint where we analyze the behavior of different sources of information under a multi-layer data compression…

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Sohrab Ferdowsi , Svyatoslav Voloshynovskiy , Dimche Kostadinov

The influx of massive amounts of data from current and upcoming cosmological surveys necessitates compression schemes that can efficiently summarize the data with minimal loss of information. We introduce a method that leverages the…

Cosmology and Nongalactic Astrophysics · Physics 2023-12-18 Aizhan Akhmetzhanova , Siddharth Mishra-Sharma , Cora Dvorkin

Simultaneous Localization and Mapping (SLAM) is an essential technology for the efficiency and reliability of unmanned robotic exploration missions. While the onboard computational capability and communication bandwidth are critically…

Robotics · Computer Science 2026-01-09 Riku Suzuki , Ayumi Umemura , Shreya Santra , Kentaro Uno , Kazuya Yoshida

With transformer-based models and the pretrain-finetune paradigm becoming mainstream, the high storage and deployment costs of individual finetuned models on multiple tasks pose critical challenges. Delta compression attempts to lower the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyu Huang , Peng Ye , Xiaohui Wang , Shenghe Zheng , Biqing Qi , Lei Bai , Wanli Ouyang , Tao Chen

In private federated learning (FL), a server aggregates differentially private updates from a large number of clients in order to train a machine learning model. The main challenge in this setting is balancing privacy with both…

Machine Learning · Computer Science 2023-08-11 Chuan Guo , Kamalika Chaudhuri , Pierre Stock , Mike Rabbat

Data preprocessing is an important component of machine learning pipelines, which requires ample time and resources. An integral part of preprocessing is data transformation into the format required by a given learning algorithm. This paper…

Machine Learning · Computer Science 2020-10-30 Nada Lavrač , Blaž Škrlj , Marko Robnik-Šikonja

Automatically summarizing large text collections is a valuable tool for document research, with applications in journalism, academic research, legal work, and many other fields. In this work, we contrast two classes of systems for…

Computation and Language · Computer Science 2025-02-11 Adithya Pratapa , Teruko Mitamura

We present a theoretical analysis and empirical evaluations of a novel set of techniques for computational cost reduction of classifiers that are based on learned transform and soft-threshold. By modifying optimization procedures for…

Large-scale simulations of time-dependent problems generate a massive amount of data and with the explosive increase in computational resources the size of the data generated by these simulations has increased significantly. This has…

Computational Engineering, Finance, and Science · Computer Science 2022-01-19 Shaghayegh Zamani Ashtiani , Mujeeb R. Malik , Hessam Babaee