English
Related papers

Related papers: Efficient data compression from statistical physic…

200 papers

The traditional methods for data compression are typically based on the symbol-level statistics, with the information source modeled as a long sequence of i.i.d. random variables or a stochastic process, thus establishing the fundamental…

Computation and Language · Computer Science 2023-04-04 Mingxiao Li , Rui Jin , Liyao Xiang , Kaiming Shen , Shuguang Cui

Compression schemes have been extensively used in Federated Learning (FL) to reduce the communication cost of distributed learning. While most approaches rely on a bounded variance assumption of the noise produced by the compressor, this…

Machine Learning · Computer Science 2023-11-01 Mahmoud Hegazy , Rémi Leluc , Cheuk Ting Li , Aymeric Dieuleveut

Likelihood-based generative models are the backbones of lossless compression due to the guaranteed existence of codes with lengths close to negative log likelihood. However, there is no guaranteed existence of computationally efficient…

Machine Learning · Computer Science 2020-01-07 Jonathan Ho , Evan Lohn , Pieter Abbeel

We address the problem of nonparametric estimation of characteristics for stationary and ergodic time series. We consider finite-alphabet time series and real-valued ones and the following four problems: i) estimation of the (limiting)…

Information Theory · Computer Science 2007-11-01 Boris Ryabko

Modern compression systems use linear transformations in their encoding and decoding processes, with transforms providing compact signal representations. While multiple data-dependent transforms for image/video coding can adapt to diverse…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Alessandro Gnutti , Fabrizio Guerrini , Riccardo Leonardi , Antonio Ortega

Various grammar compression algorithms have been proposed in the last decade. A grammar compression is a restricted CFG deriving the string deterministically. An efficient grammar compression develops a smaller CFG by finding duplicated…

Data Structures and Algorithms · Computer Science 2016-09-01 Shouhei Fukunaga , Yoshimasa Takabatake , I Tomohiro , Hiroshi Sakamoto

We study a new encoding scheme for lossy source compression based on spatially coupled low-density generator-matrix codes. We develop a belief-propagation guided-decimation algorithm, and show that this algorithm allows to approach the…

Information Theory · Computer Science 2012-02-23 Vahid Aref , Nicolas Macris , Rudiger Urbanke , Marc Vuffray

Quantum error correction promises a viable path to fault-tolerant computations, enabling exponential error suppression when the device's error rates remain below the protocol's threshold. This threshold, however, strongly depends on the…

Quantum Physics · Physics 2026-05-11 Maurice D. Hanisch , Bence Hetényi , James R. Wootton

Federated learning is a promising framework to mitigate data privacy and computation concerns. However, the communication cost between the server and clients has become the major bottleneck for successful deployment. Despite notable…

Machine Learning · Computer Science 2022-05-03 Yang He , Hui-Po Wang , Maximilian Zenk , Mario Fritz

In this paper, we introduce a novel approach for systematically solving dataset condensation problem in an efficient manner by exploiting the regularity in a given dataset. Instead of condensing the dataset directly in the original input…

Machine Learning · Computer Science 2022-08-24 Hae Beom Lee , Dong Bok Lee , Sung Ju Hwang

Quantum low-density parity-check (QLDPC) codes have emerged as a promising technique for quantum error correction. A variety of decoders have been proposed for QLDPC codes and many of them utilize belief propagation (BP) decoding in some…

Information Theory · Computer Science 2024-06-25 Hanwen Yao , Waleed Abu Laban , Christian Häger , Alexandre Graell i Amat , Henry D. Pfister

Communicating information, like gradient vectors, between computing nodes in distributed and federated learning is typically an unavoidable burden, resulting in scalability issues. Indeed, communication might be slow and costly. Recent…

Machine Learning · Computer Science 2020-10-08 Alyazeed Albasyoni , Mher Safaryan , Laurent Condat , Peter Richtárik

Fault tolerance in quantum protocols requires contributions from error-correcting codes and their suitable decoders. Quantum Low-Density Parity Check (QLDPC) codes are one of the most explored quantum codes that have good coding rate and…

Quantum Physics · Physics 2026-04-24 Mainak Bhattacharyya , Ankur Raina

We propose a model for data classification using isolated quantum $d$-level systems or else qudits. The procedure consists of an encoding phase where classical data are mapped on the surface of the qudit's Bloch hyper-sphere via rotation…

Quantum Physics · Physics 2023-07-27 A. Mandilara , B. Dellen , U. Jaekel , T. Valtinos , D. Syvridis

In this paper, we consider quantum error correction over depolarizing channels with non-binary low-density parity-check codes defined over Galois field of size $2^p$ . The proposed quantum error correcting codes are based on the binary…

Information Theory · Computer Science 2016-11-15 Kenta Kasai , Manabu Hagiwara , Hideki Imai , Kohichi Sakaniwa

With the increasing demand for storing images, traditional image compression methods face challenges in balancing the compressed size and image quality. However, the hybrid quantum-classical model can recover this weakness by using the…

Quantum Physics · Physics 2025-02-18 Vu Tuan Hai , Huynh Ho Thi Mong Trinh , Pham Hoai Luan

In this paper, a new efficient and generalized consistency correction method for weakly-compressible smoothed particle hydrodynamics is proposed and successfully implemented in the simulation of violent free-surface flow exhibiting breaking…

Fluid Dynamics · Physics 2024-05-24 Yaru Ren , Pengzhi Lin , Chi Zhang , Xiangyu Hu

In this paper, we present a fast min-sum algorithm for decoding LDPC codes over GF(q). Our algorithm is different from the one presented by David Declercq and Marc Fossorier in ISIT 05 only at the way of speeding up the horizontal scan in…

Information Theory · Computer Science 2016-11-15 Xiaofei Huang , Suquan Ding , Zhixing Yang , Youshou Wu

More than a dozen papers analyzing the COBE data have now appeared. We review the different techniques and compare them to a ``brute force" likelihood analysis where we invert the full 4038 x 4038 Galaxy-cut pixel covariance matrix. This…

Astrophysics · Physics 2008-11-26 Max Tegmark , Emory Bunn

A lossy compression algorithm for binary redundant memoryless sources is presented. The proposed scheme is based on sparse graph codes. By introducing a nonlinear function, redundant memoryless sequences can be compressed. We propose a…

Information Theory · Computer Science 2011-08-19 Kazushi Mimura