English
Related papers

Related papers: Smoothing Linear Codes by R\'enyi Divergence and A…

200 papers

Variational techniques have been recently developed to find tighter bounds on the von Neumann entropy in a completely device-independent (DI) setting. This, in turn, has led to significantly improved key rates of DI protocols, in both the…

Quantum Physics · Physics 2024-08-23 Thomas A. Hahn , Ernest Y. -Z. Tan , Peter Brown

Smoothed analysis is a powerful paradigm in overcoming worst-case intractability in unsupervised learning and high-dimensional data analysis. While polynomial time smoothed analysis guarantees have been obtained for worst-case intractable…

Data Structures and Algorithms · Computer Science 2019-04-25 Aditya Bhaskara , Aidao Chen , Aidan Perreault , Aravindan Vijayaraghavan

A sliding window algorithm receives a stream of symbols and has to output at each time instant a certain value which only depends on the last $n$ symbols. If the algorithm is randomized, then at each time instant it produces an incorrect…

Formal Languages and Automata Theory · Computer Science 2018-02-22 Moses Ganardi , Danny Hucke , Markus Lohrey

This work explores properties of Strong Data-Processing constants for R\'enyi Divergences. Parallels are made with the well-studied $\varphi$-Divergences, and it is shown that the order $\alpha$ of R\'enyi Divergences dictates whether…

Information Theory · Computer Science 2026-01-15 Adrien Vandenbroucque , Amedeo Roberto Esposito , Michael Gastpar

Tensors are a fundamental operation in distributed computing, \emph{e.g.,} machine learning, that are commonly distributed into multiple parallel tasks for large datasets. Stragglers and other failures can severely impact the overall…

Information Theory · Computer Science 2024-10-30 Pedro Soto

Locally decodable channel codes form a special class of error-correcting codes with the property that the decoder is able to reconstruct any bit of the input message from querying only a few bits of a noisy codeword. It is well known that…

Information Theory · Computer Science 2013-08-28 Ali Makhdoumi , Shao-Lun Huang , Muriel Medard , Yury Polyanskiy

Quantum low-density parity-check (qLDPC) codes are an important component in the quest for quantum fault tolerance. Dramatic recent progress on qLDPC codes has led to constructions which are asymptotically good, and which admit linear-time…

Quantum Physics · Physics 2024-11-08 Louis Golowich , Venkatesan Guruswami

A general method of coding over expansions is proposed, which allows one to reduce the highly non-trivial problem of coding over continuous channels to a much simpler discrete ones. More specifically, the focus is on the additive…

Information Theory · Computer Science 2012-02-09 O. Ozan Koyluoglu , Kumar Appaiah , Hongbo Si , Sriram Vishwanath

Quantum error correction (QEC) is indispensable for realizing fault-tolerant quantum computation, yet its effectiveness hinges critically on the classical decoding algorithm that interprets noisy syndrome measurements. Among all possible…

Quantum Physics · Physics 2026-05-19 Hanyan Cao , Ge Yan , Yuxuan Du , Feng Pan

We introduce the Random Subsequence Model, a spin glass model on pairs of random strings $(X,Y) \in \{0,1\}^N \times \{0,1\}^M$ whose partition function counts subsequence embeddings of $Y$ into $X$. We study two variants: the null model,…

Information Theory · Computer Science 2026-04-09 Ryan Jeong , Francisco Pernice

Label smoothing is a regularization technique for neural networks. Normally neural models are trained to an output distribution that is a vector with a single 1 for the correct prediction, and 0 for all other elements. Label smoothing…

Software Engineering · Computer Science 2023-03-29 Sakib Haque , Aakash Bansal , Collin McMillan

Consider communication over a binary-input memoryless output-symmetric channel with low density parity check (LDPC) codes and maximum a posteriori (MAP) decoding. The replica method of spin glass theory allows to conjecture an analytic…

Information Theory · Computer Science 2016-11-17 Shrinivas Kudekar , Nicolas Macris

We construct and analyze a family of low-density parity check (LDPC) quantum codes with a linear encoding rate, polynomial scaling distance and efficient decoding schemes. The code family is based on tessellations of closed,…

Quantum Physics · Physics 2023-07-06 Nikolas P. Breuckmann , Vivien Londe

Efficient and high-performance quantum error correction is essential for achieving fault-tolerant quantum computing. Low-depth random circuits offer a promising approach to identifying effective and practical encoding strategies. In this…

Quantum Physics · Physics 2026-03-02 Guoding Liu , Zhenyu Du , Zi-Wen Liu , Xiongfeng Ma

We show that a simple telescoping sum trick, together with the triangle inequality and a tensorisation property of expected-contractive coefficients of random channels, allow us to achieve general simultaneous decoupling for multiple users…

Quantum Physics · Physics 2024-11-15 Pau Colomer , Andreas Winter

A linear programming (LP) based framework is presented for obtaining converses for finite blocklength lossy joint source-channel coding problems. The framework applies for any loss criterion, generalizes certain previously known converses,…

Information Theory · Computer Science 2017-05-04 Sharu Theresa Jose , Ankur A. Kulkarni

We present a new family of quantum low-density parity-check codes, which we call radial codes, obtained from the lifted product of a specific subset of classical quasi-cyclic codes. The codes are defined using a pair of integers $(r,s)$ and…

Quantum Physics · Physics 2026-04-21 Thomas R. Scruby , Timo Hillmann , Joschka Roffe

Gaussian smoothing combined with a probabilistic framework for denoising via the empirical Bayes formalism, i.e., the Tweedie-Miyasawa formula (TMF), are the two key ingredients in the success of score-based generative models in Euclidean…

Machine Learning · Statistics 2025-02-04 Francis Bach , Saeed Saremi

Random (dv,dc)-regular LDPC codes are well-known to achieve the Shannon capacity of the binary symmetric channel (for sufficiently large dv and dc) under exponential time decoding. However, polynomial time algorithms are only known to…

Computational Complexity · Computer Science 2014-10-17 Badih Ghazi , Euiwoong Lee

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach