English
Related papers

Related papers: Faster Relative Entropy Coding with Greedy Rejecti…

200 papers

We describe the Greedy Sparse Subspace Clustering (GSSC) algorithm providing an efficient method for clustering data belonging to a few low-dimensional linear or affine subspaces from incomplete corrupted and noisy data. We provide…

Numerical Analysis · Mathematics 2013-04-17 Alexander Petukhov , Inna Kozlov

Spatially coupled low-density parity-check (SC-LDPC) codes are sparse graph codes that have recently become of interest due to their capacity-approaching performance on memoryless binary input channels. In this paper, we unify all existing…

Information Theory · Computer Science 2017-10-11 Allison Beemer , Salman Habib , Christine A. Kelley , Joerg Kliewer

We develop a method for evaluating restricted isometry constants (RICs). This evaluation is reduced to the identification of the zero-points of entropy, which is defined for submatrices that are composed of columns selected from a given…

Information Theory · Computer Science 2015-06-24 Ayaka Sakata , Yoshiyuki Kabashima

We develop novel protocols for generating loss-tolerant quantum codes; these are central for safeguarding information against qubit losses, with most crucial applications in quantum communications. Contrary to current proposals, our method…

Quantum Physics · Physics 2025-03-31 Francesco Cesa , Tommaso Feri , Angelo Bassi

Sparse regression codes with approximate message passing (AMP) decoding have gained much attention in recent times. The concepts underlying this coding scheme extend to unsourced random access with coded compressed sensing (CCS), as first…

Information Theory · Computer Science 2020-10-12 Vamsi K. Amalladinne , Asit Kumar Pradhan , Cynthia Rush , Jean-Francois Chamberland , Krishna R. Narayanan

In the Shortest Common Superstring (SCS) problem, one is given a collection of strings, and needs to find a shortest string containing each of them as a substring. SCS admits $2\frac{11}{23}$-approximation in polynomial time (Mucha,…

Data Structures and Algorithms · Computer Science 2020-06-05 Alexander Golovnev , Alexander S. Kulikov , Alexander Logunov , Ivan Mihajlin , Maksim Nikolaev

Coding schemes for discrete memoryless multicast networks (DM-MN) with rate-limited feedback from the receivers and relays to the transmitter are proposed. The schemes improve over the noisy network coding proposed by Lim et al.. For the…

Information Theory · Computer Science 2016-11-17 Youlong Wu

In this article, we discuss a novel greedy algorithm for the recovery of compressive sampled signals under noisy conditions. Most of the greedy recovery algorithms proposed in the literature require sparsity of the signal to be known or…

Information Theory · Computer Science 2014-12-18 V. Meena , G. Abhilash

With the help of powerful generative models, Semantic Image Compression (SIC) has achieved impressive performance at ultra-low bitrate. However, due to coarse-grained visual-semantic alignment and inherent randomness, the reliability of SIC…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Chenhao Wu , Qingbo Wu , Haoran Wei , Shuai Chen , Mingzhou He , King Ngi Ngan , Fanman Meng , Hongliang Li

Random number generators (RNG) based on quantum mechanics are captivating due to their security and unpredictability compared to conventional generators, such as pseudo-random number generators and hardware-random number generators. This…

Reconciliation is an essential procedure for continuous-variable quantum key distribution (CV-QKD). As the most commonly used reconciliation protocol in short-distance CV-QKD, the slice error correction (SEC) allows a system to distill more…

Quantum Physics · Physics 2021-06-17 Xuan Wen , Qiong Li , Haokun Mao , Xiaojun Wen , Nan Chen

We analyze the trade-off between the undetected error probability (i.e., the probability that the channel decoder outputs an erroneous message without detecting the error) and the total error probability in the short blocklength regime. We…

Information Theory · Computer Science 2025-03-05 Alexander Sauter , A. Oguz Kislal , Giuseppe Durisi , Gianluigi Liva , Balazs Matuz , Erik G. Ström

Adversarial contrastive learning (ACL) does not require expensive data annotations but outputs a robust representation that withstands adversarial attacks and also generalizes to a wide range of downstream tasks. However, ACL needs…

Machine Learning · Computer Science 2023-10-27 Xilie Xu , Jingfeng Zhang , Feng Liu , Masashi Sugiyama , Mohan Kankanhalli

Coordinate-type subgradient methods for addressing nonsmooth optimization problems are relatively underexplored due to the set-valued nature of the subdifferential. In this work, our study focuses on nonsmooth composite optimization…

Optimization and Control · Mathematics 2023-08-24 Lei Zhao , Ding Chen , Daoli Zhu , Xiao Li

Automatic repeat request (ARQ) is widely used in modern communication systems to improve transmission reliability. In conventional ARQ protocols developed for systems with energy-unconstrained receivers, an…

Information Theory · Computer Science 2016-11-17 Yuyi Mao , Jun Zhang , Khaled B. Letaief

The High Efficiency Video Coding (HEVC/H.265) standard doubles the compression efficiency of the widely used H.264/AVC standard. For practical applications, rate control (RC) algorithms for HEVC need to be developed. Based on the R-Q,…

Multimedia · Computer Science 2019-11-05 Minhao Tang , Jiangtao Wen , Yuxing Han

Random Linear Network Coding (RLNC) provides a theoretically efficient method for coding. Some of its practical drawbacks are the complexity of decoding and the overhead due to the coding vectors. For computationally weak and battery-driven…

Networking and Internet Architecture · Computer Science 2015-09-16 Janus Heide , Morten V. Pedersen , Frank H. P. Fitzek , Muriel M edard

We introduce a simple and efficient lossless image compression algorithm. We store a low resolution version of an image as raw pixels, followed by several iterations of lossless super-resolution. For lossless super-resolution, we predict…

Image and Video Processing · Electrical Eng. & Systems 2020-04-07 Sheng Cao , Chao-Yuan Wu , Philipp Krähenbühl

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

In this paper we consider the lossy compression of a binary symmetric source. We present a scheme that provides a low complexity lossy compressor with near optimal empirical performance. The proposed scheme is based on b-reduced…

Information Theory · Computer Science 2016-11-18 Alfredo Braunstein , Farbod Kayhan , Riccardo Zecchina