English
Related papers

Related papers: On Syndrome Decoding for Slepian-Wolf Coding Based…

200 papers

Quantum error correction is an essential technique for constructing a scalable quantum computer. In order to implement quantum error correction with near-term quantum devices, a fast and near-optimal decoding method is demanded. A decoder…

Quantum Physics · Physics 2020-09-16 Amarsanaa Davaasuren , Yasunari Suzuki , Keisuke Fujii , Masato Koashi

Decoding algorithms based on approximate tensor network contraction have proven tremendously successful in decoding 2D local quantum codes such as surface/toric codes and color codes, effectively achieving optimal decoding accuracy. In this…

Quantum Physics · Physics 2024-10-10 Christophe Piveteau , Christopher T. Chubb , Joseph M. Renes

Language models have recently been shown capable of performing regression wherein numeric predictions are represented as decoded strings. In this work, we provide theoretical grounds for this capability and furthermore investigate the…

Machine Learning · Computer Science 2025-08-13 Xingyou Song , Dara Bahri

Distributed matrix computations -- matrix-matrix or matrix-vector multiplications -- are well-recognized to suffer from the problem of stragglers (slow or failed worker nodes). Much of prior work in this area is (i) either sub-optimal in…

Information Theory · Computer Science 2020-06-03 Anindya B. Das , Aditya Ramamoorthy , Namrata Vaswani

Interactive encoding and decoding based on binary low-density parity-check codes with syndrome accumulation (SA-LDPC-IED) is proposed and investigated. Assume that the source alphabet is $\mathbf{GF}(2)$, and the side information alphabet…

Information Theory · Computer Science 2015-03-20 Jin Meng , En-Hui Yang

Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xili Dai , Ke Chen , Shengbang Tong , Jingyuan Zhang , Xingjian Gao , Mingyang Li , Druv Pai , Yuexiang Zhai , XIaojun Yuan , Heung-Yeung Shum , Lionel M. Ni , Yi Ma

We give an algorithm for finding network encoding and decoding equations for error-free multicasting networks with multiple sources and sinks. The algorithm given is efficient (polynomial complexity) and works on any kind of network…

Information Theory · Computer Science 2007-07-13 Angela I. Barbero Diez , Oyvind Ytrehus

Random binning is an efficient, yet complex, coding technique for the symmetric L-description source coding problem. We propose an alternative approach, that uses the quantized samples of a bandlimited source as "descriptions". By the…

Information Theory · Computer Science 2013-11-20 Adam Mashiach , Jan Ostergaard , Ram Zamir

Sparse and convolutional constraints form a natural prior for many optimization problems that arise from physical processes. Detecting motifs in speech and musical passages, super-resolving images, compressing videos, and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2014-06-11 Hilton Bristow , Simon Lucey

We provide a novel upper-bound on Witsenhausen's rate, the rate required in the zero-error analogue of the Slepian-Wolf problem; our bound is given in terms of a new information-theoretic functional defined on a certain graph. We then use…

Information Theory · Computer Science 2010-01-25 Benjamin G. Kelly , Aaron B. Wagner

The problem of computing a linear combination of sources over a multiple access channel is studied. Inner and outer bounds on the optimal tradeoff between the communication rates are established when encoding is restricted to random…

Information Theory · Computer Science 2018-10-30 Pinar Sen , Sung Hoon Lim , Young-Han Kim

Many constraint satisfaction and optimisation problems can be solved effectively by encoding them as instances of the Boolean Satisfiability problem (SAT). However, even the simplest types of constraints have many encodings in the…

Artificial Intelligence · Computer Science 2023-11-09 Felix Ulrich-Oltean , Peter Nightingale , James Alfred Walker

We consider ensembles of channel codes that are partitioned into bins, and focus on analysis of exact random coding error exponents associated with optimum decoding of the index of the bin to which the transmitted codeword belongs. Two main…

Information Theory · Computer Science 2016-11-18 Neri Merhav

We present a construction of subspace codes along with an efficient algorithm for list decoding from both insertions and deletions, handling an information-theoretically maximum fraction of these with polynomially small rate. Our…

Information Theory · Computer Science 2012-02-03 Venkatesan Guruswami , Srivatsan Narayanan , Carol Wang

Existing large language model-based code generation pipelines typically use beam search or sampling algorithms during the decoding process. Although the programs they generate achieve high token-matching-based scores, they often fail to…

Machine Learning · Computer Science 2023-03-10 Shun Zhang , Zhenfang Chen , Yikang Shen , Mingyu Ding , Joshua B. Tenenbaum , Chuang Gan

This paper presents a stochastic algorithm for iterative error control decoding. We show that the stochastic decoding algorithm is an approximation of the sum-product algorithm. When the code's factor graph is a tree, as with trellises, the…

Information Theory · Computer Science 2007-07-13 Chris Winstead , Anthony Rapley , Vincent C. Gaudet , Christian Schlegel

I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin…

Condensed Matter · Physics 2016-08-31 Nicolas Sourlas

This work studies the problem of distributed compression of correlated sources with an action-dependent joint distribution. This class of problems is, in fact, an extension of the Slepian-Wolf model, but where cost-constrained actions taken…

Information Theory · Computer Science 2014-04-16 Oron Sabag , Haim H. Permuter , Asaf Cohen

In this paper, we use linear codes to study zero-error Slepian-Wolf coding of a set of sources with deviation symmetry, where the sources are generalization of the Hamming sources over an arbitrary field. We extend our previous codes,…

Information Theory · Computer Science 2013-08-06 Rick Ma , Samuel Cheng

We consider a source coding problem with a network scenario in mind, and formulate it as a remote vector Gaussian Wyner-Ziv problem under covariance matrix distortions. We define a notion of minimum for two positive-definite matrices based…

Information Theory · Computer Science 2016-11-03 Adel Zahedi , Jan Østergaard , Søren Holdt Jensen , Patrick A. Naylor , Søren Bech