English
Related papers

Related papers: Generalized Automorphisms of Channel Codes: Proper…

200 papers

Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an…

Information Theory · Computer Science 2021-07-19 Marvin Geiselhart , Ahmed Elkelesh , Moustafa Ebada , Sebastian Cammerer , Stephan ten Brink

Visualization is a crucial step in exploratory data analysis. One possible approach is to train an autoencoder with low-dimensional latent space. Large network depth and width can help unfolding the data. However, such expressive networks…

Machine Learning · Computer Science 2023-07-03 Philipp Nazari , Sebastian Damrich , Fred A. Hamprecht

We present an autoencoder that leverages learned representations to better measure similarities in data space. By combining a variational autoencoder with a generative adversarial network we can use learned feature representations in the…

Machine Learning · Computer Science 2016-02-12 Anders Boesen Lindbo Larsen , Søren Kaae Sønderby , Hugo Larochelle , Ole Winther

A low-density parity-check (LDPC) code is a linear block code described by a sparse parity-check matrix, which can be efficiently represented by a bipartite Tanner graph. The standard iterative decoding algorithm, known as belief…

Information Theory · Computer Science 2016-05-17 Sachini Jayasooriya , Sarah J. Johnson , Lawrence Ong , Regina Berretta

Autoencoders have emerged as powerful models for visualization and dimensionality reduction based on the fundamental assumption that high-dimensional data is generated from a low-dimensional manifold. A critical challenge in autoencoder…

Machine Learning · Computer Science 2025-09-30 Qipeng Zhan , Zhuoping Zhou , Zexuan Wang , Li Shen

Deep learning on graphs has become a popular research topic with many applications. However, past work has concentrated on learning graph embedding tasks, which is in contrast with advances in generative models for images and text. Is it…

Machine Learning · Computer Science 2018-02-13 Martin Simonovsky , Nikos Komodakis

Quantum Tanner codes are a recently developed family of quantum error-correcting codes characterized by favorable asymptotic performance characteristics. Despite their theoretical potential, practical decoding algorithms that effectively…

Quantum Physics · Physics 2026-05-19 Zhuo-Yan Xiao , Sha Shi , Chen-Peng Huang , Dong-Sheng Wang , Yun-Jiang Wang

Families of generalized spatially-coupled low-density parity-check (GSC-LDPC) code ensembles can be formed by terminating protograph-based generalized LDPC convolutional (GLDPCC) codes. It has previously been shown that ensembles of…

Information Theory · Computer Science 2016-11-18 David G. M. Mitchell , Michael Lentmaier , Daniel J. Costello

Generalized low-density parity-check (GLDPC) codes are a class of LDPC codes in which the standard single parity check (SPC) constraints are replaced by constraints defined by a linear block code. These stronger constraints typically result…

Information Theory · Computer Science 2021-04-19 David G. M. Mitchell , Pablo M. Olmos , Michael Lentmaier , Daniel J. Costello

Regularized autoencoders learn the latent codes, a structure with the regularization under the distribution, which enables them the capability to infer the latent codes given observations and generate new samples given the codes. However,…

Machine Learning · Computer Science 2019-02-18 Wenju Xu , Shawn Keshmiri , Guanghui Wang

In this paper we present a new algorithm, denoted as TEP, to decode low-density parity-check (LDPC) codes over the Binary Erasure Channel (BEC). The TEP decoder is derived applying the expectation propagation (EP) algorithm with a tree-…

Information Theory · Computer Science 2012-01-05 Pablo M. Olmos , Juan José Murillo-Fuentes , Fernando Pérez-Cruz

Is there really much more to say about sparse autoencoders (SAEs)? Autoencoders in general, and SAEs in particular, represent deep architectures that are capable of modeling low-dimensional latent structure in data. Such structure could…

Machine Learning · Computer Science 2025-06-09 Yin Lu , Xuening Zhu , Tong He , David Wipf

We propose several improvements for Linear Programming (LP) decoding algorithms for High Density Parity Check (HDPC) codes. First, we use the automorphism groups of a code to create parity check matrix diversity and to generate valid cuts…

Information Theory · Computer Science 2016-11-18 Alex Yufit , Asi Lifshitz , Yair Be'ery

This study investigates the problem of learning linear block codes optimized for Belief-Propagation decoders significantly improving performance compared to the state-of-the-art. Our previous research is extended with an enhanced system…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Louis-Adrien Dufrène , Quentin Lampin , Guillaume Larue

Low-density parity-check (LDPC) codes are capable of achieving excellent performance and provide a useful alternative for high performance applications. However, at medium to high signal-to-noise ratios (SNR), an observable error floor…

Information Theory · Computer Science 2016-08-17 C. T. Healy , R. C. de Lamare

This paper proposes to use graph neural networks (GNNs) for equalization, that can also be used to perform joint equalization and decoding (JED). For equalization, the GNN is build upon the factor graph representations of the channel, while…

Information Theory · Computer Science 2024-01-30 Jannis Clausius , Marvin Geiselhart , Daniel Tandler , Stephan ten Brink

The excellent performance of convolutional low-density parity-check codes is the result of the spatial coupling of individual underlying codes across a window of growing size, but much smaller than the length of the individual codes.…

Information Theory · Computer Science 2011-05-05 S. Hamed Hassani , Nicolas Macris , Ruediger Urbanke

We introduce the notion of the stopping redundancy hierarchy of a linear block code as a measure of the trade-off between performance and complexity of iterative decoding for the binary erasure channel. We derive lower and upper bounds for…

Information Theory · Computer Science 2016-11-15 Thorsten Hehn , Olgica Milenkovic , Stefan Laendner , Johannes B. Huber

CC-GLPDC codes are a class of generalized low-density parity-check (GLDPC) codes where the constraint nodes (CNs) represent convolutional codes. This allows for efficient decoding in the trellis with the forward-backward algorithm, and the…

Information Theory · Computer Science 2022-12-01 Muhammad Umar Farooq , Michael Lentmaier , Alexandre Graell i Amat

A big mystery in deep learning continues to be the ability of methods to generalize when the number of model parameters is larger than the number of training examples. In this work, we take a step towards a better understanding of the…

Machine Learning · Computer Science 2021-11-25 Romain Cosentino , Randall Balestriero , Richard Baraniuk , Behnaam Aazhang