English
Related papers

Related papers: Improved Generalized Automorphism Belief Propagati…

200 papers

Autoencoder (AE) is the key to the success of latent diffusion models for image and video generation, reducing the denoising resolution and improving efficiency. However, the power of AE has long been underexplored in terms of network…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yushu Wu , Yanyu Li , Ivan Skorokhodov , Anil Kag , Willi Menapace , Sharath Girish , Aliaksandr Siarohin , Yanzhi Wang , Sergey Tulyakov

The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. As near capacity-approaching codes, Low-Density Parity-Check (LDPC) codes possess several advantages over…

Information Theory · Computer Science 2024-10-11 Yoni Choukroun , Lior Wolf

Quantum error correction is crucial for universal fault-tolerant quantum computing. Highly accurate and low-time-complexity decoding algorithms play an indispensable role in ensuring quantum error correction works effectively. Among…

Quantum Physics · Physics 2025-07-01 Jiahan Chen , Zhengzhong Yi , Zhipeng Liang , Xuan Wang

Low probability of detection (LPD) has recently emerged as a means to enhance the privacy and security of wireless networks. Unlike existing wireless security techniques, LPD measures aim to conceal the entire existence of wireless…

Machine Learning · Computer Science 2023-06-05 Sivaram Krishnan , Jihong Park , Subhash Sagar , Gregory Sherman , Benjamin Campbell , Jinho Choi

Wireless federated learning (FL) relies on efficient uplink communications to aggregate model updates across distributed edge devices. Over-the-air computation (a.k.a. AirComp) has emerged as a promising approach for addressing the…

Information Theory · Computer Science 2024-04-16 Yujia Mu , Xizixiang Wei , Cong Shen

We study the decoding problem for quantum Tanner codes and propose to exploit the underlying local code structure by grouping check nodes into more powerful generalized check nodes for enhanced iterative belief propagation (BP) decoding by…

Quantum Physics · Physics 2026-03-06 Olai Å. Mostad , Eirik Rosnes , Hsuan-Yin Lin

Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder blocks to provide sustainable supervision signals and…

Information Retrieval · Computer Science 2024-04-23 Guangyuan Ma , Xing Wu , Zijia Lin , Songlin Hu

Generalized product codes (GPCs) are extensions of product codes (PCs) where coded bits are protected by two component codes but not necessarily arranged in a rectangular array. It has recently been shown that there exists a large class of…

Information Theory · Computer Science 2016-06-22 Christian Häger , Alexandre Graell i Amat , Henry D. Pfister , Fredrik Brännström

High-throughput optical communication systems utilize binary soft-decision forward error correction (SD-FEC) with bit interleaving over the bit channels. The generalized mutual information (GMI) is an achievable information rate (AIR) in…

Information Theory · Computer Science 2024-01-30 Tsuyoshi Yoshida , Magnus Karlsson , Erik Agrell

This paper proposes to use graph neural networks (GNNs) for equalization, that can also be used to perform joint equalization and decoding (JED). For equalization, the GNN is build upon the factor graph representations of the channel, while…

Information Theory · Computer Science 2024-01-30 Jannis Clausius , Marvin Geiselhart , Daniel Tandler , Stephan ten Brink

In industry, machine anomalous sound detection (ASD) is in great demand. However, collecting enough abnormal samples is difficult due to the high cost, which boosts the rapid development of unsupervised ASD algorithms. Autoencoder (AE)…

Sound · Computer Science 2023-11-16 Yifan Zhou , Dongxing Xu , Haoran Wei , Yanhua Long

Algebraic codes such as BCH code are receiving renewed interest as their short block lengths and low/no error floors make them attractive for ultra-reliable low-latency communications (URLLC) in 5G wireless networks. This paper aims at…

Information Theory · Computer Science 2020-12-22 Li Deng , Zilong Liu , Yong Liang Guan , Xiaobei Liu , Chaudhry Adnan Aslam , Xiaoxi Yu , Zhiping Shi

A novel and efficient neural decoder algorithm is proposed. The proposed decoder is based on the neural Belief Propagation algorithm and the Automorphism Group. By combining neural belief propagation with permutations from the Automorphism…

Information Theory · Computer Science 2018-01-10 Eliya Nachmani , Yaron Bachar , Elad Marciano , David Burshtein , Yair Be'ery

Decoding the attended speaker in a multi-speaker environment from electroencephalography (EEG) has attracted growing interest in recent years, with neuro-steered hearing devices as a driver application. Current approaches typically rely on…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Yuanyuan Yao , Simon Geirnaert , Tinne Tuytelaars , Alexander Bertrand

Traditional mathematical models used in designing next-generation communication systems often fall short due to inherent simplifications, narrow scope, and computational limitations. In recent years, the incorporation of deep learning (DL)…

Signal Processing · Electrical Eng. & Systems 2025-07-14 Omar Alnaseri , Laith Alzubaidi , Yassine Himeur , Mohammed Alaa Ala'anzy , Jens Timmermann , Mohammed S. M. Gismalla

Node embeddings have become an ubiquitous technique for representing graph data in a low dimensional space. Graph autoencoders, as one of the widely adapted deep models, have been proposed to learn graph embeddings in an unsupervised way by…

Machine Learning · Computer Science 2019-08-13 Vaibhav , Po-Yao Huang , Robert Frederking

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

Machine Learning · Computer Science 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger

This paper considers the problem of reducing the broadcast decoding delay of wireless networks using instantly decodable network coding (IDNC) based device-to-device (D2D) communications. In a D2D configuration, devices in the network can…

Information Theory · Computer Science 2015-05-22 Ahmed Douik , Sameh Sorour , Tareq Y. Al-Naffouri , Hong-Chuan Yang , Mohamed-Slim Alouini

Quantum low-density parity-check (QLDPC) codes have emerged as a promising technique for quantum error correction. A variety of decoders have been proposed for QLDPC codes and many of them utilize belief propagation (BP) decoding in some…

Information Theory · Computer Science 2024-06-25 Hanwen Yao , Waleed Abu Laban , Christian Häger , Alexandre Graell i Amat , Henry D. Pfister

Communication efficiency arises as a necessity in federated learning due to limited communication bandwidth. To this end, the present paper develops an algorithmic framework where an ensemble of pre-trained models is learned. At each…

Machine Learning · Computer Science 2022-03-01 Pouya M Ghari , Yanning Shen