English
Related papers

Related papers: Soft-Information Post-Processing for Chase-Pyndiah…

200 papers

Compute-and-forward relaying is effective to increase bandwidth efficiency of wireless two-way relay channels. In a compute-and-forward scheme, a relay tries to decode a linear combination composed of transmitted messages from other…

Information Theory · Computer Science 2018-01-22 Satoshi Takabe , Yuta Ishimatsu , Tadashi Wadayama , Masahito Hayashi

High-throughput optical communication systems utilize binary soft-decision forward error correction (SD-FEC) with bit interleaving over the bit channels. The generalized mutual information (GMI) is an achievable information rate (AIR) in…

Information Theory · Computer Science 2024-01-30 Tsuyoshi Yoshida , Magnus Karlsson , Erik Agrell

An algorithm of improving the performance of iterative decoding on perpendicular magnetic recording is presented. This algorithm follows on the authors' previous works on the parallel and serial concatenated turbo codes and low-density…

Information Theory · Computer Science 2007-07-13 E. Papagiannis , C. Tjhai , M. Ahmed , M. Ambroze , M. Tomlinson

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinmeng Xu , Jianjun Hao

Superposition codes are efficient for the Additive White Gaussian Noise channel. We provide here a replica analysis of the performances of these codes for large signals. We also consider a Bayesian Approximate Message Passing decoder based…

Information Theory · Computer Science 2014-10-03 Jean Barbier , Florent Krzakala

The class of joint decoder of probabilistic fingerprinting codes is of utmost importance in theoretical papers to establish the concept of fingerprint capacity. However, no implementation supporting a large user base is known to date. This…

Information Theory · Computer Science 2023-07-26 Peter Meerwald , Teddy Furon

For the additive Gaussian noise channel with average codeword power constraint, sparse superposition codes and adaptive successive decoding is developed. Codewords are linear combinations of subsets of vectors, with the message indexed by…

Information Theory · Computer Science 2010-06-22 Andrew R Barron , Antony Joseph

This letter introduces a novel channel coding design framework for short-length codewords that permits balancing the tradeoff between the bit error rate floor and waterfall region by modifying a single real-valued parameter. The proposed…

Information Theory · Computer Science 2016-11-17 Mikel Hernaez , Pedro M. crespo , Javier Del Ser

Measuring the relationship between any pair of variables is a rich and active area of research that is central to scientific practice. In contrast, characterizing the common information among any group of variables is typically a…

Machine Learning · Statistics 2017-06-20 Greg Ver Steeg , Shuyang Gao , Kyle Reing , Aram Galstyan

Mutual information between particle positions before and after mixing provides a universal assumption-free measure of mixing efficiency at low Reynolds number which accounts for the kinematic reversibility of the Stokes equation. For a…

Statistical Mechanics · Physics 2025-06-19 Luca Cocconi , Yihong Shi , Andrej Vilfan

This paper presents expression of mutual information that defines the information gain in planning of sensing resources, when the goal is to reduce the forecast uncertainty of some quantities of interest and the system dynamics is described…

Systems and Control · Computer Science 2013-08-02 Han-Lim Choi

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and removing duplicates, which risks the loss of valuable…

Computation and Language · Computer Science 2024-07-10 Nan He , Weichen Xiong , Hanwen Liu , Yi Liao , Lei Ding , Kai Zhang , Guohua Tang , Xiao Han , Wei Yang

The recognition of personalized content, such as contact names, remains a challenging problem for end-to-end speech recognition systems. In this work, we demonstrate how first and second-pass rescoring strategies can be leveraged together…

A quantum error correcting protocol can be substantially improved by taking into account features of the physical noise process. We present an efficient decoder for the surface code which can account for general noise features, including…

Quantum Physics · Physics 2018-06-13 Andrew S. Darmawan , David Poulin

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

Infrared and visible image fusion aims to generate synthetic images simultaneously containing salient features and rich texture details, which can be used to boost downstream tasks. However, existing fusion methods are suffering from the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Hui Li , Yongbiao Xiao , Chunyang Cheng , Zhongwei Shen , Xiaoning Song

We present a method to compute, quickly and efficiently, the mutual information achieved by an IID (independent identically distributed) complex Gaussian input on a block Rayleigh-faded channel without side information at the receiver. The…

Information Theory · Computer Science 2010-01-14 Fredrik Rusek , Angel Lozano , Nihar Jindal

Scalable image coding for both humans and machines is a technique that has gained a lot of attention recently. This technology enables the hierarchical decoding of images for human vision and image recognition models. It is a highly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Takahiro Shindo , Yui Tatsumi , Taiju Watanabe , Hiroshi Watanabe

Recently, a novel lookup table based decoding method for binary low-density parity-check codes has attracted considerable attention. In this approach, mutual-information maximizing lookup tables replace the conventional operations of the…

Information Theory · Computer Science 2019-10-24 Maximilian Stark , Jan Lewandowsky , Souradip Saha , Gerhard Bauch

Fault tolerance is a prerequisite for scalable quantum computing. Architectures based on 2D topological codes are effective for near-term implementations of fault tolerance. To obtain high performance with these architectures, we require a…

Quantum Physics · Physics 2018-10-23 Ben Criger , Imran Ashraf