English
Related papers

Related papers: Information Rates and Error Exponents for Probabil…

200 papers

For the additive white Gaussian noise channel with average codeword power constraint, sparse superposition codes are developed. These codes are based on the statistical high-dimensional regression framework. The paper [IEEE Trans. Inform.…

Information Theory · Computer Science 2012-07-11 Antony Joseph , Andrew Barron

Sparse superposition codes are a recent class of codes introduced by Barron and Joseph for efficient communication over the AWGN channel. With an appropriate power allocation, these codes have been shown to be asymptotically…

Information Theory · Computer Science 2018-03-19 Adam Greig , Ramji Venkataramanan

With the increasing demands on future wireless systems, new design objectives become eminent. Low-density parity-check codes together with belief propagation (BP) decoding have outstanding performance for large block lengths. Yet, for…

Information Theory · Computer Science 2024-06-06 Jonathan Mandelbaum , Sisi Miao , Nils Albert Schwendemann , Holger Jäkel , Laurent Schmalen

Using tools developed in a recent work by Shen and the second author, in this paper we carry out an in-depth study on the average decoding error probability of the random matrix ensemble over the erasure channel under three decoding…

Information Theory · Computer Science 2024-04-23 Chin Hei Chan , Fang-Wei Fu , Maosheng Xiong

The interaction between carrier phase recovery and probabilistic amplitude shaping (PAS) in the nonlinear regime is investigated. We show that, for sufficiently high signal-to-noise ratio, the first provides the same inter-channel…

Information Theory · Computer Science 2020-09-03 Stella Civelli , Enrico Forestieri , Marco Secondini

Error correction code is a major part of the communication physical layer, ensuring the reliable transfer of data over noisy channels. Recently, neural decoders were shown to outperform classical decoding techniques. However, the existing…

Machine Learning · Computer Science 2022-03-30 Yoni Choukroun , Lior Wolf

We define and discuss the first sparse coding algorithm based on closed-form EM updates and continuous latent variables. The underlying generative model consists of a standard `spike-and-slab' prior and a Gaussian noise model. Closed-form…

Machine Learning · Statistics 2012-03-05 Jörg Lücke , Abdul-Saboor Sheikh

Stochastic encoders for channel coding and lossy source coding are introduced with a rate close to the fundamental limits, where the only restriction is that the channel input alphabet and the reproduction alphabet of the lossy source code…

Information Theory · Computer Science 2016-11-15 Jun Muramatsu

We introduce neural probabilistic amplitude shaping, a joint-distribution learning framework for coherent fiber systems. The proposed scheme provides a 0.5 dB signal-to-noise ratio gain over sequence selection for dual-polarized 64-QAM…

Machine Learning · Computer Science 2026-02-04 Mohammad Taha Askari , Lutz Lampe , Amirhossein Ghazisaeidi

A probabilistic shaping method for multi-level coding (MLC) is presented, where the transmitted symbols are forced to have a shaped non-uniform distribution. It is shown that shaping only a single bit-level suffices to compensate for most…

Information Theory · Computer Science 2018-12-20 Onurcan İşcan , Ronald Böhnke , Wen Xu

The OFDM waveform exhibits high fluctuation in the signal envelope which causes distortion in the nonlinear power amplifier of the transmitter. Peak-to-Average Power Ratio (PAPR) and Cubic Metric (CM) are the common metrics to quantify the…

Information Theory · Computer Science 2020-03-26 Saeed Afrasiabi-Gorgani , Gerhard Wunder

The use of multitaper estimates for spectral proper orthogonal decomposition (SPOD) is explored. Multitaper and multitaper-Welch estimators that use discrete prolate spheroidal sequences (DPSS) as orthogonal data windows are compared to the…

Fluid Dynamics · Physics 2022-09-14 Oliver T. Schmidt

Mass spectrometry (MS) is an important technique for chemical profiling which calculates for a sample a high dimensional histogram-like spectrum. A crucial step of MS data processing is the peak picking which selects peaks containing…

Machine Learning · Statistics 2009-10-05 Theodore Alexandrov , Klaus Steinhorst , Oliver Keszoecze , Stefan Schiffler

Capacity formulas and random-coding exponents are derived for a generalized family of Gel'fand-Pinsker coding problems. These exponents yield asymptotic upper bounds on the achievable log probability of error. In our model, information is…

Information Theory · Computer Science 2007-07-13 Pierre Moulin , Ying Wang

This paper investigates the problem of sampling and reconstructing bandpass signals using time encoding machine(TEM). It is shown that the sampling in principle is equivalent to periodic non-uniform sampling (PNS). Then the TEM parameters…

Information Theory · Computer Science 2023-02-16 Zhong Liu , Feng Xi , Shengyao Chen

Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from…

Machine Learning · Computer Science 2013-01-30 Thomas Hofmann

This paper presents a novel framework for enhancing physical-layer security in integrated sensing and communication (ISAC) systems by leveraging the reconfigurability of fluid antenna systems (FAS). We propose a joint precoding and port…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Abdelhamid Salem , Hao Xu , Kai-Kit Wong , Chan-Byoung Chae , Yangyang Zhang

We consider sparse superposition codes (SPARCs) over complex AWGN channels. Such codes can be efficiently decoded by an approximate message passing (AMP) decoder, whose performance can be predicted via so-called state evolution in the…

Information Theory · Computer Science 2021-03-09 Haiwen Cao , Pascal O. Vontobel

Electronic resonances are metastable states that can decay by electron loss. They are ubiquitous across various fields of science, such as chemistry, physics, and biology. However, current theoretical and computational models for resonances…

Chemical Physics · Physics 2025-04-15 Yann Damour , Anthony Scemama , Fábris Kossoski , Pierre-François Loos

Model correction is essential for reliable PDE learning when the governing physics is misspecified due to simplified assumptions or limited observations. In the machine learning literature, existing correction methods typically operate in…

Numerical Analysis · Mathematics 2026-03-27 Wenwen Zhou , Xiaodong Feng , Ling Guo , Hao Wu