English
Related papers

Related papers: Achievable Rates for Probabilistic Shaping

200 papers

A new achievability scheme for the compound channel with discrete memoryless (DM) state noncausally available at the encoder is established. Achievability is proved using superposition coding, Marton coding, joint typicality encoding, and…

Information Theory · Computer Science 2010-04-26 Chandra Nair , Abbas El Gamal , Yeow-Khiang Chia

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

We study a simplified model for pulsed laser deposition [Phys. Rev. Lett. {\bf 87}, 135701 (2001)] by rate equations. We consider a set of equations, where islands are assumed to be point-like, as well as an improved one that takes the size…

Statistical Mechanics · Physics 2008-04-23 A. C. Barato , H. Hinrichsen , D. E. Wolf

In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given…

Optimization and Control · Mathematics 2022-01-25 Jia Wang , Ying Yang

A variation of Gallager error-correcting codes is investigated using statistical mechanics. In codes of this type, a given message is encoded into a codeword which comprises Boolean sums of message bits selected by two randomly constructed…

Disordered Systems and Neural Networks · Physics 2009-10-31 Tatsuto Murayama , Yoshiyuki Kabashima , David Saad , Renato Vicente

Despite the extreme error-correction performance, the amount of computation of sequential decoding of the polarization-adjusted convolutional (PAC) codes is random. In sequential decoding of convolutional codes, the computational cutoff…

Information Theory · Computer Science 2022-11-30 Mohsen Moradi

A stochastic algorithm is proposed, finding the set of generalized means associated to a probability measure on a compact Riemannian manifold M and a continuous cost function on the product of M by itself. Generalized means include p-means…

Probability · Mathematics 2013-05-28 Marc Arnaudon , Laurent Miclo

Probabilistic shaping is a pragmatic approach to improve the performance of coherent optical fiber communication systems. In the nonlinear regime, the advantages offered by probabilistic shaping might increase thanks to the opportunity to…

Information Theory · Computer Science 2024-01-19 Stella Civelli , Enrico Forestieri , Marco Secondini

Hinging on ideas from physical-layer network coding, some promising proposals of coded random access systems seek to improve system performance (while preserving low complexity) by means of packet repetitions and decoding of linear…

Information Theory · Computer Science 2018-05-30 Adriano Pastore , Paul de Kerret , Monica Navarro , David Gregoratti , David Gesbert

Scientific explanation often requires inferring maximally predictive features from a given data set. Unfortunately, the collection of minimal maximally predictive features for most stochastic processes is uncountably infinite. In such…

Statistical Mechanics · Physics 2017-05-31 Sarah E. Marzen , James P. Crutchfield

Probabilistic shaping (PS) is investigated as a potential technique to approach the Shannon limit. However, it has been proved that conventional carrier phase recovery (CPR) algorithm designed for uniform distribution may have extra penalty…

Signal Processing · Electrical Eng. & Systems 2021-02-03 Jin Hu , Zhongliang Sun , Xuekai Xu , Mengqi Guo , Xizi Tang , Yueming Lu , Yaojun Qiao

We develop a probabilistic technique for colorizing grayscale natural images. In light of the intrinsic uncertainty of this task, the proposed probabilistic framework has numerous desirable properties. In particular, our model is able to…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Amelie Royer , Alexander Kolesnikov , Christoph H. Lampert

We consider transmission over a general memoryless channel, with bounded decoding complexity per bit under message passing decoding. We show that the achievable rate is bounded below capacity if there is a finite success in the decoding in…

Information Theory · Computer Science 2007-07-13 Pulkit Grover

New non-asymptotic random coding theorems (with error probability $\epsilon$ and finite block length $n$) based on Gallager parity check ensemble and Shannon random code ensemble with a fixed codeword type are established for discrete input…

Information Theory · Computer Science 2013-03-05 En-hui Yang , Jin Meng

In this letter, we propose a symbol-wise puncturing scheme to support hybrid automatic repeat request (HARQ) integrated probabilistic amplitude shaping (PAS). To prevent the probability distribution distortion caused by the traditional…

Information Theory · Computer Science 2022-07-26 Li Shen , Yongpeng Wu , Derrick Wing Kwan Ng , Wenjun Zhang , Xiang-Gen Xia

This work extends the multiscale structure originally developed for point cloud geometry compression to point cloud attribute compression. To losslessly encode the attribute while maintaining a low bitrate, accurate probability prediction…

Image and Video Processing · Electrical Eng. & Systems 2023-03-24 Jianqiang Wang , Dandan Ding , Zhan Ma

Partial Unit Memory (PUM) codes are a special class of convolutional codes, which are often constructed by means of block codes. Decoding of PUM codes may take advantage of existing decoders for the block code. The Dettmar--Sorger algorithm…

Information Theory · Computer Science 2012-02-09 Antonia Wachter-Zeh , Markus Stinner , Martin Bossert

The Acceptance Probability Estimation Problem (APEP) is to additively approximate the acceptance probability of a Boolean circuit. This problem admits a probabilistic approximation scheme. A central question is whether we can design a…

Computational Complexity · Computer Science 2021-03-16 Peter Dixon , A. Pavan , N. V. Vinodchandran

The intuitive sphere-packing argument is used to obtain analytically-tractable closed-form approximations for achievable information rates of coded modulation transmission systems, for which only analytically-intractable expressions are…

Information Theory · Computer Science 2020-12-04 Maria Urlea , Sergey Loyka

We consider coding schemes for computationally bounded channels, which can introduce an arbitrary set of errors as long as (a) the fraction of errors is bounded with high probability by a parameter $p$ and (b) the process which adds the…

Information Theory · Computer Science 2013-03-01 Venkatesan Guruswami , Adam Smith