English
Related papers

Related papers: Achievable Rates for Probabilistic Shaping

200 papers

It is well known that a random q-ary code of rate \Omega(\epsilon^2) is list decodable up to radius (1 - 1/q - \epsilon) with list sizes on the order of 1/\epsilon^2, with probability 1 - o(1). However, until recently, a similar statement…

Information Theory · Computer Science 2013-07-11 Mary Wootters

Rejection sampling is a technique for sampling from difficult distributions. However, its use is limited due to a high rejection rate. Common adaptive rejection sampling methods either work only for very specific distributions or without…

Machine Learning · Statistics 2026-04-27 Akram Erraqabi , Michal Valko , Alexandra Carpentier , Odalric-Ambrym Maillard

We study maximum likelihood estimation for spatial generalized linear mixed models with Gaussian process approximations using a stochastic Newton-Raphson algorithm. We consider two Gaussian Process approximations in this context: spectral…

Methodology · Statistics 2026-05-19 Samuel I. Watson , Yixin Wang , Emanuele Giorgi

The problem of variable-rate lossless data compression is considered, for codes with and without prefix constraints. Sharp bounds are derived for the best achievable compression rate of memoryless sources, when the excess-rate probability…

Information Theory · Computer Science 2025-11-13 Andreas Theocharous , Lampros Gavalakis , Ioannis Kontoyiannis

Sparse random linear network coding (SRLNC) used as a class of erasure codes to ensure the reliability of multicast communications has been widely investigated. However, an exact expression for the decoding success probability of SRLNC is…

Information Theory · Computer Science 2021-08-27 WenLin Chen , Fang Lu , Yan Dong

We consider the safety evaluation of discrete time, stochastic systems over a finite horizon. Therefore, we discuss and link probabilistic invariance with reachability as well as reach-avoid problems. We show how to efficiently compute…

Systems and Control · Electrical Eng. & Systems 2023-04-17 Niklas Schmid , John Lygeros

Upper and lower bounds on the error probability of linear codes under maximum-likelihood (ML) decoding are shortly surveyed and applied to ensembles of codes on graphs. For upper bounds, focus is put on Gallager bounding techniques and…

Information Theory · Computer Science 2007-07-13 Igal Sason , Shlomo Shamai

In this paper q-ary Raptor codes under ML decoding are considered. An upper bound on the probability of decoding failure is derived using the weight enumerator of the outer code, or its expected weight enumerator if the outer code is drawn…

Information Theory · Computer Science 2016-11-21 Francisco Lázaro , Gianluigi Liva , Enrico Paolini , Gerhard Bauch

Convolutional precoding in polarization-adjusted convolutional (PAC) codes can reduce the number of minimum weight codewords (a.k.a error coefficient) of polar codes. This can result in improving the error correction performance of (near)…

Information Theory · Computer Science 2022-12-02 Xinyi Gu , Mohammad Rowshan , Jinhong Yuan

Computing reachability probabilities is at the heart of probabilistic model checking. All model checkers compute these probabilities in an iterative fashion using value iteration. This technique approximates a fixed point from below by…

Logic in Computer Science · Computer Science 2018-04-16 Tim Quatmann , Joost-Pieter Katoen

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations (PDE) with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that…

Numerical Analysis · Mathematics 2018-09-18 Eric Joseph Hall , Håkon Hoel , Mattias Sandberg , Anders Szepessy , Raúl Tempone

Estimating probabilistic deformable template models is a new approach in the fields of computer vision and probabilistic atlases in computational anatomy. A first coherent statistical framework modelling the variability as a hidden random…

Computation · Statistics 2009-01-16 Stéphanie Allassonnière , Estelle Kuhn

The problem of error correction for Gallager's low-density parity-check codes is famously equivalent to that of computing marginal Boltzmann probabilities for an Ising-like model with multispin interactions in a non-uniform magnetic field.…

Statistical Mechanics · Physics 2014-11-03 Marco Pretti

A new polar coding scheme for higher order modulation is presented. The proposed scheme is based on multi-level coding (MLC) with natural labeling, where the bit-level corresponding to the sign-bit is generated in dependence on the previous…

Information Theory · Computer Science 2019-10-30 Onurcan İşcan , Ronald Böhnke , Wen Xu

Algorithms based on multiple decoding attempts of Reed-Solomon (RS) codes have recently attracted new attention. Choosing decoding candidates based on rate-distortion (R-D) theory, as proposed previously by the authors, currently provides…

Information Theory · Computer Science 2016-11-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

This article deals with stochastic processes endowed with the Markov (memoryless) property and evolving over general (uncountable) state spaces. The models further depend on a non-deterministic quantity in the form of a control input, which…

Systems and Control · Computer Science 2015-09-11 Sofie Haesaert , Robert Babuska , Alessandro Abate

We propose and study a task we name panoptic segmentation (PS). Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Alexander Kirillov , Kaiming He , Ross Girshick , Carsten Rother , Piotr Dollár

Decoders built on Gaussian processes (GPs) are enticing due to the marginalisation over the non-linear function space. Such models (also known as GP-LVMs) are often expensive and notoriously difficult to train in practice, but can be scaled…

Machine Learning · Statistics 2022-11-28 Pablo Moreno-Muñoz , Cilie W Feldager , Søren Hauberg

We propose a new partial decoding algorithm for $m$-interleaved Reed--Solomon (IRS) codes that can decode, with high probability, a random error of relative weight $1-R^{\frac{m}{m+1}}$ at all code rates $R$, in time polynomial in the code…

Information Theory · Computer Science 2017-05-08 Sven Puchinger , Johan Rosenkilde né Nielsen

A probabilistic approach of computing geometric rate of convergence of stochastic processes is introduced in this paper. The goal is to quantitatively compute both upper and lower bounds of the exponential rate of convergence to the…

Dynamical Systems · Mathematics 2020-12-02 Yao Li , Shirou Wang
‹ Prev 1 4 5 6 7 8 10 Next ›