English
Related papers

Related papers: Achievable Rates for Probabilistic Shaping

200 papers

This paper introduces a novel class of PICOD($t$) problems referred to as $g$-group complete-$S$ PICOD($t$) problems. It constructs a multi-stage achievability scheme to generate pliable index codes for group complete PICOD problems when $S…

Information Theory · Computer Science 2024-05-14 Sina Eghbal , Badri N. Vellambi , Lawrence Ong , Parastoo Sadeghi

Probabilistic relational models such as parametric factor graphs enable efficient (lifted) inference by exploiting the indistinguishability of objects. In lifted inference, a representative of indistinguishable objects is used for…

Artificial Intelligence · Computer Science 2025-08-28 Malte Luttermann , Jan Speller , Marcel Gehrke , Tanya Braun , Ralf Möller , Mattis Hartwig

In this paper, we propose a column by column encoding scheme suitable for two-dimensional (2D) constraint codes and derive a lower bound of its maximum achievable rate. It is shown that the maximum achievable rate is equal to the largest…

Information Theory · Computer Science 2018-04-18 Kazuya Hirata , Tadashi Wadayama

We consider the problem of rescaling the lengths of a finite frame thereby transforming it into a tight one. Such frames are called scalable and have received a lot of attention in recent years. In this note we investigate the question in…

Numerical Analysis · Mathematics 2016-08-22 Clare Wickman Lau , Kasso A. Okoudjou

Gaussian process (GP) models provide a powerful tool for prediction but are computationally prohibitive using large data sets. In such scenarios, one has to resort to approximate methods. We derive an approximation based on a composite…

Machine Learning · Statistics 2018-02-02 Xiuming Liu , Dave Zachariah , Edith C. H. Ngai

This is a companion technical report of the main manuscript "Physical-Layer Multicasting by Stochastic Transmit Beamforming and Alamouti Space-Time Coding". The report serves to give detailed derivations of the achievable rate functions…

Information Theory · Computer Science 2013-05-08 Xiaoxiao Wu , Wing-Kin Ma , Anthony Man-Cho So

We introduce the $k$-banded Cholesky prior for estimating a high-dimensional bandable precision matrix via the modified Cholesky decomposition. The bandable assumption is imposed on the Cholesky factor of the decomposition. We obtained the…

Statistics Theory · Mathematics 2017-07-06 Kyoungjae Lee , Jaeyong Lee

Some new results are derived concerning random coding error exponents and expurgated exponents for list decoding with a deterministic list size $L$. Two asymptotic regimes are considered, the fixed list-size regime, where $L$ is fixed…

Information Theory · Computer Science 2016-11-17 Neri Merhav

The generalized perturbative approach is an all purpose variant of Stein's method used to obtain rates of normal approximation. Originally developed for functions of independent random variables this method is here extended to functions of…

Probability · Mathematics 2020-10-12 Christian Houdré , George Kerchev

The Laplace approximation is an old, but frequently used method to approximate integrals for Bayesian calculations. In this paper we develop an extension of the Laplace approximation, by applying it iteratively to the residual, i.e., the…

Computation · Statistics 2012-09-04 Björn Bornkamp

In this paper we address the complexity of solving linear programming problems with a set of differential equations that converge to a fixed point that represents the optimal solution. Assuming a probabilistic model, where the inputs are…

Computational Complexity · Computer Science 2007-05-23 Asa Ben-Hur , Joshua Feinberg , Shmuel Fishman , Hava T. Siegelmann

Decomposable models and Bayesian networks can be defined as sequences of oligo-dimensional probability measures connected with operators of composition. The preliminary results suggest that the probabilistic models allowing for effective…

Artificial Intelligence · Computer Science 2013-02-08 Radim Jirousek

Gaussian processes (GPs) are popular as nonlinear regression models for expensive computer simulations, yet GP performance relies heavily on estimation of unknown covariance parameters. Maximum likelihood estimation (MLE) is common, but it…

Methodology · Statistics 2025-11-25 Ayumi Mutoh , Annie S. Booth , Jonathan W. Stallrich

We propose a randomized first order optimization algorithm Gradient Projection Iterative Sketch (GPIS) and an accelerated variant for efficiently solving large scale constrained Least Squares (LS). We provide theoretical convergence…

Optimization and Control · Mathematics 2017-07-18 Junqi Tang , Mohammad Golbabaee , Mike Davies

Mass spectrometry (MS) is an important technique for chemical profiling which calculates for a sample a high dimensional histogram-like spectrum. A crucial step of MS data processing is the peak picking which selects peaks containing…

Machine Learning · Statistics 2009-10-05 Theodore Alexandrov , Klaus Steinhorst , Oliver Keszoecze , Stefan Schiffler

In this paper, we propose \textit{selectively precoded polar (SPP) code}, built on top of Arikan's capacity achieving polar codes. We provide the encoding and decoding scheme for SPP code. Simulation results show that for a target frame…

Information Theory · Computer Science 2024-10-30 Samir Kumar Mishra , KwangChul Kim

In Computer Vision, edge detection is one of the favored approaches for feature and object detection in images since it provides information about their objects boundaries. Other region-based approaches use probabilistic analysis such as…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Dominique Beaini , Sofiane Achiche , Fabrice Nonez , Maxime Raison

We investigate the achievable rate of data transmission from sources to sinks through a multiple-relay network. We study achievable rates for omniscient coding, in which all nodes are considered in the coding design at each node. We find…

Information Theory · Computer Science 2010-04-15 Lawrence Ong , Mehul Motani

An accurate predictor is crucial for histogram-shifting (HS) based reversible data hiding methods. The embedding capacity is increased and the embedding distortion is decreased simultaneously if the predictor can generate accurate…

Multimedia · Computer Science 2015-07-30 Xiaochao Qu , Suah Kim , Run Cui , Hyoung Joong Kim

Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques, such as Markov chain Monte Carlo (MCMC) and particle filters, have become very popular in signal processing over the last years. However, in many…

Computation · Statistics 2012-05-29 Luca Martino , Joaquin Miguez