English
Related papers

Related papers: Information content in Gaussian noise: optimal com…

200 papers

Compressed sensing deals with the reconstruction of sparse signals using a small number of linear measurements. One of the main challenges in compressed sensing is to find the support of a sparse signal. In the literature, several bounds on…

Information Theory · Computer Science 2009-11-26 Ali Hormati , Amin Karbasi , Soheil Mohajer , Martin Vetterli

Recently, so-called Fuchsian codes have been proposed in [I. Blanco-Chac\'on et al., "Nonuniform Fuchsian codes for noisy channels", J. of the Franklin Institute 2014] for communication over channels subject to additive white Gaussian noise…

Information Theory · Computer Science 2014-10-23 Iván Blanco-Chacón , Camilla Hollanti , Montserrat Alsina , Dionís Remón

Probability distributions which emerge from the formalism of nonextensive statistical mechanics have been applied to a variety of problems. In this paper we unite modeling of such distributions with the model of widespread 1/f noise. We…

Statistical Mechanics · Physics 2015-06-03 J. Ruseckas , B. Kaulakys

With the advent of massive data outputs at a regular rate, admittedly, signal processing technology plays an increasingly key role. Nowadays, signals are not merely restricted to physical sources, they have been extended to digital sources…

Information Theory · Computer Science 2015-07-28 Yi Lu

The necessary and sufficient conditions of optimality of the decoding of quantum signals minimizing the Bayesian risk are generalized for the Shannon mutual information criteria. It is shown that for a linear channel with Gaussian boson…

Quantum Physics · Physics 2007-05-23 V. P. Belavkin , A. G. Vantsyan

Accurate characterization of the noise influencing a quantum system of interest has far-reaching implications across quantum science, ranging from microscopic modeling of decoherence dynamics to noise-optimized quantum control. While the…

This paper introduces a simple and very general theory of compressive sensing. In this theory, the sensing mechanism simply selects sensing vectors independently at random from a probability distribution F; it includes all models - e.g.…

Information Theory · Computer Science 2010-11-23 Emmanuel J. Candes , Yaniv Plan

A new approach to data compression is developed and applied to multimedia content. This method separates messages into components suitable for both lossless coding and 'lossy' or statistical coding techniques, compressing complex objects by…

Information Theory · Computer Science 2011-12-26 John Scoville

In quantum metrology, information about unknown parameters $\mathbf{\theta} = (\theta_1,\ldots,\theta_M)$ is accessed by measuring probe states $\hat{\rho}_{\mathbf{\theta}}$. In experimental settings where copies of…

We consider the transmission of a memoryless bivariate Gaussian source over an average-power-constrained one-to-two Gaussian broadcast channel. The transmitter observes the source and describes it to the two receivers by means of an…

Information Theory · Computer Science 2009-03-20 Shraga Bross , Amos Lapidoth , Stephan Tinguely

We consider stochastic model based on the linear stochastic differential equation with the linear relaxation and with the diffusion-like fluctuations of the relaxation rate. The model generates monofractal signals with the non-Gaussian…

Data Analysis, Statistics and Probability · Physics 2015-05-18 B. Kaulakys , M. Alaburda , J. Ruseckas

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

Machine Learning · Computer Science 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

We consider the distributional connection between the lossy compressed representation of a high-dimensional signal $X$ using a random spherical code and the observation of $X$ under an additive white Gaussian noise (AWGN). We show that the…

Information Theory · Computer Science 2021-12-14 Alon Kipnis , Galen Reeves

Many simulations of stochastic processes require colored noises: I describe here an exact numerical method to simulate power-law noises: the method can be extended to more general colored noises, and is exact for all time steps, even when…

Computational Physics · Physics 2007-05-23 Edoardo Milotti

The power-spectrum subband energy ratio (PSER) has been applied in a variety of fields, but reports on its statistical properties have been limited. As such, this study investigates these characteristics in the presence of additive Gaussian…

Signal Processing · Electrical Eng. & Systems 2020-11-19 Han Li , Yanzhu Hu , Song Wang , Zhen Meng

Especially in lossless image coding the obtainable compression ratio strongly depends on the amount of noise included in the data as all noise has to be coded, too. Different approaches exist for lossless image coding. We analyze the…

Image and Video Processing · Electrical Eng. & Systems 2023-01-12 Wolfgang Schnurrer , Jürgen Seiler , Michael Schöberl , André Kaup

For the discrete-time additive white generalized Gaussian noise channel with a generalized input power constraint, with the respective shape and power parameters >= 1, we derive an upper bound on the optimal block error exponent. Explicit…

Information Theory · Computer Science 2025-09-11 Sergey Tridenski , Anelia Somekh-Baruch

The capacity of peak-power limited, single-antenna, non-coherent, flat-fading channels with memory is considered. The emphasis is on the capacity pre-log, i.e., on the limiting ratio of channel capacity to the logarithm of the…

Information Theory · Computer Science 2008-04-14 Tobias Koch , Amos Lapidoth

In this paper we present a rigorous asymptotic analysis for stochastic systems with two fast relaxation times. The mathematical model analyzed in this paper consists of a Langevin equation for the particle motion with time-dependent force…

Mathematical Physics · Physics 2007-05-23 G. A. Pavliotis , A. M. Stuart

We analyze the effect of lossy compression in the processing of sensor signals that must be used to detect anomalous events in the system under observation. The intuitive relationship between the quality loss at higher compression and the…

Information Theory · Computer Science 2024-10-28 Alex Marchioni , Andriy Enttsel , Mauro Mangia , Riccardo Rovatti , Gianluca Setti