English
Related papers

Related papers: Universal compression of Gaussian sources with unk…

200 papers

A theoretical framework is developed to describe the transformation that distributes probability density functions uniformly over space. In one dimension, the cumulative distribution can be used, but does not generalize to higher…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Eric Kee

The recently developed average-case analysis of optimization methods allows a more fine-grained and representative convergence analysis than usual worst-case results. In exchange, this analysis requires a more precise hypothesis over the…

Optimization and Control · Mathematics 2022-06-23 Leonardo Cunha , Gauthier Gidel , Fabian Pedregosa , Damien Scieur , Courtney Paquette

In lossy compression, Wang et al. [1] recently introduced the rate-distortion-perception-classification function, which supports multi-task learning by jointly optimizing perceptual quality, classification accuracy, and reconstruction…

Information Theory · Computer Science 2025-04-23 Nam Nguyen , Thuan Nguyen , Thinh Nguyen , Bella Bose

The current PDF4LHC recommendation to estimate uncertainties due to parton distribution functions (PDFs) in theoretical predictions for LHC processes involves the combination of separate predictions computed using PDF sets from different…

High Energy Physics - Phenomenology · Physics 2015-09-30 Stefano Carrazza , Jose I. Latorre , Juan Rojo , Graeme Watt

We investigate the problem of characterizing the optimal variance proxy for sub-Gaussian random variables,whose moment-generating function exhibits bounded growth at infinity. We apply a general characterization method to discrete random…

Statistics Theory · Mathematics 2025-10-08 Soufiane Atouani , Olivier Marchal , Julyan Arbel

The Poisson model is frequently employed to describe count data, but in a Bayesian context it leads to an analytically intractable posterior probability distribution. In this work, we analyze a variational Gaussian approximation to the…

Numerical Analysis · Mathematics 2018-02-14 Simon Arridge , Kazufumi Ito , Bangti Jin , Chen Zhang

The joint probability distribution function (PDF) of the density within multiple concentric spherical cells is considered. It is shown how its cumulant generating function can be obtained at tree order in perturbation theory as the Legendre…

Cosmology and Nongalactic Astrophysics · Physics 2014-11-19 Francis Bernardeau , Christophe Pichon , Sandrine Codis

By optimal fluctuation method, we study short-time distribution $P(\mathcal{A}=A)$ of the functionals, $\mathcal{A}=\int_{0}^{t_f} x^n(t) dt$, along constrained trajectories of random acceleration process for a given time duration $t_f$,…

Statistical Mechanics · Physics 2025-06-18 Hanshuang Chen , Lulu Tian , Guofeng Li

We present a non-perturbative calculation of the 1-point probability distribution function (PDF) for the spherically-averaged matter density field. The PDF is represented as a path integral and is evaluated using the saddle-point method. It…

Cosmology and Nongalactic Astrophysics · Physics 2019-03-20 Mikhail M. Ivanov , Alexander A. Kaurov , Sergey Sibiryakov

We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the…

Statistics Theory · Mathematics 2020-01-01 Jisu Kim , Jaehyeok Shin , Alessandro Rinaldo , Larry Wasserman

We develop a non-perturbative method to derive the probability distribution $P(\delta_R)$ of the density contrast within spherical cells in the quasi-linear regime. Indeed, since this corresponds to a rare-event limit a steepest-descent…

Astrophysics · Physics 2009-11-06 P. Valageas

What is the size of the most massive object one expects to find in a survey of a given volume? In this paper, we present a solution to this problem using Extreme-Value Statistics, taking into account primordial non-Gaussianity and its…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-28 Sirichai Chongchitnan , Joseph Silk

We describe a method to computationally estimate the probability density function of a univariate random variable by applying the maximum entropy principle with some local conditions given by Gaussian functions. The estimation errors and…

Statistics Theory · Mathematics 2012-06-21 Mihail-Ioan Pop

Previously referred to as `miraculous' in the scientific literature because of its powerful properties and its wide application as optimal solution to the problem of induction/inference, (approximations to) Algorithmic Probability (AP) and…

Information Theory · Computer Science 2018-04-16 Hector Zenil , Liliana Badillo , Santiago Hernández-Orozco , Francisco Hernández-Quiroz

Clarke and Barron have recently shown that the Jeffreys' invariant prior of Bayesian theory yields the common asymptotic (minimax and maximin) redundancy of universal data compression in a parametric setting. We seek a possible analogue of…

Probability · Mathematics 2016-11-17 Christian Krattenthaler , Paul B. Slater

We give a necessary and sufficient condition for symmetric infinitely divisible distribution to have Gaussian component. The result can be applied to approximation the distribution of finite sums of random variables. Particularly, it shows…

Probability · Mathematics 2015-08-25 Lev B. Klebanov , Irina V. Volchenkova , Ashot V. Kakosyan

Compression also known as entropy coding has a rich and long history. However, a recent explosion of multimedia Internet applications (such as teleconferencing and video streaming for instance) renews an interest in fast compression that…

Information Theory · Computer Science 2023-05-10 Josef Pieprzyk , Jarek Duda , Marcin Pawlowski , Seyit Camtepe , Arash Mahboubi , Pawel Morawiecki

Compression of integer sets and sequences has been extensively studied for settings where elements follow a uniform probability distribution. In addition, methods exist that exploit clustering of elements in order to achieve higher…

Information Theory · Computer Science 2014-02-11 N. Jesper Larsson

The problem of performing similarity queries on compressed data is considered. We focus on the quadratic similarity measure, and study the fundamental tradeoff between compression rate, sequence length, and reliability of queries performed…

Information Theory · Computer Science 2016-11-18 Amir Ingber , Thomas Courtade , Tsachy Weissman

Given data drawn from an unknown distribution, $D$, to what extent is it possible to ``amplify'' this dataset and output an even larger set of samples that appear to have been drawn from $D$? We formalize this question as follows: an…

Machine Learning · Computer Science 2024-08-27 Brian Axelrod , Shivam Garg , Vatsal Sharan , Gregory Valiant