English
Related papers

Related papers: Universal Bayesian Measures and Universal Histogra…

200 papers

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

Methodology · Statistics 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

Consider the case where consecutive blocks of N letters of a semi-infinite individual sequence X over a finite-alphabet are being compressed into binary sequences by some one-to-one mapping. No a-priori information about X is available at…

Information Theory · Computer Science 2013-01-25 Jacob Ziv

A new framework is introduced for examining and evaluating the fundamental limits of lossless data compression, that emphasizes genuinely non-asymptotic results. The {\em sample complexity} of compressing a given source is defined as the…

Information Theory · Computer Science 2026-04-16 Terence Viaud , Ioannis Kontoyiannis

A density estimation method in a Bayesian nonparametric framework is presented when recorded data are not coming directly from the distribution of interest, but from a length biased version. From a Bayesian perspective, efforts to…

Statistics Theory · Mathematics 2015-10-23 Spyridon J. Hatjispyros , Theodoros Nicoleris , Stephen G. Walker

We investigate the question of whether or not there exists a noncommutative/ quantum extension of a recent (commutative probabilistic) result of Clarke and Barron. They demonstrated that the Jeffreys' invariant prior of Bayesian theory…

Quantum Physics · Physics 2008-02-03 Christian Krattenthaler , Paul Slater

We present a procedure for averaging one-parameter random unitary groups and random self-adjoint groups. Central to this is a generalization of the notion of weak convergence of a sequence of measures and the corresponding generalization of…

Mathematical Physics · Physics 2021-07-13 John E. Gough , Yurii N. Orlov , Vsevolod Zh. Sakbaev , Oleg G. Smolyanov

We extend a recently proposed 1-nearest-neighbor based multiclass learning algorithm and prove that our modification is universally strongly Bayes-consistent in all metric spaces admitting any such learner, making it an "optimistically…

Machine Learning · Computer Science 2021-10-01 Steve Hanneke , Aryeh Kontorovich , Sivan Sabato , Roi Weiss

We are living in the big data era, as current technologies and networks allow for the easy and routine collection of data sets in different disciplines. Bayesian Statistics offers a flexible modeling approach which is attractive for…

Methodology · Statistics 2018-05-09 George Karabatsos , Fabrizio Leisen

In this paper, generalized metrics mean metrics taking values in general linearly ordered Abelian groups. Using the Hahn fields, we first prove that for every generalized metric space, if the set of the Archimedean equivalence classes of…

Metric Geometry · Mathematics 2022-07-22 Yoshito Ishiki

The Bayesian framework is ideally suited for induction problems. The probability of observing $x_t$ at time $t$, given past observations $x_1...x_{t-1}$ can be computed with Bayes' rule if the true distribution $\mu$ of the sequences…

Artificial Intelligence · Computer Science 2011-11-09 Marcus Hutter

The paper concerns the limit shape (under some probability measure) of convex polygonal lines with vertices on $\mathbb{Z}_+^2$, starting at the origin and with the right endpoint $n=(n_1,n_2)\to\infty$. In the case of the uniform measure,…

Probability · Mathematics 2014-07-29 Leonid V. Bogachev

We study mean convergence results for weighted multiple ergodic averages defined by commuting transformations with iterates given by integer polynomials in several variables. Roughly speaking, we prove that a bounded sequence is a good…

Dynamical Systems · Mathematics 2016-07-13 Nikos Frantzikinakis , Bernard Host

In this work, we investigate the possibility of compressing a quantum system to one of smaller dimension in a way that preserves the measurement statistics of a given set of observables. In this process, we allow for an arbitrary amount of…

Quantum Physics · Physics 2018-06-26 Andreas Bluhm , Lukas Rauber , Michael M. Wolf

Quantized maximum a posteriori (Q-MAP) is a recently-proposed Bayesian compressed sensing algorithm that, given the source distribution, recovers $X^n$ from its linear measurements $Y^m=AX^n$, where $A\in R^{m\times n}$ denotes the known…

Information Theory · Computer Science 2018-01-04 Shirin Jalali

Nourdin et al. [9] established the following universality result: if a sequence of off-diagonal homogeneous polynomial forms in i.i.d. standard normal random variables converges in distribution to a normal, then the convergence also holds…

Probability · Mathematics 2015-05-15 Shuyang Bai , Murad S. Taqqu

Let $X_N$ be an $N$-dimensional subspace of $L_2$ functions on a probability space $(\Omega, \mu)$ spanned by a uniformly bounded Riesz basis $\Phi_N$. Given an integer $1\leq v\leq N$ and an exponent $1\leq q\leq 2$, we obtain universal…

Functional Analysis · Mathematics 2021-07-27 Feng Dai , V. Temlyakov

We propose two types of universal codes that are suited to two asymptotic regimes when the output alphabet is possibly continuous. The first class has the property that the error probability decays exponentially fast and we identify an…

Information Theory · Computer Science 2024-09-10 Masahito Hayashi

The sample mean is often used to aggregate different unbiased estimates of a parameter, producing a final estimate that is unbiased but possibly high-variance. This paper introduces the Bayesian median of means, an aggregation rule that…

Statistics Theory · Mathematics 2019-06-05 Paulo Orenstein

Various optimality properties of universal sequence predictors based on Bayes-mixtures in general, and Solomonoff's prediction scheme in particular, will be studied. The probability of observing $x_t$ at time $t$, given past observations…

Machine Learning · Computer Science 2007-05-23 Marcus Hutter

This paper deals with the problem of quantifying the approximation a probability measure by means of an empirical (in a wide sense) random probability measure, depending on the first n terms of a sequence of random elements. In Section 2,…

Probability · Mathematics 2018-08-23 Emanuele Dolera , Eugenio Regazzini