English
Related papers

Related papers: Universal Coding and Prediction on Ergodic Martin-…

200 papers

A stochastic algorithm is proposed, finding the set of generalized means associated to a probability measure on a compact Riemannian manifold M and a continuous cost function on the product of M by itself. Generalized means include p-means…

Probability · Mathematics 2013-05-28 Marc Arnaudon , Laurent Miclo

We lift important results about universally typical sets, typically sampled sets, and empirical entropy estimation in the theory of samplings of discrete ergodic information sources from the usual one-dimensional discrete-time setting to a…

Information Theory · Computer Science 2013-11-13 Tyll Krueger , Guido Montufar , Ruedi Seiler , Rainer Siegmund-Schultze

Ergodic properties of rational maps are studied, generalising the work of F.\ Ledrappier. A new construction allows for simpler proofs of stronger results. Very general conformal measures are considered. Equivalent conditions are given for…

Dynamical Systems · Mathematics 2012-04-02 Neil Dobbs

This paper develops several interesting, significant, and interconnected approaches to nonparametric or semi-parametric statistical inferences. The overwhelmingly favoured maximum likelihood estimator (MLE) under parametric model is…

Statistics Theory · Mathematics 2023-03-30 Haodi Liang , Jiahua Chen

Spaces with locally varying scale of measurement, like multidimensional structures with differently scaled dimensions, are pretty common in statistics and machine learning. Nevertheless, it is still understood as an open question how to…

Machine Learning · Statistics 2024-03-05 Christoph Jansen , Georg Schollmeyer , Hannah Blocher , Julian Rodemann , Thomas Augustin

This expository paper advocates an approach to physics in which ``typicality" is identified with a suitable form of algorithmic randomness. To this end various theorems from mathematics and physics are reviewed. Their original versions…

Mathematical Physics · Physics 2023-09-06 Klaas Landsman

Bucklew and Wise (1982) showed that the quantization dimension of an absolutely continuous probability measure on a given Euclidean space is constant and equals the Euclidean dimension of the space, and the quantization coefficient exists…

Probability · Mathematics 2025-07-23 Evans Nyanney , Megha Pandey , Mrinal Kanti Roychowdhury

We present a simple randomized procedure for the prediction of a binary sequence. The algorithm uses ideas from recent developments of the theory of the prediction of individual sequences. We show that if the sequence is a realization of a…

Statistics Theory · Mathematics 2008-06-19 L. Györfi , G. Lugosi , G. Morvai

This paper introduces a novel error estimator for the Proper Generalized Decomposition (PGD) approximation of parametrized equations. The estimator is intrinsically random: It builds on concentration inequalities of Gaussian maps and an…

Numerical Analysis · Mathematics 2019-10-28 Kathrin Smetana , Olivier Zahm

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

We study Martin-L\"{o}f random (ML-random) points on computable probability measures on sample and parameter spaces (Bayes models). We consider variants of conditional randomness defined by ML-randomness on Bayes models and those of…

Information Theory · Computer Science 2023-04-24 Hayato Takahashi

A new notion of typicality for arbitrary probability measures on standard Borel spaces is proposed, which encompasses the classical notions of weak and strong typicality as special cases. Useful lemmas about strong typical sets, including…

Information Theory · Computer Science 2016-11-17 Junekey Jeon

The paper considers quantitative versions of different randomness notions: algorithmic test measures the amount of non-randomness (and is infinite for non-random sequences). We start with computable measures on Cantor space (and Martin-Lof…

Logic · Mathematics 2011-05-27 Laurent Bienvenu , Peter Gacs , Mathieu Hoyrup , Cristobal Rojas , Alexander Shen

Ergodic optimization aims to single out dynamically invariant Borel probability measures which maximize the integral of a given "performance" function. For a continuous self-map of a compact metric space and a dense set of continuous…

Dynamical Systems · Mathematics 2017-04-20 Mao Shinoda

Statistical models incorporating change points are common in practice, especially in the area of biomedicine. This approach is appealing in that a specific parameter is introduced to account for the abrupt change in the response variable…

Statistics Theory · Mathematics 2008-12-18 Hongling Zhou , Kung-Yee Liang

We first develop a theory of conditional expectations for random variables with values in a complete metric space $M$ equipped with a contractive barycentric map $\beta$, and then give convergence theorems for martingales of…

Probability · Mathematics 2018-05-23 Fumio Hiai , Yongdo Lim

Optimal prediction (OP) methods compensate for a lack of resolution in the numerical solution of complex problems through the use of an invariant measure as a prior measure in the Bayesian sense. In first-order OP, unresolved information is…

Numerical Analysis · Mathematics 2025-10-20 John Bell , Alexandre J. Chorin , William Crutchfield

We study sequential prediction of real-valued, arbitrary and unknown sequences under the squared error loss as well as the best parametric predictor out of a large, continuous class of predictors. Inspired by recent results from…

Machine Learning · Computer Science 2014-01-24 N. Denizcan Vanli , Suleyman S. Kozat

There is only one fully supported ergodic invariant probability measure for the adic transformation on the space of infinite paths in the graph that underlies the Eulerian numbers. This result may partially justify a frequent assumption…

Dynamical Systems · Mathematics 2007-08-10 Sarah Bailey Frick , Karl Petersen

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong