English
Related papers

Related papers: Universally Typical Sets for Ergodic Sources of Mu…

200 papers

We investigate the overdamped stochastic dynamics of a particle in an asymptotically flat external potential field, in contact with a thermal bath. For an infinite system size, the particles may escape the force field and diffuse freely at…

Statistical Mechanics · Physics 2020-06-24 Erez Aghion , David A. Kessler , Eli Barkai

We investigate a network model based on an infinite regular square lattice embedded in the Euclidean plane where the node connection probability is given by the geometrical distance of nodes. We show that the degree distribution in the…

Physics and Society · Physics 2008-06-23 Matus Medo , Jan Smrek

Let $\{X_n\}$ be a stationary and ergodic time series taking values from a finite or countably infinite set ${\cal X}$. Assume that the distribution of the process is otherwise unknown. We propose a sequence of stopping times $\lambda_n$…

Probability · Mathematics 2008-06-19 G. Morvai , B. Weiss

In many applications, it is often necessary to sample the mean value of certain quantity with respect to a probability measure {\mu} on the level set of a smooth function $\xi: \mathbb{R}^d\rightarrow \mathbb{R}^k$, $1\le k < d$. A…

Probability · Mathematics 2019-09-25 Wei Zhang

In this work, we demonstrate how to reliably estimate epistemic uncertainty while maintaining the flexibility needed to capture complicated aleatoric distributions. To this end, we propose an ensemble of Normalizing Flows (NF), which are…

Machine Learning · Computer Science 2023-10-05 Lucas Berry , David Meger

Information theoretical measures, such as entropy, mutual information, and various divergences, exhibit robust characteristics in image registration applications. However, the estimation of these quantities is computationally intensive in…

Information Theory · Computer Science 2012-10-03 Zoltan Szabo , Andras Lorincz

Sampling from flat modes in discrete spaces is a crucial yet underexplored problem. Flat modes represent robust solutions and have broad applications in combinatorial optimization and discrete generative modeling. However, existing sampling…

Machine Learning · Computer Science 2025-05-19 Pinaki Mohanty , Riddhiman Bhattacharya , Ruqi Zhang

Given a discrete-valued sample $X_1,...,X_n$ we wish to decide whether it was generated by a distribution belonging to a family $H_0$, or it was generated by a distribution belonging to a family $H_1$. In this work we assume that all…

Statistics Theory · Mathematics 2014-12-30 Daniil Ryabko

One of the fundamental results of ergodic optimization asserts that for any dynamical system on a compact metric space with the specification property and for a generic continuous function $f$ every invariant probability measure that…

Dynamical Systems · Mathematics 2024-03-25 Shoya Motonaga , Mao Shinoda

For any diagonal element $a$ with two eigenvalues, we construct a sequence of $a$-invariant probability measures on the space of unimodular lattices with high entropy but converging to the zero measure. This extends the result of Kadyrov…

Dynamical Systems · Mathematics 2025-11-26 Taehyeong Kim

We develop random graph models where graphs are generated by connecting not only pairs of vertices by edges but also larger subsets of vertices by copies of small atomic subgraphs of arbitrary topology. This allows the for the generation of…

Statistics Theory · Mathematics 2021-04-21 Anatol E. Wegner , Sofia Olhede

Multivariate elliptically-contoured distributions are widely used for modeling correlated and non-Gaussian data. In this work, we study the kurtosis of the elliptical model, which is an important parameter in many statistical analysis.…

Statistics Theory · Mathematics 2024-08-23 Bowen Zhou , Peirong Xu , Cheng Wang

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, the standard form of the MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited…

Statistical Mechanics · Physics 2022-03-30 Pablo A. Morales , Fernando E. Rosas

Let $(\xi_n)_{n=0}^\infty$ be a nonhomogeneous Markov chain taking values from finite state-space of $\mathbf{X}=\{1,2,\ldots,b\}$. In this paper, we will study the generalized entropy ergodic theorem with almost-everywhere and…

Probability · Mathematics 2015-01-19 Zhongzhi Wang , Weiguo Yang

The paper addresses the problem of sampling discretization of integral norms of elements of finite-dimensional subspaces satisfying some conditions. We prove sampling discretization results under two standard kinds of assumptions --…

Numerical Analysis · Mathematics 2021-09-21 F. Dai , V. Temlyakov

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

Euclidean embeddings of data are fundamentally limited in their ability to capture latent semantic structures, which need not conform to Euclidean spatial assumptions. Here we consider an alternative, which embeds data as discrete…

Machine Learning · Computer Science 2019-05-10 Charlie Frogner , Farzaneh Mirzazadeh , Justin Solomon

This work gives a computable formula for the average measure theoretic entropy of a family of expanding on average random Blaschke products, generalizing work by Pujals, Roberts and Shub [Expanding maps of the circle revisited: positive…

Dynamical Systems · Mathematics 2025-05-16 Cecilia González-Tokman , Renee Oldfield

Recent years have seen the rise of convolutional neural network techniques in exemplar-based image synthesis. These methods often rely on the minimization of some variational formulation on the image space for which the minimizers are…

Statistics Theory · Mathematics 2019-12-05 Valentin De Bortoli , Agnes Desolneux , Alain Durmus , Bruno Galerne , Arthur Leclaire

High-dimensional data sets are commonly collected in many contemporary applications arising in various fields of scientific research. We present two views of finite samples in high dimensions: a probabilistic one and a nonprobabilistic one.…

Statistics Theory · Mathematics 2013-11-13 Jinchi Lv