English
Related papers

Related papers: A note on convergence of the equi-energy sampler

200 papers

In this paper, we quantify the impact of using non-convergent Markov chains to train Energy-Based models (EBMs). In particular, we show analytically that EBMs trained with non-persistent short runs to estimate the gradient can perfectly…

Machine Learning · Computer Science 2026-05-07 Elisabeth Agoritsas , Giovanni Catania , Aurélien Decelle , Beatriz Seoane

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

High-dimensional count data poses significant challenges for statistical analysis, necessitating effective methods that also preserve explainability. We focus on a low rank constrained variant of the Poisson log-normal model, which relates…

Optimization and Control · Mathematics 2025-06-17 Bastien Batardière , Julien Chiquet , Joon Kwon , Julien Stoehr

In engineering, it is a common desire to couple existing simulation tools together into one big system by passing information from subsystems as parameters into the subsystems under influence. As executed at fixed time points, this data…

Numerical Analysis · Mathematics 2017-04-25 Thilo Moshagen

In this paper, quantitative central limit theorems for $U$-statistics on the $q$-dimensional torus defined in the framework of the two-sample problem for Poisson processes are derived. In particular, the $U$-statistics are built over tight…

Probability · Mathematics 2016-04-06 Solesne Bourguin , Claudio Durastanti

The Expectation Maximisation (EM) algorithm is widely used to optimise non-convex likelihood functions with latent variables. Many authors modified its simple design to fit more specific situations. For instance, the Expectation (E) step…

Statistics Theory · Mathematics 2022-05-03 Thomas Lartigue , Stanley Durrleman , Stéphanie Allassonnière

The Effective Sample Size (ESS) and Integrated Autocorrelation Time (IACT) are two popular criteria for comparing Markov Chain Monte Carlo (MCMC) algorithms and detecting their convergence. Our goal is to assess those two quantities in the…

Methodology · Statistics 2024-08-27 Lucas Seiffert , Felipe Pereira

Modeling data with multivariate count responses is a challenging problem due to the discrete nature of the responses. Existing methods for univariate count responses cannot be easily extended to the multivariate case since the dependency…

Methodology · Statistics 2016-08-15 Hao Wu , Xinwei Deng , Naren Ramakrishnan

Motivated by the recent contribution \cite{BB17} we study the scaling limit behavior of a class of one-dimensional stochastic differential equations which has a unique attracting point subject to a small additional repulsive perturbation.…

Mathematical Physics · Physics 2019-06-26 Martin Kolb , Matthias Liesenfeld

Motivated, in part, by the desire to develop an information-theoretic foundation for compound Poisson approximation limit theorems (analogous to the corresponding developments for the central limit theorem and for simple Poisson…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

Labelling data is a major practical bottleneck in training and testing classifiers. Given a collection of unlabelled data points, we address how to select which subset to label to best estimate test metrics such as accuracy, $F_1$ score or…

Machine Learning · Computer Science 2021-09-27 Emine Yilmaz , Peter Hayes , Raza Habib , Jordan Burgess , David Barber

We perform an error analysis for numerical approximation methods of continuous time Markov chain models commonly found in the chemistry and biochemistry literature. The motivation for the analysis is to be able to compare the accuracy of…

Probability · Mathematics 2012-02-15 David F. Anderson , Arnab Ganguly , Thomas G. Kurtz

We provide explicit nonasymptotic estimates for the rate of convergence of empirical means of Markov chains, together with a Gaussian or exponential control on the deviations of empirical means. These estimates hold under a "positive…

Probability · Mathematics 2010-11-11 Aldéric Joulin , Yann Ollivier

Bayesian estimation is increasingly popular for performing model based inference to support policymaking. These data are often collected from surveys under informative sampling designs where subject inclusion probabilities are designed to…

Methodology · Statistics 2018-07-13 Luis G. Leon-Novelo , Terrance D. Savitsky

Researchers in physical science aim to uncover universal features in strongly interacting many-body systems, often hidden in complicated observables like entanglement entropy (EE). The non-local nature of EE makes it challenging to compute…

Strongly Correlated Electrons · Physics 2025-04-22 Yuan Da Liao

In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is…

Computation · Statistics 2014-04-04 Randal Douc , Florian Maire , Jimmy Olsson

In Markov Chain Monte Carlo (MCMC) simulations, the thermal equilibria quantities are estimated by ensemble average over a sample set containing a large number of correlated samples. These samples are selected in accordance with the…

Data Analysis, Statistics and Probability · Physics 2015-01-08 J. Li , P. Vignal , S. Sun , V. M. Calo

We present an exact Monte Carlo algorithm designed to sample theories where the energy is a sum of many couplings of decreasing strength. Our algorithm, simplified from that of L. Lin et al. hep-lat/9905033, avoids the computation of almost…

High Energy Physics - Lattice · Physics 2009-10-31 T. Bakeyev , Ph. de Forcrand

In this paper we prove discrete to continuum convergence rates for Poisson Learning, a graph-based semi-supervised learning algorithm that is based on solving the graph Poisson equation with a source term consisting of a linear combination…

Analysis of PDEs · Mathematics 2024-07-10 Leon Bungert , Jeff Calder , Max Mihailescu , Kodjo Houssou , Amber Yuan

Many problems in machine learning and statistics involve nested expectations and thus do not permit conventional Monte Carlo (MC) estimation. For such problems, one must nest estimators, such that terms in an outer estimator themselves…

Computation · Statistics 2018-05-24 Tom Rainforth , Robert Cornish , Hongseok Yang , Andrew Warrington , Frank Wood