English
Related papers

Related papers: Group-averaged Markov chains: mixing improvement

200 papers

It is a commonly held belief that enforcing invariance improves generalisation. Although this approach enjoys widespread popularity, it is only very recently that a rigorous theoretical demonstration of this benefit has been established. In…

Machine Learning · Statistics 2021-12-21 Bryn Elesedy

A common tool in the practice of Markov Chain Monte Carlo is to use approximating transition kernels to speed up computation when the desired kernel is slow to evaluate or intractable. A limited set of quantitative tools exist to assess the…

Probability · Mathematics 2026-01-14 Jeffrey Negrea , Jeffrey S. Rosenthal

We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently…

Probability · Mathematics 2018-08-22 Andreas Eberle , Mateusz B. Majka

Since 1997 a considerable effort has been spent to study the mixing time of switch Markov chains on the realizations of graphic degree sequences of simple graphs. Several results were proved on rapidly mixing Markov chains on unconstrained,…

We consider Markov chains on general state spaces in stationary random environment which are defined by a random mapping that is contractive up to a bounded perturbation. We prove their convergence to a limiting law, providing convergence…

Probability · Mathematics 2025-12-18 Attila Lovas , Miklós Rásonyi , Lionel Truquet

We study ergodic properties of some Markov chains models in random environments when the random Markov kernels that define the dynamic satisfy some usual drift and small set conditions but with random coefficients. In particular, we adapt a…

Probability · Mathematics 2021-08-16 Lionel Truquet

We propose the particle dual averaging (PDA) method, which generalizes the dual averaging method in convex optimization to the optimization over probability distributions with quantitative runtime guarantee. The algorithm consists of an…

Machine Learning · Statistics 2022-01-25 Atsushi Nitanda , Denny Wu , Taiji Suzuki

Graded posets frequently arise throughout combinatorics, where it is natural to try to count the number of elements of a fixed rank. These counting problems are often $\#\textbf{P}$-complete, so we consider approximation algorithms for…

Data Structures and Algorithms · Computer Science 2023-04-11 Prateek Bhakta , Ben Cousins , Matthew Fahrbach , Dana Randall

Stein importance sampling is a widely applicable technique based on kernelized Stein discrepancy, which corrects the output of approximate sampling algorithms by reweighting the empirical distribution of the samples. A general analysis of…

Statistics Theory · Mathematics 2021-09-14 Liam Hodgkinson , Robert Salomone , Fred Roosta

In our earlier paper, a generalized Dobrushin ergodicity coefficient of Markov operators (acting on abstract state spaces) with respect to a projection $P$, has been introduced and studied. It turned out that the introduced coefficient was…

Functional Analysis · Mathematics 2020-01-22 Farrukh Mukhamedov , Ahmed Al-Rawashdeh

Let $\mathscr{P}(E)$ be the space of probability measures on a measurable space $(E,\mathcal{E})$. In this paper we introduce a class of nonlinear Markov chain Monte Carlo (MCMC) methods for simulating from a probability measure…

Statistics Theory · Mathematics 2011-07-18 Christophe Andrieu , Ajay Jasra , Arnaud Doucet , Pierre Del Moral

The divergence of a group is a quasi-isometry invariant defined in terms of pairs of points and lengths of paths avoiding a suitable ball around the identity. In this paper we study "random divergence'', meaning the divergence at two points…

Group Theory · Mathematics 2023-03-20 Antoine Goldsborough , Alessandro Sisto

State estimation is a key ingredient in most robotic systems. Often, state estimation is performed using some form of least squares minimization. Basically, all error minimization procedures that work on real-world data use robust kernels…

Robotics · Computer Science 2021-02-19 Nived Chebrolu , Thomas Läbe , Olga Vysotska , Jens Behley , Cyrill Stachniss

Approximate Bayesian computation has emerged as a standard computational tool when dealing with the increasingly common scenario of completely intractable likelihood functions in Bayesian inference. We show that many common Markov chain…

Methodology · Statistics 2014-08-12 Anthony Lee , Krzysztof Latuszynski

Recent research has established sufficient conditions for finite mixture models to be identifiable from grouped observations. These conditions allow the mixture components to be nonparametric and have substantial (or even total) overlap.…

Machine Learning · Statistics 2020-06-16 Alexander Ritchie , Robert A. Vandermeulen , Clayton Scott

We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random…

Machine Learning · Computer Science 2015-12-07 Youssef Mroueh , Stephen Voinea , Tomaso Poggio

We present the class of Hida-Mat\'ern kernels, which is the canonical family of covariance functions over the entire space of stationary Gauss-Markov Processes. It extends upon Mat\'ern kernels, by allowing for flexible construction of…

Machine Learning · Statistics 2021-12-30 Matthew Dowling , Piotr Sokół , Il Memming Park

Let $G$ be a compact Lie group. Suppose $g_1, \dots, g_k$ are chosen independently from the Haar measure on $G$. Let $\mathcal{A} = \cup_{i \in [k]} \mathcal{A}_i$, where, $\mathcal{A}_i := \{g_i\} \cup \{g_i^{-1}\}$. Let…

Probability · Mathematics 2018-11-15 Hariharan Narayanan

This article analyses a new class of advanced particle Markov chain Monte Carlo algorithms recently introduced by Andrieu, Doucet, and Holenstein (2010). We present a natural interpretation of these methods in terms of well known…

Probability · Mathematics 2014-10-28 P. Del Moral , R. Kohn , F. Patras

We propose in this work a new family of kernels for variable-length time series. Our work builds upon the vector autoregressive (VAR) model for multivariate stochastic processes: given a multivariate time series x, we consider the…

Machine Learning · Statistics 2011-01-05 Marco Cuturi , Arnaud Doucet