English
Related papers

Related papers: Efficient shape-constrained inference for the auto…

200 papers

In order to sample from a given target distribution (often of Gibbs type), the Monte Carlo Markov chain method consists in constructing an ergodic Markov process whose invariant measure is the target distribution. By sampling the Markov…

Probability · Mathematics 2015-06-11 Luc Rey-Bellet , Kostantinos Spiliopoulos

Using the renewal approach we prove Bernstein-like inequalities for additive functionals of geometrically ergodic Markov chains, thus obtaining counterparts of inequalities for sums of independent random variables. The coefficient in the…

Probability · Mathematics 2020-03-18 Michał Lemańczyk

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

We consider the parameter estimation of Markov chain when the unknown transition matrix belongs to an exponential family of transition matrices. Then, we show that the sample mean of the generator of the exponential family is an…

Statistics Theory · Mathematics 2016-09-28 Masahito Hayashi , Shun Watanabe

In this article we focus on estimating the quadratic covariation of continuous semimartingales from discrete observations that take place at asynchronous observation times. The Hayashi-Yoshida estimator serves as synchronized realized…

Statistics Theory · Mathematics 2011-06-22 Markus Bibinger

We consider a unified framework of sequential change-point detection and hypothesis testing modeled by means of hidden Markov chains. One observes a sequence of random variables whose distributions are functionals of a hidden Markov chain.…

Optimization and Control · Mathematics 2013-12-13 Savas Dayanik , Kazutoshi Yamazaki

Stochastic optimization in learning and inference often relies on Markov chain Monte Carlo (MCMC) to approximate gradients when exact computation is intractable. However, finite-time MCMC estimators are biased, and reducing this bias…

Statistics Theory · Mathematics 2026-02-02 Antoine Godichon-Baggioni , Gabriel Lang , Sylvain Le Corff , Julien Stoehr , Sobihan Surendran

We present a new class of interacting Markov chain Monte Carlo algorithms for solving numerically discrete-time measure-valued equations. The associated stochastic processes belong to the class of self-interacting Markov chains. In contrast…

Probability · Mathematics 2010-09-30 Pierre Del Moral , Arnaud Doucet

The first aim of this paper is to introduce a class of Markov chains on $\mathbb{Z}_+$ which are discrete self-similar in the sense that their semigroups satisfy an invariance property expressed in terms of a discrete random dilation…

Probability · Mathematics 2022-03-08 Laurent Miclo , Pierre Patie , Rohan Sarkar

We study the convergence of random function iterations for finding an invariant measure of the corresponding Markov operator. We call the problem of finding such an invariant measure the stochastic fixed point problem. This generalizes…

Functional Analysis · Mathematics 2022-03-24 Neal Hermer , D. Russell Luke , Anja Sturm

Adaptive Monte Carlo methods can be viewed as implementations of Markov chains with infinite memory. We derive a general condition for the convergence of a Monte Carlo method whose history dependence is contained within the simulated…

Computational Physics · Physics 2007-05-23 David J. Earl , Michael W. Deem

When implementing Markov Chain Monte Carlo (MCMC) algorithms, perturbation caused by numerical errors is sometimes inevitable. This paper studies how perturbation of MCMC affects the convergence speed and Monte Carlo estimation accuracy.…

Computation · Statistics 2026-01-14 Tiangang Cui , Jing Dong , Ajay Jasra , Xin T. Tong

We consider a class of small-sample distribution estimators over noisy channels. Our estimators are designed for repetition channels, and rely on properties of the runs of the observed sequences. These runs are modeled via a special type of…

Information Theory · Computer Science 2012-02-07 Farzad Farnoud , Narayana P. Santhanam , Olgica Milenkovic

A desirable property of an autocovariance estimator is to be robust to the presence of additive outliers. It is well-known that the sample autocovariance, being based on moments, does not have this property. Hence, the use of an…

Statistics Theory · Mathematics 2009-12-24 Céline Lévy-Leduc , Hélène Boistard , Eric Moulines , Murad S. Taqqu , Valderio A. Reisen

MCMC methods are used in Bayesian statistics not only to sample from posterior distributions but also to estimate expectations. Underlying functions are most often defined on a continuous state space and can be unbounded. We consider a…

Methodology · Statistics 2009-07-29 Krzysztof Latuszynski , Blazej Miasojedow , Wojciech Niemiro

Artificial Neural Networks were recently shown to be an efficient representation of highly-entangled many-body quantum states. In practical applications, neural-network states inherit numerical schemes used in Variational Monte Carlo, most…

Disordered Systems and Neural Networks · Physics 2020-01-22 Or Sharir , Yoav Levine , Noam Wies , Giuseppe Carleo , Amnon Shashua

Markov chain Monte Carlo (MCMC) produces a correlated sample for estimating expectations with respect to a target distribution. A fundamental question is when should sampling stop so that we have good estimates of the desired quantities?…

Statistics Theory · Mathematics 2017-10-02 Dootika Vats , James M. Flegal , Galin L. Jones

We present a new way of converting a reversible finite Markov chain into a non-reversible one, with a theoretical guarantee that the asymptotic variance of the MCMC estimator based on the non-reversible chain is reduced. The method is…

Methodology · Statistics 2012-09-27 Yi Sun , Faustino Gomez , Juergen Schmidhuber

A finite ergodic Markov chain exhibits cutoff if its distance to equilibrium remains close to its initial value over a certain number of iterations and then abruptly drops to near 0 on a much shorter time scale. Originally discovered in the…

Probability · Mathematics 2018-01-23 Charles Bordenave , Pietro Caputo , Justin Salez

We consider covariance asymptotics for linear statistics of general stationary random measures in terms of their truncated pair correlation measure. We give exact infinite series-expansion formulas for covariance of smooth statistics of…

Probability · Mathematics 2024-11-14 Manjunath Krishnapur , D. Yogeshwaran