English
Related papers

Related papers: Complexity Results for MCMC derived from Quantitat…

200 papers

We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system…

Probability · Mathematics 2020-12-04 Attila Lovas , Miklós Rásonyi

This paper considers stochastic-constrained stochastic optimization where the stochastic constraint is to satisfy that the expectation of a random function is below a certain threshold. In particular, we study the setting where data samples…

Optimization and Control · Mathematics 2026-01-27 Yeongjong Kim , Dabeen Lee

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

Motivated by applications to the dynamic control of queueing networks, we develop a simulation-based scheme, the so-called multilevel Picard (MLP) approximation, for solving high-dimensional drift control problems whose states are…

Optimization and Control · Mathematics 2025-10-27 Yuan Zhong

Inference is typically intractable in high-treewidth undirected graphical models, making maximum likelihood learning a challenge. One way to overcome this is to restrict parameters to a tractable set, most typically the set of…

Machine Learning · Computer Science 2015-11-02 Justin Domke

Introducing inequality constraints in Gaussian process (GP) models can lead to more realistic uncertainties in learning a great variety of real-world problems. We consider the finite-dimensional Gaussian approach from Maatouk and Bay (2017)…

Machine Learning · Statistics 2021-11-04 Andrés F. López-Lopera , François Bachoc , Nicolas Durrande , Olivier Roustant

We study Gibbs partition models, also known as composition schemes. Our main results comprehensively describe their phase diagram, including a phase transition from the convergent case described in Stufler (2018, Random Structures \&…

Probability · Mathematics 2022-11-22 Benedikt Stufler

One-dimensional run-and-tumble processes may converge towards some localized non-equilibrium steady state when the two velocities and/or the two switching rates are space-dependent. A long dynamical trajectory can be then analyzed via the…

Statistical Mechanics · Physics 2021-08-23 Cecile Monthus

To avoid poor empirical performance in Metropolis-Hastings and other accept-reject-based algorithms practitioners often tune them by trial and error. Lower bounds on the convergence rate are developed in both total variation and Wasserstein…

Statistics Theory · Mathematics 2024-07-04 Austin Brown , Galin L. Jones

While several papers have investigated computationally and statistically efficient methods for learning Gaussian mixtures, precise minimax bounds for their statistical performance as well as fundamental limits in high-dimensional settings…

Machine Learning · Statistics 2013-06-11 Martin Azizyan , Aarti Singh , Larry Wasserman

The aim of this paper is to approximate a finite-state Markov process by another process with fewer states, called herein the approximating process. The approximation problem is formulated using two different methods. The first method,…

We generalise the coarse Ricci curvature method of Ollivier by considering the coarse Ricci curvature of multiple steps in the Markov chain. This implies new spectral bounds and concentration inequalities. We also extend this approach to…

Probability · Mathematics 2015-10-09 Daniel Paulin

We study the approximation of a (finite) continuous-time Markov chain by a Markov chain on a reduced state space, and we provide formal error bounds for the approximated transient distributions in the Wasserstein distance. These bounds…

Probability · Mathematics 2025-12-19 Fabian Michel

In this work we derive a lower bound for the minimum time required to implement a target unitary transformation through a classical time-dependent field in a closed quantum system. The bound depends on the target gate, the strength of the…

Quantum Physics · Physics 2017-11-22 Christian Arenz , Benjamin Russell , Daniel Burgarth , Herschel Rabitz

One of the most demanding calculations is to generate random samples from a specified probability distribution (usually with an unknown normalizing prefactor) in a high-dimensional configuration space. One often has to resort to using a…

Computational Physics · Physics 2015-06-18 Youhan Fang , Jesus-Maria Sanz-Serna , Robert D. Skeel

Model Predictive Control (MPC) is a successful control methodology, which is applied to increasingly complex systems. However, real-time feasibility of MPC can be challenging for complex systems, certainly when an (extremely) large number…

Systems and Control · Electrical Eng. & Systems 2024-10-25 S. A. N. Nouwens , B. de Jager , M. M. Paulides , W. P. M. H. Heemels

The "drift-and-minorization" method, introduced and popularized in (Rosenthal, 1995; Meyn and Tweedie, 1994; Meyn and Tweedie, 2012), remains the most popular approach for bounding the convergence rates of Markov chains used in statistical…

Probability · Mathematics 2020-06-02 Robert M. Anderson , Haosui Duanmu , Aaron Smith , Jun Yang

We study control variate methods for Markov chain Monte Carlo (MCMC) in the setting of deterministic sweep sampling using $K\geq 2$ transition kernels. New variance reduction results are provided for MCMC averages based on sweeps over…

Statistics Theory · Mathematics 2019-12-17 Stephen Berg , Jun Zhu , Murray K. Clayton

Stochastic gradient Markov Chain Monte Carlo (SG-MCMC) has been developed as a flexible family of scalable Bayesian sampling algorithms. However, there has been little theoretical analysis of the impact of minibatch size to the algorithm's…

Machine Learning · Statistics 2017-09-06 Changyou Chen , Wenlin Wang , Yizhe Zhang , Qinliang Su , Lawrence Carin

Verifying uniform conditions over continuous spaces through random sampling is fundamental in machine learning and control theory, yet classical coverage analyses often yield conservative bounds, particularly at small failure probabilities.…

Machine Learning · Computer Science 2025-12-15 Lyu Yuhuan