English
Related papers

Related papers: Quantitative Weak Convergence for Discrete Stochas…

200 papers

Langevin diffusion is a commonly used tool for sampling from a given distribution. In this work, we establish that when the target density $p^*$ is such that $\log p^*$ is $L$ smooth and $m$ strongly convex, discrete Langevin diffusion…

Machine Learning · Statistics 2017-11-02 Xiang Cheng , Peter Bartlett

We study "the Wojcik model" which is a discrete-time quantum walk (QW) with one defect in one dimension, introduced by Wojcik et al.. For the Wojcik model, we give the weak convergence theorem describing the ballistic behavior of the walker…

Mathematical Physics · Physics 2016-02-09 Takako Endo , Norio Konno

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

Machine Learning · Statistics 2025-05-27 Yifeng Yu , Lu Yu

Recently there has been renewed interests in derivative free approaches to stochastic optimization. In this paper, we examine the rates of convergence for the Kiefer-Wolfowitz algorithm and the mirror descent algorithm, under various…

Optimization and Control · Mathematics 2016-10-31 Liyi Dai

Stochastic quantization in physics has been considered to provide a path integral representation of a probability distribution for Ito processes. It has been indicated that the stochastic quantization can involve a potential term, if the…

Systems and Control · Computer Science 2020-05-05 Masakazu Sano

The analysis in Part I revealed interesting properties for subgradient learning algorithms in the context of stochastic optimization when gradient noise is present. These algorithms are used when the risk functions are non-smooth and…

Optimization and Control · Mathematics 2017-04-21 Bicheng Ying , Ali H. Sayed

Researchers from different areas have independently defined extensions of the usual weak convergence of laws of stochastic processes with the goal of adequately accounting for the flow of information. Natural approaches are convergence of…

Probability · Mathematics 2025-01-27 Daniel Bartl , Mathias Beiglböck , Gudmund Pammer , Stefan Schrott , Xin Zhang

In this paper we show that the family P_d of probability distributions on R^d with log-concave densities satisfies a strong continuity condition. In particular, it turns out that weak convergence within this family entails (i) convergence…

Probability · Mathematics 2013-11-26 Dominic Schuhmacher , Andre Huesler , Lutz Duembgen

This article extends weak convergence bounds of Markov transition kernels to convergence bounds on the variance of the Markov kernel applied to Lipschitz functions. In the reversible case, weak convergence rates of the transition kernels…

Statistics Theory · Mathematics 2026-04-29 Austin Brown

The weak limit theorem (WLT), the quantum analogue of the central limit theorem, is foundational to quantum walk (QW) theory. Unlike the universal Gaussian limit of classical walks, deriving analytical forms of the limiting probability…

Mathematical Physics · Physics 2026-03-24 Keisuke Asahara , Daiju Funakawa , Motoki Seki , Akito Suzuki

In distribution compression, one aims to accurately summarize a probability distribution $\mathbb{P}$ using a small number of representative points. Near-optimal thinning procedures achieve this goal by sampling $n$ points from a Markov…

Machine Learning · Statistics 2022-10-19 Abhishek Shetty , Raaz Dwivedi , Lester Mackey

We first establish strong convergence rates for multiscale systems driven by $\alpha$-stable processes, with analyses constructed in two distinct scaling regimes. When addressing weak convergence rates of this system, we derive four…

Probability · Mathematics 2026-03-03 Kun Yin

We consider linear two-time-scale stochastic approximation algorithms driven by martingale noise. Recent applications in machine learning motivate the need to understand finite-time error rates, but conventional stochastic approximation…

Machine Learning · Computer Science 2025-12-12 Seo Taek Kong , Sihan Zeng , Thinh T. Doan , R. Srikant

Using lattice approximations of Euclidean space, we develop a way to approximate stable processes that are represented by stochastic integrals over Euclidean space. Via a stable version of the Lindeberg-Feller Theorem we show that the…

Probability · Mathematics 2013-02-19 Clément Dombry , Paul Jung

We provide tight finite-time convergence bounds for gradient descent and stochastic gradient descent on quadratic functions, when the gradients are delayed and reflect iterates from $\tau$ rounds ago. First, we show that without stochastic…

Optimization and Control · Mathematics 2018-06-28 Yossi Arjevani , Ohad Shamir , Nathan Srebro

Diffusion approximation provides weak approximation for stochastic gradient descent algorithms in a finite time horizon. In this paper, we introduce new tools motivated by the backward error analysis of numerical stochastic differential…

Machine Learning · Computer Science 2019-09-05 Yuanyuan Feng , Tingran Gao , Lei Li , Jian-Guo Liu , Yulong Lu

In this paper, we study the weak convergence of the extremes of supercritical branching L\'evy processes $\{\mathbb{X}_t, t \ge0\}$ whose spatial motions are L\'evy processes with regularly varying tails. The result is drastically different…

Probability · Mathematics 2022-10-13 Yan-Xia Ren , Renming Song , Rui Zhang

In this paper, we study the stochastic homogenization for a class of symmetric random walks in random conductance model, whose one-step transition probability from $x$ to $y$ is proportional to $|x-y|^{-d-2}$. As the associated jumping…

Probability · Mathematics 2026-04-24 Xin Chen , Chenlin Gu , Jian Wang

In this paper, we study the problem of sampling from a given probability density function that is known to be smooth and strongly log-concave. We analyze several methods of approximate sampling based on discretizations of the (highly…

Statistics Theory · Mathematics 2024-02-26 Arnak S. Dalalyan , Avetik G. Karagulyan

We study distributed optimization problems when $N$ nodes minimize the sum of their individual costs subject to a common vector variable. The costs are convex, have Lipschitz continuous gradient (with constant $L$), and bounded gradient. We…

Information Theory · Computer Science 2014-04-15 Dusan Jakovetic , Joao Xavier , Jose M. F. Moura