English
Related papers

Related papers: On the convergence, lock-in probability and sample…

200 papers

In large-data applications, such as the inference process of diffusion models, it is desirable to design sampling algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of sampling, which is the…

Data Structures and Algorithms · Computer Science 2025-05-21 Huanjian Zhou , Baoxiang Wang , Masashi Sugiyama

In the context of infinitesimal strain plasticity with hardening, we derive a stochastic homogenization result. We assume that the coefficients of the equation are random functions: elasticity tensor, hardening parameter and flow-rule…

Analysis of PDEs · Mathematics 2016-04-11 M. Heida , B. Schweizer

Algorithms based on the hard thresholding principle have been well studied with sounding theoretical guarantees in the compressed sensing and more general sparsity-constrained optimization. It is widely observed in existing empirical…

Optimization and Control · Mathematics 2021-11-17 Shenglong Zhou , Naihua Xiu , Hou-Duo Qi

The asymptotic behavior of stochastic gradient algorithms is studied. Relying on results from differential geometry (Lojasiewicz gradient inequality), the single limit-point convergence of the algorithm iterates is demonstrated and…

Optimization and Control · Mathematics 2013-09-19 Vladislav B. Tadic

We consider a family of parallel methods for constrained optimization based on projected gradient descents along individual coordinate directions. In the case of polyhedral feasible sets, local convergence towards a regular solution occurs…

Optimization and Control · Mathematics 2015-09-18 Olivier Bilenne

We present bounds for the finite sample error of sequential Monte Carlo samplers on static spaces. Our approach explicitly relates the performance of the algorithm to properties of the chosen sequence of distributions and mixing properties…

Computation · Statistics 2022-08-19 Joe Marion , Joseph Mathews , Scott C. Schmidler

This manuscript presents an innovative framework for constructing barrier functions to bound reachability probabilities for continuous-time stochastic systems described by stochastic differential equations (SDEs). The reachability…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Bai Xue

Stochastic non-smooth convex optimization constitutes a class of problems in machine learning and operations research. This paper considers minimization of a non-smooth function based on stochastic subgradients. When the function has a…

Optimization and Control · Mathematics 2016-07-12 Sucha Supittayapornpong , Michael J. Neely

The methods of the probability theory have been used in order to build up a new model of hysteresis. It turns out that the reversal points of the control parameter (e. g., the magnetic field) are Markov points which determine the stochastic…

Statistical Mechanics · Physics 2009-10-31 L. Pal

Computing the probability of evidence even with known error bounds is NP-hard. In this paper we address this hard problem by settling on an easier problem. We propose an approximation which provides high confidence lower bounds on…

Artificial Intelligence · Computer Science 2012-06-26 Vibhav Gogate , Bozhena Bidyuk , Rina Dechter

Almost sure reachability refers to the property of a stochastic system whereby, from any initial condition, the system state reaches a given target set with probability one. In this paper, we study the problem of certifying almost sure…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Arash Bahari Kordabad , Rupak Majumdar , Harshit Jitendra Motwani , Sadegh Soudjani

We consider stochastic approximations which arise from such applications as data communications and image processing. We demonstrate why constraints are needed in a stochastic approximation and how a constrained approximation can be…

Numerical Analysis · Mathematics 2015-09-01 Hong Jiang , Gang Huang , Paul Wilford , Liangkai Yu

Stochastic approximation is a class of algorithms that update a vector iteratively, incrementally, and stochastically, including, e.g., stochastic gradient descent and temporal difference learning. One fundamental challenge in analyzing a…

Machine Learning · Computer Science 2025-11-06 Shuze Daniel Liu , Shuhang Chen , Shangtong Zhang

Stochastic approximation (SA) with multiple coupled sequences has found broad applications in machine learning such as bilevel learning and reinforcement learning (RL). In this paper, we study the finite-time convergence of nonlinear SA…

Machine Learning · Computer Science 2022-06-22 Han Shen , Tianyi Chen

We consider convex hulls of random walks whose steps belong to the domain of attraction of a stable law in $\mathbb{R}^d$. We prove convergence of the convex hull in the space of all convex and compact subsets of $\mathbb{R}^d$, equipped…

Probability · Mathematics 2022-02-28 Wojciech Cygan , Nikola Sandrić , Stjepan Šebek

For one-dimensional simple random walk in a general i.i.d. scenery and its limiting process we construct a coupling with explicit rate of approximation extending a recent result for Gaussian sceneries due to Khoshnevisan and Lewis.…

Probability · Mathematics 2016-09-07 Endre Csáki , Wolfgang König , Zhan Shi

The performance of standard stochastic approximation implementations can vary significantly based on the choice of the steplength sequence, and in general, little guidance is provided about good choices. Motivated by this gap, in the first…

Optimization and Control · Mathematics 2015-03-19 Farzad Yousefian , Angelia Nedić , Uday V. Shanbhag

Temporal Point Processes (TPP) with partial likelihoods involving a latent structure often entail an intractable marginalization, thus making inference hard. We propose a novel approach to Maximum Likelihood Estimation (MLE) involving…

Machine Learning · Computer Science 2019-12-20 Amrith Setlur , Barnabás Póczós

We provide a general theorem on the asymptotic behavior of stochastic processes that conform to a relaxed supermartingale condition. The distinguishing feature of our result is that it provides quantitative convergence guarantees at a much…

Optimization and Control · Mathematics 2026-05-11 Morenikeji Neri , Nicholas Pischke , Thomas Powell

The region of attraction characterizes well-behaved and safe operation of a nonlinear system and is hence sought after for verification. In this paper, a framework for probabilistic region of attraction estimation is developed that combines…

Optimization and Control · Mathematics 2023-06-06 Torbjørn Cunis