English
Related papers

Related papers: Numerical computations of geometric ergodicity for…

200 papers

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

Machine Learning · Computer Science 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

We study a class of dynamical systems generated by random substitutions, which contains both intrinsically ergodic systems and instances with several measures of maximal entropy. In this class, we show that the measures of maximal entropy…

Dynamical Systems · Mathematics 2026-03-26 Philipp Gohlke , Andrew Mitchell

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and…

Machine Learning · Statistics 2024-09-09 Haoyu Jiang , Jason Xu

Stochastic differential equations (SDEs) offer powerful and accessible mathematical models for capturing both deterministic and probabilistic aspects of dynamic behavior across a wide range of physical, financial, and social systems.…

Statistics Theory · Mathematics 2026-02-17 Paromita Banerjee , Anirban Mondal

The horizontal dynamics of a bouncing ball interacting with an irregular surface is investigated and is found to demonstrate behavior analogous to a random walk. Its stochastic character is substantiated by the calculation of a permutation…

Physics Education · Physics 2025-09-15 Luiz Antonio Barreiro

An embedded selective recoupling method is proposed which is based on the idea of embedding the recently proposed deterministic selective recoupling scheme of Yamaguchi et al. [quant-ph/0411099] into a stochastic dynamical decoupling…

Quantum Physics · Physics 2007-05-23 O. Kern , G. Alber

We consider the unconstrained optimization problem whose objective function is composed of a smooth and a non-smooth conponents where the smooth component is the expectation a random function. This type of problem arises in some interesting…

Optimization and Control · Mathematics 2011-07-01 Qihang Lin , Xi Chen , Javier Pena

Convergence of a projected stochastic gradient algorithm is demonstrated for convex objective functionals with convex constraint sets in Hilbert spaces. In the convex case, the sequence of iterates ${u_n}$ converges weakly to a point in the…

Optimization and Control · Mathematics 2019-10-01 Caroline Geiersbach , Georg Pflug

In this paper, we examine a geometrical projection algorithm for statistical inference. The algorithm is based on Pythagorean relation and it is derivative-free as well as representation-free that is useful in nonparametric cases. We derive…

Machine Learning · Computer Science 2019-09-30 Shotaro Akaho , Hideitsu Hino , Noboru Murata

Deterministic simulations of the rate equations governing cluster dynamics in materials are limited by the number of equations to integrate. Stochastic simulations are limited by the high frequency of certain events. We propose a coupling…

Materials Science · Physics 2017-10-11 Pierre Terrier , Manuel Athènes , Thomas Jourdan , Gilles Adjanor , Gabriel Stoltz

We establish a rate of convergence of the two scale expansion (in the sense of homogenization theory) of the solution to a highly oscillatory elliptic partial differential equation with random coefficients that are a perturbation of…

Analysis of PDEs · Mathematics 2011-10-25 C. Le Bris , F. Legoll , F. Thomines

We consider parabolic PDEs with randomly switching boundary conditions. In order to analyze these random PDEs, we consider more general stochastic hybrid systems and prove convergence to, and properties of, a stationary distribution.…

Probability · Mathematics 2020-03-13 Sean D. Lawley , Jonathan C. Mattingly , Michael C. Reed

In this paper, we present a stochastic augmented Lagrangian approach on (possibly infinite-dimensional) Riemannian manifolds to solve stochastic optimization problems with a finite number of deterministic constraints.We investigate the…

Optimization and Control · Mathematics 2025-04-01 Caroline Geiersbach , Tim Suchan , Kathrin Welker

Porous and heterogeneous materials are found in many applications from composites, membranes, chemical reactors, and other engineered materials to biological matter and natural subsurface structures. In this work we propose an integrated…

Computational Physics · Physics 2019-09-15 Gianluca Boccardo , Eleonora Crevacore , Alberto Passalacqua , Matteo Icardi

Sharp asymptotic lower bounds of the expected quadratic variation of discretization error in stochastic integration are given. The theory relies on inequalities for the kurtosis and skewness of a general random variable which are themselves…

Probability · Mathematics 2012-04-04 Masaaki Fukasawa

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

We propose an efficient probabilistic method to solve a deterministic problem -- we present a randomized optimization approach that drastically reduces the enormous computational cost of optimizing designs under many load cases for both…

Optimization and Control · Mathematics 2017-10-11 Xiaojia Zhang , Eric de Sturler , Glaucio H. Paulino

We study the long time statistics of a two-dimensional Hamiltonian system in the presence of Gaussian white noise. While the original dynamics is known to exhibit finite time explosion, we demonstrate that under the impact of the stochastic…

Probability · Mathematics 2025-08-06 Hung D. Nguyen , Lekun Wang

We derive optimal-order homogenization rates for random nonlinear elliptic PDEs with monotone nonlinearity in the uniformly elliptic case. More precisely, for a random monotone operator on $\mathbb{R}^d$ with stationary law (i.e. spatially…

Analysis of PDEs · Mathematics 2021-01-01 Julian Fischer , Stefan Neukamm