English
Related papers

Related papers: The Collusion of Memory and Nonlinearity in Stocha…

200 papers

Much is now known about the consistency of Bayesian updating on infinite-dimensional parameter spaces with independent or Markovian data. Necessary conditions for consistency include the prior putting enough weight on the correct…

Statistics Theory · Mathematics 2022-03-18 Cosma Rohilla Shalizi

This paper studies the performative prediction problem which optimizes a stochastic loss function with data distribution that depends on the decision variable. We consider a setting where the agent(s) provides samples adapted to the…

Optimization and Control · Mathematics 2021-10-05 Qiang Li , Hoi-To Wai

This paper studies continuous-time stochastic control problems whose controlled states are fully non-Markovian and depend on unknown model parameters. Such problems arise naturally in path-dependent stochastic differential equations,…

Machine Learning · Statistics 2026-05-29 Dorival Leão , Alberto Ohashi , Simone Scotti , Adolfo M. D da Silva

In this paper, we study asynchronous stochastic approximation algorithms without communication delays. Our main contribution is a stability proof for these algorithms that extends a method of Borkar and Meyn by accommodating more general…

Machine Learning · Computer Science 2024-08-15 Huizhen Yu , Yi Wan , Richard S. Sutton

This paper studies linear stochastic approximation (SA) algorithms and their application to multi-agent systems in engineering and sociology. As main contribution, we provide necessary and sufficient conditions for convergence of linear SA…

Optimization and Control · Mathematics 2018-09-07 Ge Chen , Xiaoming Duan , Wenjun Mei , Francesco Bullo

The classical Method of Successive Approximations (MSA) is an iterative method for solving stochastic control problems and is derived from Pontryagin's optimality principle. It is known that the MSA may fail to converge. Using careful…

Optimization and Control · Mathematics 2020-11-18 Bekzhan Kerimkulov , David Šiška , Łukasz Szpruch

Stochastic parameterisations deployed in models of the Earth system frequently invoke locality assumptions such as Markovianity or spatial locality. This work highlights the impact of such assumptions on predictive performance. Both in…

Dynamical Systems · Mathematics 2025-08-12 Martin T. Brolly

We examine the stability and qualitative dynamics of stochastic neuronal networks specified as multivariate nonlinear Hawkes processes and related point-process generalized linear models that incorporate both auto- and cross-history…

Disordered Systems and Neural Networks · Physics 2019-12-13 Dmitrii Todorov , Wilson Truccolo

This paper focuses on stochastic partial differential equations (SPDEs) under two-time-scale formulation. Distinct from the work in the existing literature, the systems are driven by $\alpha$-stable processes with $\alpha \in(1,2)$. In…

Statistics Theory · Mathematics 2016-09-30 Jianhai Bao , George Yin , Chenggui Yuan

We consider optimization algorithms that successively minimize simple Taylor-like models of the objective function. Methods of Gauss-Newton type for minimizing the composition of a convex function and a smooth map are common examples. Our…

Optimization and Control · Mathematics 2016-10-12 Dmitriy Drusvyatskiy , Alexander D. Ioffe , Adrian S. Lewis

Traditionally, stochastic approximation schemes for SVIs have relied on strong monotonicity and Lipschitzian properties of the underlying map. In contrast, we consider monotone stochastic variational inequality (SVI) problems where the…

Optimization and Control · Mathematics 2016-01-06 Farzad Yousefian , Angelia Nedić , Uday V. Shanbhag

Non-Markovian dynamics is central to quantum information processing, as memory effects strongly influence coherence preservation, metrology, and communication. In this work, we investigate the role of stochastic system--bath couplings in…

Quantum Physics · Physics 2025-09-17 Mehboob Rashid , Rayees A Mala , Saima Bashir , Muzaffar Qadir Lone

In this paper we address the convergence of stochastic approximation when the functions to be minimized are not convex and nonsmooth. We show that the "mean-limit" approach to the convergence which leads, for smooth problems, to the ODE…

Optimization and Control · Mathematics 2018-05-08 Szymon Majewski , Błażej Miasojedow , Eric Moulines

We introduce two models of consensus following a majority rule on time-evolving stochastic block models (SBM), in which the network evolution is Markovian or non-Markovian. Under the majority rule, in each round, each agent simultaneously…

Probability · Mathematics 2022-09-12 Haoyu Wang , Jiaheng Wei , Zhenyuan Zhang

Adam is a popular variant of stochastic gradient descent for finding a local minimizer of a function. In the constant stepsize regime, assuming that the objective function is differentiable and non-convex, we establish the convergence in…

Machine Learning · Statistics 2020-05-15 Anas Barakat , Pascal Bianchi

Stochastic optimization has found wide applications in minimizing objective functions in machine learning, which motivates a lot of theoretical studies to understand its practical success. Most of existing studies focus on the convergence…

Artificial Intelligence · Computer Science 2023-07-19 Yunwen Lei

In this paper, we develop the mathematical framework for filtering problems arising from biophysical applications where data is collected from confocal laser scanning microscopy recordings of the space-time evolution of intracellular wave…

Statistics Theory · Mathematics 2025-06-10 Jan Szalankiewicz , Cristina Martinez-Torres , Wilhelm Stannat

Time estimation is a fundamental task that underpins precision measurement, global navigation systems, financial markets, and the organisation of everyday life. Many biological processes also depend on time estimation by nanoscale clocks,…

We develop a stochastic approximation-type algorithm to solve finite state/action, infinite-horizon, risk-aware Markov decision processes. Our algorithm has two loops. The inner loop computes the risk by solving a stochastic saddle-point…

Optimization and Control · Mathematics 2019-12-05 Wenjie Huang , William B. Haskell

We investigate the role of noise in the phenomenon of stochastic synchronization of switching events in a rocked, overdamped bistable potential driven by white Gaussian noise, the archetype description of Stochastic Resonance. We present a…