English
Related papers

Related papers: The ODE Method and Spectral Theory of Markov Opera…

200 papers

Effectively modeling phenomena present in highly nonlinear dynamical systems whilst also accurately quantifying uncertainty is a challenging task, which often requires problem-specific techniques. We present a novel, domain-agnostic…

Machine Learning · Statistics 2021-10-26 Thomas M. McDonald , Mauricio A. Álvarez

Logistic regression is a well-known statistical model which is commonly used in the situation where the output is a binary random variable. It has a wide range of applications including machine learning, public health, social sciences,…

Statistics Theory · Mathematics 2019-04-18 Bernard Bercu , Antoine Godichon-Baggioni , Bruno Portier

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

We present the observation that the process of stochastic model predictive control can be formulated in the framework of iterated function systems. The latter has a rich ergodic theory that can be applied to study the system's long-run…

Optimization and Control · Mathematics 2022-10-14 Vyacheslav Kungurtsev , Jakub Marecek , Robert Shorten

The discrete class algorithm presented in this paper is an efficient simulation tool for stochastic processes governed by a reasonably small set of transition rates. The algorithm is presented, its performance compared to prevailing methods…

Computational Physics · Physics 2008-02-03 Hans E. Plesser , Dietmar Wendt

We present a theoretical analysis of some popular adaptive Stochastic Gradient Descent (SGD) methods in the small learning rate regime. Using the stochastic modified equations framework introduced by Li et al., we derive effective…

Machine Learning · Statistics 2025-09-29 Luca Callisti , Marco Romito , Francesco Triggiano

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

We consider estimation procedures which are recursive in the sense that each successive estimator is obtained from the previous one by a simple adjustment. The model considered in the paper is very general as we do not impose any…

Statistics Theory · Mathematics 2007-05-23 Teo Sharia

For stochastic implicit Taylor methods that use an iterative scheme to compute their numerical solution, stochastic B--series and corresponding growth functions are constructed. From these, convergence results based on the order of the…

Numerical Analysis · Mathematics 2011-09-22 Kristian Debrabant , Anne Kværnø

We consider optimization algorithms that are open systems, that is, with external inputs and outputs. Such algorithms arise for instance, when analyzing the effect of noise or disturbance on an algorithm, or when an algorithm is part of…

Optimization and Control · Mathematics 2026-04-02 Jaap Eising , Florian Dörfler

This paper provides a general and abstract approach to approximate ergodic regimes of Markov and Feller processes. More precisely, we show that the recursive algorithm presented in Lamberton & Pages (2002) and based on simulation algorithms…

Probability · Mathematics 2018-01-17 Gilles Pagès , Clément Rey

We investigate the Randomized Stochastic Accelerated Gradient (RSAG) method, utilizing either constant or adaptive step sizes, for stochastic optimization problems with generalized smooth objective functions. Under relaxed affine variance…

Optimization and Control · Mathematics 2025-02-25 Chenhao Yu , Yusu Hong , Junhong Lin

This paper studies the continuous-time dynamics of primal-dual algorithms for linearly constrained convex optimization problems and provides a quantitative convergence analysis using the Lyapunov functions. With the growing prevalence of…

Optimization and Control · Mathematics 2026-05-26 Chise Ishii , Yasushi Narushima

We introduce a linear-scaling stochastic method to compute real-space maps of any positive local spectral operator in a tight-binding model. By employing positive-definite estimators, the sampling error at each site can be rigorously…

Disordered Systems and Neural Networks · Physics 2025-11-18 H. P. Veiga , D. R. Pinheiro , J. P. Santos Pires , J. M. Viana Parente Lopes

We consider a class of dissipative stochastic differential equations (SDE's) with time-periodic coefficients in finite dimension, and the response of time-asymptotic probability measures induced by such SDE's to sufficiently regular, small…

Probability · Mathematics 2022-01-04 Michal Branicki , Kenneth Uda

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

The theoretical base of the research of occupational injuries is the idea of the process as Markov chain of random variables. However the exact proof of this position was not carried out whereas the experimental passing of the hypothesis is…

Applications · Statistics 2015-03-17 Boris A. Zyryanov

A useful sampling-reconstruction model should be stable with respect to different kind of small perturbations, regardless whether they result from jitter, measurement errors, or simply from a small change in the model assumptions. In this…

General Mathematics · Mathematics 2007-05-31 E. costa-Reyes , A. Aldroubi , I. Krishtal

Modal regression, a widely used regression protocol, has been extensively investigated in statistical and machine learning communities due to its robustness to outliers and heavy-tailed noises. Understanding modal regression's theoretical…

Machine Learning · Statistics 2022-03-15 Tielang Gong , Yuxin Dong , Hong Chen , Bo Dong , Wei Feng , Chen Li