English
Related papers

Related papers: Computing large deviation prefactors of stochastic…

200 papers

We study wide Bayesian neural networks focusing on the rare but statistically dominant fluctuations that govern posterior concentration, beyond Gaussian-process limits. Large-deviation theory provides explicit variational objectives-rate…

Machine Learning · Statistics 2026-02-27 Katerina Papagiannouli , Dario Trevisan , Giuseppe Pio Zitto

We present a method to learn mean residence time and escape probability from data modeled by stochastic differential equations. This method is a combination of machine learning from data (to extract stochastic differential equations as…

Dynamical Systems · Mathematics 2019-10-02 Dengfeng Wu , Miaomiao Fu , Jinqiao Duan

We propose a computational method for large deviation statistics of time-averaged quantities in general Markov processes. In our proposed method, we repeat a response measurement against external forces, where the forces are determined by…

Statistical Mechanics · Physics 2014-03-12 Takahiro Nemoto , Shin-ichi Sasa

We consider systems of slow--fast diffusions with small noise in the slow component. We construct provably logarithmic asymptotically optimal importance schemes for the estimation of rare events based on the moderate deviations principle.…

Probability · Mathematics 2020-01-07 Matthew R. Morse , Konstantinos Spiliopoulos

We study the large deviation estimates for the short time asymptotic behavior of a strongly degenerate diffusion process. Assuming a nilpotent structure of the Lie algebra generated by the driving vector fields, we obtain a graded large…

Probability · Mathematics 2019-01-30 Gérard Ben Arous , Jing Wang

The large deviations analysis of solutions to stochastic differential equations and related processes is often based on approximation. The construction and justification of the approximations can be onerous, especially in the case where the…

Probability · Mathematics 2008-08-28 Amarjit Budhiraja , Paul Dupuis , Vasileios Maroulas

We analyse large deviations of time-averaged quantities in stochastic processes with long-range memory, where the dynamics at time t depends itself on the value q_t of the time-averaged quantity. First we consider the elephant random walk…

Statistical Mechanics · Physics 2020-08-05 Robert L. Jack , Rosemary J. Harris

We introduce and test a general machine-learning-based technique for the inference of short term causal dependence between state variables of an unknown dynamical system from time series measurements of its state variables. Our technique…

Adaptation and Self-Organizing Systems · Physics 2020-12-18 Amitava Banerjee , Jaideep Pathak , Rajarshi Roy , Juan G. Restrepo , Edward Ott

We introduce a method for learning the dynamics of complex nonlinear systems based on deep generative models over temporal segments of states and actions. Unlike dynamics models that operate over individual discrete timesteps, we learn the…

Machine Learning · Computer Science 2017-07-14 Nikhil Mishra , Pieter Abbeel , Igor Mordatch

Nonlinear and non-stationary processes are prevalent in various natural and physical phenomena, where system dynamics can change qualitatively due to bifurcation phenomena. Traditional machine learning methods have advanced our ability to…

Machine Learning · Statistics 2024-06-21 Keita Tokuda , Yuichi Katori

The ability to predict traffic flow over time for crowded areas during rush hours is increasingly important as it can help authorities make informed decisions for congestion mitigation or scheduling of infrastructure development in an area.…

Machine Learning · Computer Science 2023-04-03 Zann Koh , Yan Qin , Yong Liang Guan , Chau Yuen

Predicting extreme events in high-dimensional chaotic dynamical systems remains a fundamental challenge, as such events are rare, intermittent, and arise from transient dynamical mechanisms that are difficult to infer from limited…

Machine Learning · Computer Science 2026-03-12 Eirini Katsidoniotaki , Themistoklis P. Sapsis

The event of large losses plays an important role in credit risk. As these large losses are typically rare, and portfolios usually consist of a large number of positions, large deviation theory is the natural tool to analyze the tail…

Probability · Mathematics 2014-07-03 Vincent Leijdekker , Michel Mandjes , Peter Spreij

The dynamics of mechanical systems such as turbomachinery with multiple blades are often modeled by arrays of periodically driven coupled nonlinear oscillators. It is known that such systems may have multiple stable vibrational modes, and…

Chaotic Dynamics · Physics 2022-12-06 Lautaro Cilenti , Maria Cameron , Balakumar Balachandran

In many experimental situations, a physical system undergoes stochastic evolution which may be described via random maps between two compact spaces. In the current work, we study the applicability of large deviations theory to time-averaged…

Statistical Mechanics · Physics 2015-05-13 Vladimir Y. Chernyak , Michael Chertkov , Sergey V. Malinin , Razvan Teodorescu

We study the problem of predicting rare critical transition events for a class of slow-fast nonlinear dynamical systems. The state of the system of interest is described by a slow process, whereas a faster process drives its evolution and…

Computational Physics · Physics 2020-12-14 Soon Hoe Lim , Ludovico Theo Giorgini , Woosok Moon , J. S. Wettlaufer

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

Many real-world systems are characterized by stochastic dynamical rules where a complex network of interactions among individual elements probabilistically determines their state. Even with full knowledge of the network structure and of the…

Physics and Society · Physics 2018-05-15 Filippo Radicchi , Claudio Castellano

We study the Stochastic Gradient Descent (SGD) method in nonconvex optimization problems from the point of view of approximating diffusion processes. We prove rigorously that the diffusion process can approximate the SGD algorithm weakly…

Machine Learning · Statistics 2018-03-06 Wenqing Hu , Chris Junchi Li , Lei Li , Jian-Guo Liu

We explore the limit of stochastic differential equations driven by some random processes satisfying singularly perturbed second order stochastic differential equations. The main tool we employ is the universal limit theorem in rough path…

Probability · Mathematics 2026-04-08 Qingming Zhao , Xueru Liu , Wei Wang