English
Related papers

Related papers: Predicting rare events using neural networks and s…

200 papers

Estimating the probability of rare channel conditions is a central challenge in ultra-reliable wireless communication, where random events, such as deep fades, can cause sudden variations in the channel quality. This paper proposes a…

Signal Processing · Electrical Eng. & Systems 2024-07-08 Tobias Kallehauge , Anders E. Kalør , Pablo Ramírez-Espinosa , Christophe Biscio , Petar Popovski

The neural network-based approach to solving partial differential equations has attracted considerable attention due to its simplicity and flexibility in representing the solution of the partial differential equation. In training a neural…

Machine Learning · Computer Science 2022-01-10 Jihun Han , Yoonsang Lee

Rare events play a crucial role in many physics, chemistry, and biology phenomena, when they change the structure of the system, for instance in the case of multistability, or when they have a huge impact. Rare event algorithms have been…

Dynamical Systems · Mathematics 2022-08-24 Dario Lucente , Joran Rolland , Corentin Herbert , Freddy Bouchet

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space $\mathbb R^d$ and discrete time steps (i.e. a discrete-time $\mathbb…

Probability · Mathematics 2019-04-09 Krzysztof Bisewski , Daan Crommelin , Michel Mandjes

The ability to detect and classify rare occurrences in images has important applications - for example, counting rare and endangered species when studying biodiversity, or detecting infrequent traffic scenarios that pose a danger to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Sara Beery , Yang Liu , Dan Morris , Jim Piavis , Ashish Kapoor , Markus Meister , Neel Joshi , Pietro Perona

Neural marked temporal point processes have been a valuable addition to the existing toolbox of statistical parametric models for continuous-time event data. These models are useful for sequences where each event is associated with a single…

Machine Learning · Computer Science 2024-03-20 Yuxin Chang , Alex Boyd , Padhraic Smyth

We present a novel statistical inference framework for convex empirical risk minimization, using approximate stochastic Newton steps. The proposed algorithm is based on the notion of finite differences and allows the approximation of a…

Machine Learning · Computer Science 2019-02-06 Tianyang Li , Anastasios Kyrillidis , Liu Liu , Constantine Caramanis

We propose Echo State Networks (ESNs) to predict the statistics of extreme events in a turbulent flow. We train the ESNs on small datasets that lack information about the extreme events. We asses whether the networks are able to extrapolate…

Fluid Dynamics · Physics 2022-04-13 Alberto Racca , Luca Magri

Extreme weather events have significant consequences, dominating the impact of climate on society. While high-resolution weather models can forecast many types of extreme events on synoptic timescales, long-term climatological risk…

Atmospheric and Oceanic Physics · Physics 2023-01-25 Justin Finkel , Edwin P. Gerber , Dorian S. Abbot , Jonathan Weare

Combining the increasing availability and abundance of healthcare data and the current advances in machine learning methods have created renewed opportunities to improve clinical decision support systems. However, in healthcare risk…

Machine Learning · Statistics 2021-06-17 Zidi Xiu , Chenyang Tao , Michael Gao , Connor Davis , Benjamin A. Goldstein , Ricardo Henao

Although many computational methods for rare event sampling exist, this type of calculation is not usually practical for general nonequilibrium conditions, with macroscopically irreversible dynamics and away from both stationary and…

Mesoscale and Nanoscale Physics · Physics 2015-05-18 Joshua T. Berryman , Tanja Schilling

Computing the return times of extreme events and assessing the impact of climate change on such return times is fundamental to extreme event attribution studies. However, the rarity of such events in the observational record makes this task…

Atmospheric and Oceanic Physics · Physics 2024-12-03 Clément Le Priol , Joy M. Monteiro , Freddy Bouchet

Trajectory prediction of aerial vehicles is a key requirement in applications ranging from missile guidance to UAV collision avoidance. While most prediction methods assume deterministic target motion, real-world targets often exhibit…

Robotics · Computer Science 2025-12-19 Marc Schneider , Renato Loureiro , Torbjørn Cunis , Walter Fichter

In this paper we develop a perturbation method to predict the rate of occurrence of rare events for singularly perturbed stochastic systems using a probability density function approach. In contrast to a stochastic normal form approach, we…

Dynamical Systems · Mathematics 2015-06-16 Christoffer R. Heckman , Ira B. Schwartz

We exploit the relationship between the stochastic Koopman operator and the Kolmogorov backward equation to construct importance sampling schemes for stochastic differential equations. Specifically, we propose using eigenfunctions of the…

Computation · Statistics 2022-02-09 Benjamin Zhang , Tuhin Sahai , Youssef Marzouk

This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic…

Optimization and Control · Mathematics 2019-06-13 Ziyi Wang , Keuntaek Lee , Marcus A. Pereira , Ioannis Exarchos , Evangelos A. Theodorou

In this article, we investigate the existence of a deep neural network (DNN) capable of approximating solutions to partial integro-differential equations while circumventing the curse of dimensionality. Using the Feynman-Kac theorem, we…

Numerical Analysis · Mathematics 2025-01-22 Marcin Baranek

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for…

Machine Learning · Statistics 2018-04-20 Maziar Raissi

We calculate the probabilities to find systems of reacting particles in states which largely deviate from typical behavior. The rare event statistics is obtained from the master equation which describes the dynamics of the probability…

Statistical Mechanics · Physics 2019-08-02 Andreas Mühlbacher , Thomas Guhr