English
Related papers

Related papers: Deep Echo State Networks with Uncertainty Quantifi…

200 papers

Bayesian neural networks (BNNs) have been long considered an ideal, yet unscalable solution for improving the robustness and the predictive uncertainty of deep neural networks. While they could capture more accurately the posterior…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

To model time series accurately is important within a wide range of fields. As the world is generally too complex to be modelled exactly, it is often meaningful to assess the probability of a dynamical system to be in a specific state. This…

Machine Learning · Computer Science 2023-03-16 Mari Dahl Eggen , Alise Danielle Midtfjord

Deep learning-based support systems have demonstrated encouraging results in numerous clinical applications involving the processing of time series data. While such systems often are very accurate, they have no inherent mechanism for…

Machine Learning · Computer Science 2020-12-16 Kristoffer Wickstrøm , Karl Øyvind Mikalsen , Michael Kampffmeyer , Arthur Revhaug , Robert Jenssen

Learning in uncertain, noisy, or adversarial environments is a challenging task for deep neural networks (DNNs). We propose a new theoretically grounded and efficient approach for robust learning that builds upon Bayesian estimation and…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya , Lyudmila Mihaylova

The goal of this paper is to investigate the theoretical properties, the training algorithm, and the predictive control applications of Echo State Networks (ESNs), a particular kind of Recurrent Neural Networks. First, a condition…

Systems and Control · Computer Science 2019-02-06 Luca Bugliari Armenio , Enrico Terzi , Marcello Farina , Riccardo Scattolini

Quantifying uncertainty in weather forecasts is critical, especially for predicting extreme weather events. This is typically accomplished with ensemble prediction systems, which consist of many perturbed numerical weather simulations, or…

Machine Learning · Computer Science 2021-03-17 Peter Grönquist , Chengyuan Yao , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Shigang Li , Torsten Hoefler

An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate…

Dynamical Systems · Mathematics 2021-06-28 Allen G. Hart , Kevin R. Olding , A. M. G. Cox , Olga Isupova , J. H. P. Dawes

Power system state estimation (PSSE) is commonly formulated as weighted least-square (WLS) algorithm and solved using iterative methods such as Gauss-Newton methods. However, iterative methods have become more sensitive to system operating…

Systems and Control · Electrical Eng. & Systems 2021-01-12 Narayan Bhusal , Raj Mani Shukla , Mukesh Gautam , Mohammed Benidris , Shamik Sengupta

In the past decades, clean and renewable energy has gained increasing attention due to a global effort on carbon footprint reduction. In particular, Saudi Arabia is gradually shifting its energy portfolio from an exclusive use of oil to a…

Machine Learning · Statistics 2024-12-11 Kesen Wang , Minwoo Kim , Stefano Castruccio , Marc G. Genton

Regional rainfall forecasting is an important issue in hydrology and meteorology. This paper aims to design an integrated tool by applying various machine learning algorithms, especially the state-of-the-art deep learning algorithms…

Machine Learning · Computer Science 2021-03-30 Ning Yu , Timothy Haskins

A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained. In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and…

Dynamical Systems · Mathematics 2021-12-28 Allen G Hart

We propose a numerical method for discovering unknown parameterized dynamical systems by using observational data of the state variables. Our method is built upon and extends the recent work of discovering unknown dynamical systems, in…

Numerical Analysis · Mathematics 2020-03-11 Tong Qin , Zhen Chen , John Jakeman , Dongbin Xiu

Effective quantification of uncertainty is an essential and still missing step towards a greater adoption of deep-learning approaches in different applications, including mission-critical ones. In particular, investigations on the…

Machine Learning · Computer Science 2023-04-14 Marco Forgione , Dario Piga

Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long time prediction of the evolution of the unknown system. Training a DNN with low…

Machine Learning · Computer Science 2022-12-28 Victor Churchill , Steve Manns , Zhen Chen , Dongbin Xiu

Dryland vegetation ecosystems are known to be susceptible to critical transitions between alternative stable states when subjected to external forcing. Such transitions are often discussed through the framework of bifurcation theory, but…

Computational Physics · Physics 2025-05-16 Daniel Dylewsky , Sonia Kéfi , Madhur Anand , Chris T. Bauch

This article introduces a robust hybrid method for solving supervised learning tasks, which uses the Echo State Network (ESN) model and the Particle Swarm Optimization (PSO) algorithm. An ESN is a Recurrent Neural Network with the…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Sebastián Basterrech , Enrique Alba , Václav Snášel

Time series with long-term structure arise in a variety of contexts and capturing this temporal structure is a critical challenge in time series analysis for both inference and forecasting settings. Traditionally, state space models have…

Machine Learning · Statistics 2020-06-12 Anna K. Yanchenko , Sayan Mukherjee

The notion of an Evolutional Deep Neural Network (EDNN) is introduced for the solution of partial differential equations (PDE). The parameters of the network are trained to represent the initial state of the system only, and are…

Computational Physics · Physics 2021-10-13 Yifan Du , Tamer A. Zaki

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach,…

Machine Learning · Statistics 2026-01-09 James Rice

The 2022 National Defense Strategy of the United States listed climate change as a serious threat to national security. Climate intervention methods, such as stratospheric aerosol injection, have been proposed as mitigation strategies, but…

Machine Learning · Statistics 2023-10-13 Katherine Goode , Daniel Ries , Kellie McClernon