English
Related papers

Related papers: Propagating Uncertainty through the tanh Function …

200 papers

Echo-state networks are simple models of discrete dynamical systems driven by a time series. By selecting network parameters such that the dynamics of the network is contractive, characterized by a negative maximal Lyapunov exponent, the…

Machine Learning · Computer Science 2022-12-06 L. Storm , K. Gustavsson , B. Mehlig

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Machine Learning · Computer Science 2021-02-24 Janis Postels , Hermann Blum , Yannick Strümpler , Cesar Cadena , Roland Siegwart , Luc Van Gool , Federico Tombari

Echo State Networks (ESNs) are recurrent neural networks usually employed for modeling nonlinear dynamic systems with relatively ease of training. By incorporating physical laws into the training of ESNs, Physics-Informed ESNs (PI-ESNs)…

Machine Learning · Computer Science 2025-02-05 Eric Mochiutti , Eric Aislan Antonelo , Eduardo Camponogara

Each year a growing number of wind farms are being added to power grids to generate electricity. The power curve of a wind turbine, which exhibits the relationship between generated power and wind speed, plays a major role in assessing the…

Neural and Evolutionary Computing · Computer Science 2021-06-10 Farzad Karami , Nasser Kehtarnavaz , Mario Rotea

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

Due to the inherent aleatory uncertainties in renewable generators, the reliability/adequacy assessments of distributed generation (DG) systems have been particularly focused on the probabilistic modeling of random behaviors, given…

Performance · Computer Science 2012-06-07 Yanfu Li , Enrico Zio

Polynomial chaos based methods enable the efficient computation of output variability in the presence of input uncertainty in complex models. Consequently, they have been used extensively for propagating uncertainty through a wide variety…

Optimization and Control · Mathematics 2020-09-18 Tuhin Sahai

Recurrent neural network based solutions are increasingly being used in the analysis of longitudinal Electronic Health Record data. However, most works focus on prediction accuracy and neglect prediction uncertainty. We propose Deep Kernel…

Machine Learning · Computer Science 2021-07-27 Zhiliang Wu , Yinchong Yang , Peter A. Fasching , Volker Tresp

The increase in renewable energy sources (RESs), like wind or solar power, results in growing uncertainty also in transmission grids. This affects grid stability through fluctuating energy supply and an increased probability of overloaded…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Rebecca Bauer , Tillmann Mühlpfordt , Nicole Ludwig , Veit Hagenmeyer

Chance-constrained motion planning requires uncertainty in dynamics to be propagated into uncertainty in state. When nonlinear models are used, Gaussian assumptions on the state distribution do not necessarily apply since almost all random…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Allen Wang , Ashkan Jasour , Brian Williams

We propose a feed-forward inference method applicable to belief and neural networks. In a belief network, the method estimates an approximate factorized posterior of all hidden units given the input. In neural networks the method propagates…

Machine Learning · Statistics 2018-11-02 Alexander Shekhovtsov , Boris Flach , Michal Busta

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

As a neural network's depth increases, it can improve generalization performance. However, training deep networks is challenging due to gradient and signal propagation issues. To address these challenges, extensive theoretical research and…

Machine Learning · Computer Science 2025-03-04 Hyunwoo Lee , Hayoung Choi , Hyunju Kim

A recurrent neural network (RNN) possesses the echo state property (ESP) if, for a given input sequence, it ``forgets'' any internal states of the driven (nonautonomous) system and asymptotically follows a unique, possibly complex…

Dynamical Systems · Mathematics 2020-06-26 Andrea Ceni , Peter Ashwin , Lorenzo Livi , Claire Postlethwaite

We report about probabilistic likelihood estimates that are performed on time series using an echo state network with orthogonal recurrent connectivity. The results from tests using synthetic stochastic input time series with temporal…

Neural and Evolutionary Computing · Computer Science 2017-06-14 Norbert Michael Mayer , Ying-Hao Yu

This paper presents a novel Wasserstein distributionally robust control and state estimation algorithm for partially observable linear stochastic systems, where the probability distributions of disturbances and measurement noises are…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

The lack of transparency of Deep Neural Networks continues to be a limitation that severely undermines their reliability and usage in high-stakes applications. Promising approaches to overcome such limitations are Prototype-Based…

Machine Learning · Computer Science 2025-07-21 Jon Vadillo , Roberto Santana , Jose A. Lozano , Marta Kwiatkowska

This paper presents a tensor-recovery method to solve probabilistic power flow problems. Our approach generates a high-dimensional and sparse generalized polynomial-chaos expansion that provides useful statistical information. The result…

Computational Engineering, Finance, and Science · Computer Science 2015-08-12 Zheng Zhang , Hung Dinh Nguyen , Konstantin Turitsyn , Luca Daniel

Many real-world systems are characterized by stochastic dynamical rules where a complex network of interactions among individual elements probabilistically determines their state. Even with full knowledge of the network structure and of the…

Physics and Society · Physics 2018-05-15 Filippo Radicchi , Claudio Castellano

Conventional predictive Artificial Neural Networks (ANNs) commonly employ deterministic weight matrices; therefore, their prediction is a point estimate. Such a deterministic nature in ANNs causes the limitations of using ANNs for medical…

Machine Learning · Computer Science 2020-07-02 Minhyeok Lee , Junhee Seok