English
Related papers

Related papers: Air quality prediction using optimal neural networ…

200 papers

Ordinary stochastic neural networks mostly rely on the expected values of their weights to make predictions, whereas the induced noise is mostly used to capture the uncertainty, prevent overfitting and slightly boost the performance through…

Machine Learning · Statistics 2019-02-19 Kirill Neklyudov , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

Virtually every organism gathers information about its noisy environment and builds models from that data, mostly using neural networks. Here, we use stochastic thermodynamics to analyse the learning of a classification rule by a neural…

Statistical Mechanics · Physics 2017-01-31 Sebastian Goldt , Udo Seifert

Recent years have seen a surge in interest in building deep learning-based fully data-driven models for weather prediction. Such deep learning models if trained on observations can mitigate certain biases in current state-of-the-art weather…

Machine Learning · Computer Science 2022-05-11 Ashesh Chattopadhyay , Jaideep Pathak , Ebrahim Nabizadeh , Wahid Bhimji , Pedram Hassanzadeh

Most existing neural network-based approaches for solving stochastic optimal control problems using the associated backward dynamic programming principle rely on the ability to simulate the underlying state variables. However, in some…

Machine Learning · Statistics 2024-01-30 Christian Yeo

For many types of machine learning algorithms, one can compute the statistically `optimal' way to select training data. In this paper, we review how optimal data selection techniques have been used with feedforward neural networks. We then…

Artificial Intelligence · Computer Science 2014-11-17 D. A. Cohn , Z. Ghahramani , M. I. Jordan

The economic and social impact of poor air quality in towns and cities is increasingly being recognised, together with the need for effective ways of creating awareness of real-time air quality levels and their impact on human health. With…

Computers and Society · Computer Science 2019-01-21 Yuchao Zhou , Suparna De , Gideon Ewa , Charith Perera , Klaus Moessner

Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on…

Atmospheric and Oceanic Physics · Physics 2009-08-26 T. N. Palmer , F. J. Doblas-Reyes , A. Weisheimer , G. J. Shutts , J. Berner , J. M. Murphy

Numerous methods exist and were developed for global radiation forecasting. The two most popular types are the numerical weather predictions (NWP) and the predictions using stochastic approaches. We propose to compute a parameter noted…

Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such…

Machine Learning · Computer Science 2019-12-06 Peter Grönquist , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Luca Lavarini , Shigang Li , Torsten Hoefler

We consider a neural network with adapting synapses whose dynamics can be analitically computed. The model is made of $N$ neurons and each of them is connected to $K$ input neurons chosen at random in the network. The synapses are…

Disordered Systems and Neural Networks · Physics 2009-10-30 G. Lattanzi , G. Nardulli , G. Pasquariello , S. Stramaglia

Many modern applications of the artificial neural networks ensue large number of layers making traditional digital implementations increasingly complex. Optical neural networks offer parallel processing at high bandwidth, but have the…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Egor Manuylovich , Diego Argüello Ron , Morteza Kamalian-Kopae , Sergei Turitsyn

In this paper, we show that the recent integration of statistical models with deep recurrent neural networks provides a new way of formulating volatility (the degree of variation of time series) models that have been widely used in time…

Machine Learning · Computer Science 2018-12-06 Rui Luo , Weinan Zhang , Xiaojun Xu , Jun Wang

In this paper, we attempt to employ convolutional recurrent neural networks for weather temperature estimation using only image data. We study ambient temperature estimation based on deep neural networks in two scenarios a) estimating…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Wei-Ta Chu , Kai-Chia Ho , Ali Borji

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

Integrating measurements and historical data can enhance control systems through learning-based techniques, but ensuring performance and safety is challenging. Robust model predictive control strategies, like stochastic model predictive…

Systems and Control · Electrical Eng. & Systems 2023-03-28 J. Pohlodek , H. Alsmeier , B. Morabito , C. Schlauch , A. Savchenko , R. Findeisen

This paper considers the design of optimal resource allocation policies in wireless communication systems which are generically modeled as a functional optimization problem with stochastic constraints. These optimization problems have the…

Machine Learning · Computer Science 2022-02-08 Mark Eisen , Clark Zhang , Luiz F. O. Chamon , Daniel D. Lee , Alejandro Ribeiro

How to model distribution of sequential data, including but not limited to speech and human motions, is an important ongoing research problem. It has been demonstrated that model capacity can be significantly enhanced by introducing…

Machine Learning · Computer Science 2018-06-19 Guokun Lai , Bohan Li , Guoqing Zheng , Yiming Yang

We demonstrate the use of a probabilistic machine learning technique to develop stochastic parameterizations of atmospheric column-physics. After suitable preprocessing of NASA's Modern-Era Retrospective analysis for Research and…

Atmospheric and Oceanic Physics · Physics 2022-12-01 B. T. Nadiga , X. Sun , C. Nash

Given a set of empirical observations, conditional density estimation aims to capture the statistical relationship between a conditional variable $\mathbf{x}$ and a dependent variable $\mathbf{y}$ by modeling their conditional probability…

Machine Learning · Statistics 2019-04-16 Jonas Rothfuss , Fabio Ferreira , Simon Walther , Maxim Ulrich

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein