English
Related papers

Related papers: Marginalize, Rather than Impute: Probabilistic Win…

200 papers

Machine learning models (e.g., neural networks) achieve high accuracy in wind power forecasting, but they are usually regarded as black boxes that lack interpretability. To address this issue, the paper proposes a glass-box approach that…

Machine Learning · Computer Science 2024-02-27 Wenlong Liao , Fernando Porte-Agel , Jiannong Fang , Birgitte Bak-Jensen , Guangchun Ruan , Zhe Yang

Inference problems with incomplete observations often aim at estimating population properties of unobserved quantities. One simple way to accomplish this estimation is to impute the unobserved quantities of interest at the individual level…

Methodology · Statistics 2012-10-16 Vladimir N. Minin , John D. O'Brien , Arseni Seregin

Building the conditional probability distribution of wind power forecast errors benefits both wind farms (WFs) and independent system operators (ISOs). Establishing the joint probability distribution of wind power and the corresponding…

Machine Learning · Computer Science 2020-03-03 Mengshuo Jia , Shaowei Huang , Zhiwen Wang , Chen Shen

Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques to produce improve localized forecasts, by including additional observations, or determining systematic…

Precipitation data collected at sub-hourly resolution represents specific challenges for missing data recovery by being largely stochastic in nature and highly unbalanced in the duration of rain vs non-rain. Here we present a two-step…

Uncertainty analysis in the form of probabilistic forecasting can significantly improve decision making processes in the smart power grid when integrating renewable energy sources such as wind. Whereas point forecasting provides a single…

Signal Processing · Electrical Eng. & Systems 2019-09-27 Kostas Hatalis , Alberto J. Lamadrid , Katya Scheinberg , Shalinee Kishore

As climate change intensifies, the shift to cleaner energy sources becomes increasingly urgent. With wind energy production set to accelerate, reliable wind probabilistic forecasts are essential to ensure its efficient use. However, since…

Machine Learning · Computer Science 2024-10-08 Jean-Sébastien Giroux , Simon-Philippe Breton , Julie Carreau

Recently, there has been growing interest in the use of machine-learning methods for predicting solar flares. Initial efforts along these lines employed comparatively simple models, correlating features extracted from observations of…

Solar and Stellar Astrophysics · Physics 2023-06-21 Varad Deshmukh , Srinivas Baskar , Elizabeth Bradley , Thomas Berger , James D. Meiss

When estimating a regression model, we might have data where some labels are missing, or our data might be biased by a selection mechanism. When the response or selection mechanism is ignorable (i.e., independent of the response variable…

Statistics Theory · Mathematics 2023-08-22 Philip Boeken , Noud de Kroon , Mathijs de Jong , Joris M. Mooij , Onno Zoeter

The inferential models (IM) framework provides prior-free, frequency-calibrated, posterior probabilistic inference. The key is the use of random sets to predict unobservable auxiliary variables connected to the observable data and unknown…

Statistics Theory · Mathematics 2016-01-26 Ryan Martin , Chuanhai Liu

Atmospheric models used for weather and climate prediction are traditionally formulated in a deterministic manner. In other words, given a particular state of the resolved scale variables, the most likely forcing from the sub-grid scale…

Machine Learning · Computer Science 2024-02-16 Hannah M. Christensen , Salah Kouhen , Greta Miller , Raghul Parthipan

Clinical decision support using data mining techniques offers more intelligent way to reduce the decision error in the last few years. However, clinical datasets often suffer from high missingness, which adversely impacts the quality of…

Machine Learning · Computer Science 2020-11-20 Xuetong Wu , Hadi Akbarzadeh Khorshidi , Uwe Aickelin , Zobaida Edib , Michelle Peate

Learning representations of data, and in particular learning features for a subsequent prediction task, has been a fruitful area of research delivering impressive empirical results in recent years. However, relatively little is understood…

Machine Learning · Computer Science 2016-11-11 Daniel McNamara , Cheng Soon Ong , Robert C. Williamson

Missing data is an important problem in machine learning practice. Starting from the premise that imputation methods should preserve the causal structure of the data, we develop a regularization scheme that encourages any baseline…

Machine Learning · Computer Science 2021-11-08 Trent Kyono , Yao Zhang , Alexis Bellot , Mihaela van der Schaar

Wind energy is the leading non-hydro renewable technology. Increasing reliability is a key factor in reducing the downtime of high-power wind turbines installed in remote off-shore places, where maintenance is costly and less reactive.…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Alessio Dallabona , Mogens Blanke , Henrik C. Pedersen , Dimitrios Papageorgiou

Accurate aircraft trajectory prediction (TP) in air traffic management systems is confounded by a number of epistemic uncertainties, dominated by uncertain meteorological conditions and operator specific procedures. Handling this…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Amy Hodgkin , Nick Pepper , Marc Thomas

Time-series forecasting plays an important role in many domains. Boosted by the advances in Deep Learning algorithms, it has for instance been used to predict wind power for eolic energy production, stock market fluctuations, or motor…

Machine Learning · Computer Science 2021-07-23 Luis P. Silvestrin , Leonardos Pantiskas , Mark Hoogendoorn

We consider multi-task regression models where the observations are assumed to be a linear combination of several latent node functions and weight functions, which are both drawn from Gaussian process priors. Driven by the problem of…

Machine Learning · Statistics 2018-12-05 Astrid Dahl , Edwin V. Bonilla

Nonparametric and machine learning methods are flexible methods for obtaining accurate predictions. Nowadays, data sets with a large number of predictors and complex structures are fairly common. In the presence of item nonresponse,…

Methodology · Statistics 2022-08-23 Mehdi Dagdoug , Camelia Goga , David Haziza

Evaluation of treatment effects and more general estimands is typically achieved via parametric modelling, which is unsatisfactory since model misspecification is likely. Data-adaptive model building (e.g. statistical/machine learning) is…

Statistics Theory · Mathematics 2022-01-14 Oliver Hines , Oliver Dukes , Karla Diaz-Ordaz , Stijn Vansteelandt