English
Related papers

Related papers: Regularized Ensemble Forecasting for Learning Weig…

200 papers

A natural strategy for continual learning is to weigh a Bayesian ensemble of fixed functions. This suggests that if a (single) neural network could be interpreted as an ensemble, one could design effective algorithms that learn without…

Machine Learning · Computer Science 2025-02-28 Ari S. Benjamin , Christian Pehle , Kyle Daruwalla

Clustering ensemble, or consensus clustering, has emerged as a powerful tool for improving both the robustness and the stability of results from individual clustering methods. Weighted clustering ensemble arises naturally from clustering…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Mimi Zhang

We propose a generalised framework for the updating of a prior ensemble to a posterior ensemble, an essential yet challenging part in ensemble-based filtering methods. The proposed framework is based on a generalised and fully Bayesian view…

Methodology · Statistics 2021-03-29 Margrethe Kvale Loe , Håkon Tjelmeland

Time series forecasting is at the core of important application domains posing significant challenges to machine learning algorithms. Recently neural network architectures have been widely applied to the problem of time series forecasting.…

Machine Learning · Computer Science 2022-07-28 Chrysoula Kosma , Giannis Nikolentzos , Nancy Xu , Michalis Vazirgiannis

Data assimilation combines forecasts from a numerical model with observations. Most of the current data assimilation algorithms consider the model and observation error terms as additive Gaussian noise, specified by their covariance…

This paper presents a time series forecasting framework which combines standard forecasting methods and a machine learning model. The inputs to the machine learning model are not lagged values or regular time series features, but instead…

Machine Learning · Statistics 2020-01-15 Shi Zhao , Ying Feng

In many machine learning tasks, models are trained to predict structure data such as graphs. For example, in natural language processing, it is very common to parse texts into dependency trees or abstract meaning representation (AMR)…

Computation and Language · Computer Science 2022-01-25 Hoang Thanh Lam , Gabriele Picco , Yufang Hou , Young-Suk Lee , Lam M. Nguyen , Dzung T. Phan , Vanessa López , Ramon Fernandez Astudillo

A well-established insight in mortality forecasting is that combining predictions from a set of models improves accuracy compared to relying on a single best model. This paper proposes a novel ensemble approach based on Shapley values, a…

Applications · Statistics 2026-03-05 G. Bimonte , M. Russolillo , Y. Yang , H. L. Shang

The aim of this paper is to propose a suitable method for constructing prediction intervals for the output of neural network models. To do this, we adapt the extremely randomized trees method originally developed for random forests to…

Machine Learning · Statistics 2021-05-14 Tullio Mancini , Hector Calvo-Pardo , Jose Olmo

The Fr\'echet regression is a useful method for modeling random objects in a general metric space given Euclidean covariates. However, the conventional approach could be sensitive to outlying objects in the sense that the distance from the…

Computation · Statistics 2026-01-21 Hao Li , Shonosuke Sugasawa , Shota Katayama

A novel data-driven methodology is presented for the joint selection of prior parameters for both fixed and random effects in Linear Mixed Models (LMMs). This approach facilitates the estimation of complex random-effects structures, as well…

Methodology · Statistics 2026-04-28 Matteo Amestoy , R. Vermeulen , Mark A. van de Wiel , Wessel N. van Wieringen

Predictive hydrological uncertainty can be quantified by using ensemble methods. If properly formulated, these methods can offer improved predictive performance by combining multiple predictions. In this work, we use 50-year-long monthly…

This paper explores Bayesian estimation for categorical data, focusing on simple yet effective models that provide a foundation for applying more advanced methods accurately and reliably in real-world applications. We begin by revisiting…

Methodology · Statistics 2025-09-03 Jan Kalina

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

Prediction intervals are a machine- and human-interpretable way to represent predictive uncertainty in a regression analysis. In this paper, we present a method for generating prediction intervals along with point estimates from an ensemble…

Machine Learning · Statistics 2020-07-21 Tárik S. Salem , Helge Langseth , Heri Ramampiaro

In many medical and business applications, researchers are interested in estimating individualized treatment effects using data from a randomized experiment. For example in medical applications, doctors learn the treatment effects from…

Methodology · Statistics 2022-03-01 Kevin Wu Han , Han Wu

This study investigates Bayesian ensemble learning for improving the quality of decision-making. We consider a decision-maker who selects an action from a set of candidates based on a policy trained using observations. In our setting, we…

Methodology · Statistics 2024-06-14 Masahiro Kato

Recent studies have shown that ensemble approaches could not only improve accuracy and but also estimate model uncertainty in deep learning. However, it requires a large number of parameters according to the increase of ensemble models for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Hong Joo Lee , Seong Tae Kim , Hakmin Lee , Nassir Navab , Yong Man Ro

Physics parameterizations are often needed for numerical weather prediction (NWP) of precipitation forecast. This is mainly because the resolutions of most computational atmospheric models are not fine enough to explicitly resolve sub-grid…

Geophysics · Physics 2025-06-19 Khanh Hung Mai , Duc Le , Kazuo Saito , Tomizawa Futo , Yohei Sawada

Ensemble learning is a popular technique to improve the accuracy of machine learning models. It traditionally hinges on the rationale that aggregating multiple weak models can lead to better models with lower variance and hence higher…

Optimization and Control · Mathematics 2026-01-06 Huajie Qian , Donghao Ying , Henry Lam , Wotao Yin