English
Related papers

Related papers: Adaptive and Calibrated Ensemble Learning with Dep…

200 papers

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

Ensemble learning is characterized by flexibility, high precision, and refined structure. As a critical component within computational finance, option pricing with machine learning requires both high predictive accuracy and reduced…

Machine Learning · Computer Science 2025-06-09 Zeyuan Li , Qingdao Huang

Machine learning techniques always aim to reduce the generalized prediction error. In order to reduce it, ensemble methods present a good approach combining several models that results in a greater forecasting capacity. The Random Machines…

Machine Learning · Statistics 2020-03-31 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

Combining multiple predictors obtained from distributed data sources to an accurate meta-learner is promising to achieve enhanced performance in lots of prediction problems. As the accuracy of each predictor is usually unknown, integrating…

Machine Learning · Statistics 2024-08-16 Shiva Afshar , Yinghan Chen , Shizhong Han , Ying Lin

Modeling the behavior of stock price data has always been one of the challengeous applications of Artificial Intelligence (AI) and Machine Learning (ML) due to its high complexity and dependence on various conditions. Recent studies show…

Applications · Statistics 2025-01-14 Xinyuan Song

The contribution of this work is twofold: (1) We introduce a collection of ensemble methods for time series forecasting to combine predictions from base models. We demonstrate insights on the power of ensemble learning for forecasting,…

Machine Learning · Computer Science 2021-04-26 Julia Gastinger , Sébastien Nicolas , Dušica Stepić , Mischa Schmidt , Anett Schülke

Tree-based ensemble methods such as random forests, gradient-boosted trees, and Bayesianadditive regression trees have been successfully used for regression problems in many applicationsand research studies. In this paper, we study ensemble…

Machine Learning · Statistics 2024-06-21 Alexandre Seiller , Éric Gaussier , Emilie Devijver , Marianne Clausel , Sami Alkhoury

Combining forecasts from multiple experts often yields more accurate results than relying on a single expert. In this paper, we introduce a novel regularized ensemble method that extends the traditional linear opinion pool by leveraging…

Applications · Statistics 2026-02-13 Han Su , Xiaojia Guo , Xiaoke Zhang

Ensemble models often achieve higher accuracy than single learners, but their ability to maintain small generalization gaps is not always well understood. This study examines how ensembles balance accuracy and overfitting across four…

Machine Learning · Computer Science 2025-12-08 Zubair Ahmed Mohammad

We investigate ensemble methods for prediction in an online setting. Unlike all the literature in ensembling, for the first time, we introduce a new approach using a meta learner that effectively combines the base model predictions via…

Machine Learning · Computer Science 2022-12-01 Arda Fazla , Mustafa Enes Aydin , Orhun Tamyigit , Suleyman Serdar Kozat

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

We describe various moment-based ensemble interpretation models for the construction of probabilistic temperature forecasts from ensembles. We apply the methods to one year of medium range ensemble forecasts and perform in and out of sample…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Stephen Jewson

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on…

Atmospheric and Oceanic Physics · Physics 2023-05-17 Maximiliano A. Sacco , Manuel Pulido , Juan J. Ruiz , Pierre Tandeo

In modern statistics, interests shift from pursuing the uniformly minimum variance unbiased estimator to reducing mean squared error (MSE) or residual squared error. Shrinkage based estimation and regression methods offer better prediction…

Methodology · Statistics 2025-02-25 Tianyu Zhan , Haoda Fu , Jian Kang

Model ensemble is an effective strategy in continual learning, which alleviates catastrophic forgetting by interpolating model parameters, achieving knowledge fusion learned from different tasks. However, existing model ensemble methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yuchuan Mao , Zhi Gao , Xiaomeng Fan , Yuwei Wu , Yunde Jia , Chenchen Jing

Ensembles, which employ a set of classifiers to enhance classification accuracy collectively, are crucial in the era of big data. However, although there is general agreement that the relation between ensemble size and its prediction…

Machine Learning · Computer Science 2023-08-29 Enes Bektas , Fazli Can

Variational inference with {\alpha}-divergences has been widely used in modern probabilistic machine learning. Compared to Kullback-Leibler (KL) divergence, a major advantage of using {\alpha}-divergences (with positive {\alpha} values) is…

Machine Learning · Computer Science 2019-09-10 Dilin Wang , Hao Liu , Qiang Liu

It is common practice to combine deep neural networks into ensembles. These deep ensembles can benefit from the cancellation of errors effect: Errors by ensemble members may average out, leading to better generalization performance than…

Machine Learning · Computer Science 2025-01-07 Nick Hauptvogel , Christian Igel

Model selection is a strategy aimed at creating accurate and robust models. A key challenge in designing these algorithms is identifying the optimal model for classifying any particular input sample. This paper addresses this challenge and…

Machine Learning · Computer Science 2023-05-22 James Kotary , Vincenzo Di Vito , Ferdinando Fioretto

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati