English
Related papers

Related papers: Context-Aware Ensemble Learning for Time Series

200 papers

Ensemble learning is a technique where multiple component learners are combined through a protocol. We propose an Ensemble Neural Network (ENN) that uses the combined latent-feature space of multiple neural network classifiers to improve…

High Energy Physics - Phenomenology · Physics 2021-05-06 Jack Y. Araz , Michael Spannowsky

We present an architecture that is effective for continual learning in an especially demanding setting, where task boundaries do not exist or are unknown, and where classes have to be learned online (with each example presented only once).…

Machine Learning · Computer Science 2021-10-08 Murray Shanahan , Christos Kaplanis , Jovana Mitrović

We propose a principle for exploring context in machine learning models. Starting with a simple assumption that each observation may or may not depend on its context, a conditional probability distribution is decomposed into two parts:…

Machine Learning · Computer Science 2019-01-23 Yun Zeng

Ensembling multiple predictions is a widely used technique for improving the accuracy of various machine learning tasks. One obvious drawback of ensembling is its higher execution cost during inference. In this paper, we first describe our…

Machine Learning · Computer Science 2019-03-11 Hiroshi Inoue

Neural networks are very effective when trained on large datasets for a large number of iterations. However, when they are trained on non-stationary streams of data and in an online fashion, their performance is reduced (1) by the online…

Machine Learning · Computer Science 2023-07-04 Albin Soutif--Cormerais , Antonio Carta , Joost Van de Weijer

The combination of multiple classifiers using ensemble methods is increasingly important for making progress in a variety of difficult prediction problems. We present a comparative analysis of several ensemble methods through two case…

Machine Learning · Computer Science 2013-09-20 Sean Whalen , Gaurav Pandey

Amounts of historical data collected increase and business intelligence applicability with automatic forecasting of time series are in high demand. While no single time series modeling method is universal to all types of dynamics,…

Machine Learning · Statistics 2022-04-18 Evaldas Vaiciukynas , Paulius Danenas , Vilius Kontrimas , Rimantas Butleris

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

There is a long history in machine learning of model ensembling, beginning with boosting and bagging and continuing to the present day. Much of this history has focused on combining models for classification and regression, but recently…

Machine Learning · Computer Science 2024-05-28 Ira Globus-Harris , Varun Gupta , Michael Kearns , Aaron Roth

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning…

Machine Learning · Computer Science 2022-08-09 M. A. Ganaie , Minghui Hu , A. K. Malik , M. Tanveer , P. N. Suganthan

Ensemble methods for supervised machine learning have become popular due to their ability to accurately predict class labels with groups of simple, lightweight "base learners." While ensembles offer computationally efficient models that…

Machine Learning · Statistics 2011-09-01 Orianna DeMasi , Juan Meza , David H. Bailey

Ensemble of machine learning models yields improved performance as well as robustness. However, their memory requirements and inference costs can be prohibitively high. Knowledge distillation is an approach that allows a single model to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Zhengcong Fei , Shuman Tian , Junshi Huang , Xiaoming Wei , Xiaolin Wei

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

We propose a hybrid meta-learning framework for forecasting and anomaly detection in nonlinear dynamical systems characterized by nonstationary and stochastic behavior. The approach integrates a physics-inspired simulator that captures…

Machine Learning · Computer Science 2025-06-18 Abdullah Burkan Bereketoglu

In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in accordance with the…

Machine Learning · Computer Science 2021-07-12 Grzegorz Dudek , Paweł Pełka

Ensembles are popular methods for solving practical supervised learning problems. They reduce the risk of having underperforming models in production-grade software. Although critical, methods for learning heterogeneous regression ensembles…

Machine Learning · Computer Science 2018-04-18 Jihed Khiari , Luis Moreira-Matias , Ammar Shaker , Bernard Zenko , Saso Dzeroski

In the early observation period of a time series, there might be only a few historic observations available to learn a model. However, in cases where an existing prior set of datasets is available, Meta learning methods can be applicable.…

Machine Learning · Computer Science 2023-07-20 Shayan Jawed , Kiran Madhusudhanan , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

Ensemble learning combines several individual models to obtain a better generalization performance. In this work we present a practical method for estimating the joint power of several classifiers. It differs from existing approaches which…

Artificial Intelligence · Computer Science 2023-12-22 Simi Haber , Yonatan Wexler

Recent years have seen a shift towards learning-based methods for trajectory prediction, with challenges remaining in addressing uncertainty and capturing multi-modal distributions. This paper introduces Temporal Ensembling with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kai-Yin Hong , Chieh-Chih Wang , Wen-Chieh Lin

Heterogeneous ensembles built from the predictions of a wide variety and large number of diverse base predictors represent a potent approach to building predictive models for problems where the ideal base/individual predictor may not be…

Machine Learning · Computer Science 2021-03-01 Ana Stanescu , Gaurav Pandey