English
Related papers

Related papers: Context-Aware Ensemble Learning for Time Series

200 papers

Ensemble learning is traditionally justified as a variance-reduction strategy, explaining its strong performance for unstable predictors such as decision trees. This explanation, however, does not account for ensembles constructed from…

Machine Learning · Statistics 2025-12-30 Ernest Fokoué

Given multiple source word embeddings learnt using diverse algorithms and lexical resources, meta word embedding learning methods attempt to learn more accurate and wide-coverage word embeddings. Prior work on meta-embedding has repeatedly…

Computation and Language · Computer Science 2022-04-27 Danushka Bollegala

Compared to humans, machine learning models generally require significantly more training examples and fail to extrapolate from experience to solve previously unseen challenges. To help close this performance gap, we augment single-task…

Machine Learning · Computer Science 2018-07-27 Tailin Wu , John Peurifoy , Isaac L. Chuang , Max Tegmark

Given the continuous increase in dataset sizes and the complexity of forecasting models, the trade-off between forecast accuracy and computational cost is emerging as an extremely relevant topic, especially in the context of ensemble…

Machine Learning · Computer Science 2025-07-10 Marco Zanotti

Ensembling has a long history in statistical data analysis, with many impactful applications. However, in many modern machine learning settings, the benefits of ensembling are less ubiquitous and less obvious. We study, both theoretically…

Machine Learning · Statistics 2023-05-23 Ryan Theisen , Hyunsuk Kim , Yaoqing Yang , Liam Hodgkinson , Michael W. Mahoney

One of the challenging questions in time series forecasting is how to find the best algorithm. In recent years, a recommender system scheme has been developed for time series analysis using a meta-learning approach. This system selects the…

Machine Learning · Statistics 2019-08-23 Sasan Barak , Mahdi Nasiri , Mehrdad Rostamzadeh

In the low-data regime, it is difficult to train good supervised models from scratch. Instead practitioners turn to pre-trained models, leveraging transfer learning. Ensembling is an empirically and theoretically appealing way to construct…

Machine Learning · Computer Science 2020-10-20 Basil Mustafa , Carlos Riquelme , Joan Puigcerver , André Susano Pinto , Daniel Keysers , Neil Houlsby

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

Traffic flow forecasting is a crucial task in intelligent transport systems. Deep learning offers an effective solution, capturing complex patterns in time-series traffic flow data to enable the accurate prediction. However, deep learning…

Machine Learning · Computer Science 2024-11-07 Qiyuan Zhu , A. K. Qin , Hussein Dia , Adriana-Simona Mihaita , Hanna Grzybowska

A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular examples are…

Machine Learning · Statistics 2022-02-25 Maksim Velikanov , Roman Kail , Ivan Anokhin , Roman Vashurin , Maxim Panov , Alexey Zaytsev , Dmitry Yarotsky

Most machine learning classifiers give predictions for new examples accurately, yet without indicating how trustworthy predictions are. In the medical domain, this hampers their integration in decision support systems, which could be useful…

Machine Learning · Computer Science 2018-07-06 Telma Pereira , Sandra Cardoso , Dina Silva , Manuela Guerreiro , Alexandre de Mendonça , Sara C. Madeira

Modern multi-centre randomized controlled trials (MCRCTs) collect massive amounts of tabular data, and are monitored intensively for irregularities by humans. We began by empirically evaluating 6 modern machine learning-based outlier…

Machine Learning · Computer Science 2023-11-10 Walter Nelson , Jonathan Ranisau , Jeremy Petch

Ensemble models can be used to estimate prediction uncertainties in machine learning models. However, an ensemble of N models is approximately N times more computationally demanding compared to a single model when it is used for inference.…

Machine Learning · Computer Science 2026-03-04 Vidit Agrawal , Shixin Zhang , Lane E. Schultz , Dane Morgan

Enhancing the robustness and accuracy of time series forecasting models is an active area of research. Recently, Artificial Neural Networks (ANNs) have found extensive applications in many practical forecasting problems. However, the…

Neural and Evolutionary Computing · Computer Science 2013-02-27 Ratnadip Adhikari , R. K. Agrawal

A growing body of research in continual learning focuses on the catastrophic forgetting problem. While many attempts have been made to alleviate this problem, the majority of the methods assume a single model in the continual learning…

Machine Learning · Computer Science 2023-07-06 Thang Doan , Seyed Iman Mirzadeh , Mehrdad Farajtabar

Ensembles of machine learning models have been well established as a powerful method of improving performance over a single model. Traditionally, ensembling algorithms train their base learners independently or sequentially with the goal of…

Machine Learning · Computer Science 2023-11-01 Alan Jeffares , Tennison Liu , Jonathan Crabbé , Mihaela van der Schaar

Ensemble approaches for deep-learning-based semantic segmentation remain insufficiently explored despite the proliferation of competitive benchmarks and downstream applications. In this work, we explore and benchmark the popular ensembling…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Rawal Khirodkar , Brandon Smith , Siddhartha Chandra , Amit Agrawal , Antonio Criminisi

Machine learning-based Deepfake detection models have achieved impressive results on benchmark datasets, yet their performance often deteriorates significantly when evaluated on out-of-distribution data. In this work, we investigate an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haroon Wahab , Hassan Ugail , Lujain Jaleel

With the sweeping digitalization of societal, medical, industrial, and scientific processes, sensing technologies are being deployed that produce increasing volumes of time series data, thus fueling a plethora of new or improved…

Machine Learning · Computer Science 2024-04-23 David Campos , Tung Kieu , Chenjuan Guo , Feiteng Huang , Kai Zheng , Bin Yang , Christian S. Jensen

Ensemble learning has had many successes in supervised learning, but it has been rare in unsupervised learning and dimensionality reduction. This study explores dimensionality reduction ensembles, using principal component analysis and…

Machine Learning · Statistics 2017-10-13 Colleen M. Farrelly