English
Related papers

Related papers: Unifying Ensemble Methods for Q-learning via Socia…

200 papers

Reinforcement learning (RL) has increasingly been applied to solve real-world planning problems, with progress in handling large state spaces and time horizons. However, a key bottleneck in many domains is that RL methods cannot accommodate…

Machine Learning · Computer Science 2025-03-19 Lily Xu , Bryan Wilder , Elias B. Khalil , Milind Tambe

Optimizing large-scale wireless networks, including optimal resource management, power allocation, and throughput maximization, is inherently challenging due to their non-observable system dynamics and heterogeneous and complex nature.…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

Ensembling has a long history in statistical data analysis, with many impactful applications. However, in many modern machine learning settings, the benefits of ensembling are less ubiquitous and less obvious. We study, both theoretically…

Machine Learning · Statistics 2023-05-23 Ryan Theisen , Hyunsuk Kim , Yaoqing Yang , Liam Hodgkinson , Michael W. Mahoney

Ensemble learning is a powerful paradigm that has been usedin the top state-of-the-art machine learning methods like Random Forestsand XGBoost. Inspired by the success of such methods, we have devel-oped a new Genetic Programming method…

Neural and Evolutionary Computing · Computer Science 2020-01-22 Nuno M. Rodrigues , João E. Batista , Sara Silva

In this paper we examine the effect of applying ensemble learning to the performance of collaborative filtering methods. We present several systematic approaches for generating an ensemble of collaborative filtering models based on a single…

Information Retrieval · Computer Science 2012-11-14 Ariel Bar , Lior Rokach , Guy Shani , Bracha Shapira , Alon Schclar

Training large neural networks is known to be time-consuming, with the learning duration taking days or even weeks. To address this problem, large-batch optimization was introduced. This approach demonstrated that scaling mini-batch sizes…

Machine Learning · Computer Science 2023-01-31 Alexander Nikulin , Vladislav Kurenkov , Denis Tarasov , Dmitry Akimov , Sergey Kolesnikov

Ensembling large language models (LLMs) can effectively combine diverse strengths of different models, offering a promising approach to enhance performance across various tasks. However, existing methods typically rely on fixed weighting…

Machine Learning · Computer Science 2025-06-03 Yuqian Fu , Yuanheng Zhu , Jiajun Chai , Guojun Yin , Wei Lin , Qichao Zhang , Dongbin Zhao

The merit of ensemble learning lies in having different outputs from many individual models on a single input, i.e., the diversity of the base models. The high quality of diversity can be achieved when each model is specialized to different…

Machine Learning · Computer Science 2021-12-09 Sihwan Kim , Dae Yon Jung , Taejang Park

A common approach to aggregate classification estimates in an ensemble of decision trees is to either use voting or to average the probabilities for each class. The latter takes uncertainty into account, but not the reliability of the…

Machine Learning · Computer Science 2022-08-17 Florian Busch , Moritz Kulessa , Eneldo Loza Mencía , Hendrik Blockeel

Time series forecasting is a challenging problem particularly when a time series expresses multiple seasonality, nonlinear trend and varying variance. In this work, to forecast complex time series, we propose ensemble learning which is…

Machine Learning · Computer Science 2022-03-03 Grzegorz Dudek

Ensemble and auxiliary tasks are both well known to improve the performance of machine learning models when data is limited. However, the interaction between these two methods is not well studied, particularly in the context of deep…

Machine Learning · Computer Science 2021-07-07 Muhammad Rizki Maulana , Wee Sun Lee

Unsupervised learning, and more specifically clustering, suffers from the need for expertise in the field to be of use. Researchers must make careful and informed decisions on which algorithm to use with which set of hyperparameters for a…

Machine Learning · Computer Science 2021-12-28 Antoine Zambelli

The construction of models for video action classification progresses rapidly. However, the performance of those models can still be easily improved by ensembling with the same models trained on different modalities (e.g. Optical flow).…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Stepan Komkov , Maksim Dzabraev , Aleksandr Petiushko

This paper establishes a new and comprehensive theoretical analysis for the application of reinforcement learning (RL) in high-frequency market making. We bridge the modern RL theory and the continuous-time statistical models in…

Trading and Market Microstructure · Quantitative Finance 2024-08-13 Yuheng Zheng , Zihan Ding

Ensemble learning is a methodology that integrates multiple DNN learners for improving prediction performance of individual learners. Diversity is greater when the errors of the ensemble prediction is more uniformly distributed. Greater…

Machine Learning · Computer Science 2019-08-30 Ling Liu , Wenqi Wei , Ka-Ho Chow , Margaret Loper , Emre Gursoy , Stacey Truex , Yanzhao Wu

Deep learning has proven to be an effective approach in the field of Human activity recognition (HAR), outperforming other architectures that require manual feature engineering. Despite recent advancements, challenges inherent to HAR data,…

Machine Learning · Computer Science 2023-07-18 Yiran Huang , Yexu Zhou , Till Riedel , Likun Fang , Michael Beigl

It is well known that ensemble methods often provide enhanced performance in reinforcement learning. In this paper, we explore this concept further by using group-aided training within the distributional reinforcement learning paradigm.…

Machine Learning · Computer Science 2020-05-25 Björn Lindenberg , Jonas Nordqvist , Karl-Olof Lindahl

The development of machine learning algorithms has been gathering relevance to address the increasing modelling complexity of manufacturing decision-making problems. Reinforcement learning is a methodology with great potential due to the…

Machine Learning · Computer Science 2023-04-18 Miguel Neves , Miguel Vieira , Pedro Neto

Ensembling is a simple and popular technique for boosting evaluation performance by training multiple models (e.g., with different initializations) and aggregating their predictions. This approach is commonly reserved for the largest…

Machine Learning · Computer Science 2020-05-05 Dan Kondratyuk , Mingxing Tan , Matthew Brown , Boqing Gong

Quality assessments of models in unsupervised learning and clustering verification in particular have been a long-standing problem in the machine learning research. The lack of robust and universally applicable cluster validity scores often…

Machine Learning · Statistics 2018-03-30 Luzie Helfmann , Johannes von Lindheim , Mattes Mollenhauer , Ralf Banisch