English
Related papers

Related papers: Differentiable Model Selection for Ensemble Learni…

200 papers

Crowdsourced machine learning on competition platforms such as Kaggle is a popular and often effective method for generating accurate models. Typically, teams vie for the most accurate model, as measured by overall error on a holdout set,…

Machine Learning · Computer Science 2024-02-19 Ira Globus-Harris , Declan Harrison , Michael Kearns , Pietro Perona , Aaron Roth

Networks are a commonly used mathematical model to describe the rich set of interactions between objects of interest. Many clustering methods have been developed in order to partition such structures, among which several rely on underlying…

Methodology · Statistics 2014-05-13 P. Latouche , E. Birmelé , C. Ambroise

Thompson sampling has emerged as an effective heuristic for a broad range of online decision problems. In its basic form, the algorithm requires computing and sampling from a posterior distribution over models, which is tractable only for…

Machine Learning · Statistics 2023-04-26 Xiuyuan Lu , Benjamin Van Roy

A framework was developed to address limitations associated with existing techniques for analysing sequences. This work deals with the steps followed to select suitable datasets characterised by discrete irregular sequential patterns. To…

Machine Learning · Computer Science 2021-09-23 Kudakwashe Dandajena , Isabella M. Venter , Mehrdad Ghaziasgar , Reg Dodds

Ensemble learning is gaining renewed interests in recent years. This paper presents EnsembleBench, a holistic framework for evaluating and recommending high diversity and high accuracy ensembles. The design of EnsembleBench offers three…

Machine Learning · Computer Science 2020-10-22 Yanzhao Wu , Ling Liu , Zhongwei Xie , Juhyun Bae , Ka-Ho Chow , Wenqi Wei

Many applications require the collection of data on different variables or measurements over many system performance metrics. We term those broadly as measures or variables. Often data collection along each measure incurs a cost, thus it is…

Methodology · Statistics 2021-11-30 Donghui Yan , Zhiwei Qin , Songxiang Gu , Haiping Xu , Ming Shao

Machine learning (ML) models are increasingly being used in application domains that often involve working together with human experts. In this context, it can be advantageous to defer certain instances to a single human expert when they…

Artificial Intelligence · Computer Science 2022-06-17 Patrick Hemmer , Sebastian Schellhammer , Michael Vössing , Johannes Jakubik , Gerhard Satzger

We address the decision-making capability within an end-to-end planning framework that focuses on motion prediction, decision-making, and trajectory planning. Specifically, we formulate decision-making and trajectory planning as a…

Robotics · Computer Science 2024-12-03 Wenru Liu , Yongkang Song , Chengzhen Meng , Zhiyu Huang , Haochen Liu , Chen Lv , Jun Ma

Federated machine learning is growing fast in academia and industries as a solution to solve data hungriness and privacy issues in machine learning. Being a widely distributed system, federated machine learning requires various system…

Machine Learning · Computer Science 2023-05-01 Sin Kit Lo , Qinghua Lu , Hye-Young Paik , Liming Zhu

Many dynamic ensemble selection (DES) methods are known in the literature. A previously-developed by the authors, method consists in building a randomized classifier which is treated as a model of the base classifier. The model is…

Machine Learning · Computer Science 2021-09-17 Pawel Trajdos , Marek Kurzynski

The remarkable success of modern machine learning models on large datasets often demands extensive training time and resource consumption. To save cost, a prevalent research line, known as online batch selection, explores selecting…

Machine Learning · Computer Science 2024-06-10 Feng Hong , Yueming Lyu , Jiangchao Yao , Ya Zhang , Ivor W. Tsang , Yanfeng Wang

A growing body of research in continual learning focuses on the catastrophic forgetting problem. While many attempts have been made to alleviate this problem, the majority of the methods assume a single model in the continual learning…

Machine Learning · Computer Science 2023-07-06 Thang Doan , Seyed Iman Mirzadeh , Mehrdad Farajtabar

A plethora of research has been done in the past focusing on predicting student's performance in order to support their development. Many institutions are focused on improving the performance and the education quality; and this can be…

Computers and Society · Computer Science 2020-05-15 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

Ensembles of neural networks have been shown to give better performance than single networks, both in terms of predictions and uncertainty estimation. Additionally, ensembles allow the uncertainty to be decomposed into aleatoric (data) and…

Machine Learning · Statistics 2021-01-11 Jakob Lindqvist , Amanda Olmin , Fredrik Lindsten , Lennart Svensson

Ensemble learning, the machine learning paradigm where multiple algorithms are combined, has exhibited promising perfomance in a variety of tasks. The present work focuses on unsupervised ensemble classification. The term unsupervised…

Machine Learning · Computer Science 2020-12-22 Panagiotis A. Traganitis , Georgios B. Giannakis

Federated learning is proposed as a machine learning setting to enable distributed edge devices, such as mobile phones, to collaboratively learn a shared prediction model while keeping all the training data on device, which can not only…

Machine Learning · Computer Science 2020-03-13 Lifeng Liu , Fengda Zhang , Jun Xiao , Chao Wu

Ensemble learning has had many successes in supervised learning, but it has been rare in unsupervised learning and dimensionality reduction. This study explores dimensionality reduction ensembles, using principal component analysis and…

Machine Learning · Statistics 2017-10-13 Colleen M. Farrelly

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste

The contribution of this work is twofold: (1) We introduce a collection of ensemble methods for time series forecasting to combine predictions from base models. We demonstrate insights on the power of ensemble learning for forecasting,…

Machine Learning · Computer Science 2021-04-26 Julia Gastinger , Sébastien Nicolas , Dušica Stepić , Mischa Schmidt , Anett Schülke

Transferring a deep neural network trained on one problem to another requires only a small amount of data and little additional computation time. The same behaviour holds for ensembles of deep learning models typically superior to a single…

Machine Learning · Computer Science 2022-06-28 Ilya Shashkov , Nikita Balabin , Evgeny Burnaev , Alexey Zaytsev