English
Related papers

Related papers: Personalized Classifier Ensemble Pruning Framework…

200 papers

While large language models (LLMs) fine-tuned with lightweight adapters achieve strong performance across diverse tasks, their performance on individual tasks depends on the fine-tuning strategy. Fusing independently trained models with…

Machine Learning · Computer Science 2026-03-05 Sanae Lotfi , Lucas Caccia , Alessandro Sordoni , Jordan T. Ash , Miroslav Dudik

We develop a generalized inverse optimization framework for fitting the cost vector of a single linear optimization problem given multiple observed decisions. This setting is motivated by ensemble learning, where building consensus from…

Optimization and Control · Mathematics 2020-06-08 Aaron Babier , Timothy C. Y. Chan , Taewoo Lee , Rafid Mahmood , Daria Terekhov

We often see undesirable tradeoffs in robust machine learning where out-of-distribution (OOD) accuracy is at odds with in-distribution (ID) accuracy: a robust classifier obtained via specialized techniques such as removing spurious features…

Machine Learning · Computer Science 2022-07-20 Ananya Kumar , Tengyu Ma , Percy Liang , Aditi Raghunathan

Ensembles, as a widely used and effective technique in the machine learning community, succeed within a key element -- "diversity." The relationship between diversity and generalization, unfortunately, is not entirely understood and remains…

Machine Learning · Computer Science 2021-05-10 Yijun Bian , Huanhuan Chen

Ensemble techniques are frequently encountered in machine learning and engineering problems since the method combines different models and produces an optimal predictive solution. The ensemble concept can be adapted to deep learning models…

Ensemble learning has had many successes in supervised learning, but it has been rare in unsupervised learning and dimensionality reduction. This study explores dimensionality reduction ensembles, using principal component analysis and…

Machine Learning · Statistics 2017-10-13 Colleen M. Farrelly

The objective of this paper is to define an effective strategy for building an ensemble of Genetic Programming (GP) models. Ensemble methods are widely used in machine learning due to their features: they average out biases, they reduce the…

Neural and Evolutionary Computing · Computer Science 2019-06-14 Mauro Castelli , Ivo Gonçalves , Luca Manzoni , Leonardo Vanneschi

Background: Machine learning (ML) model composition is a popular technique to mitigate shortcomings of a single ML model and to design more effective ML-enabled systems. While ensemble learning, i.e., forwarding the same request to several…

Machine Learning · Computer Science 2024-07-04 Rafiullah Omar , Justus Bogner , Henry Muccini , Patricia Lago , Silverio Martínez-Fernández , Xavier Franch

A preference-based subjective evaluation is a key method for evaluating generative media reliably. However, its huge combinations of pairs prohibit it from being applied to large-scale evaluation using crowdsourcing. To address this issue,…

Human-Computer Interaction · Computer Science 2024-03-12 Yusuke Yasuda , Tomoki Toda

Ensemble methods are among the state-of-the-art predictive modeling approaches. Applied to modern big data, these methods often require a large number of sub-learners, where the complexity of each learner typically grows with the size of…

Machine Learning · Computer Science 2018-10-29 Amichai Painsky , Saharon Rosset

The rising interest in pattern recognition and data analytics has spurred the development of innovative machine learning algorithms and tools. However, as each algorithm has its strengths and limitations, one is motivated to judiciously…

Machine Learning · Statistics 2018-07-31 Panagiotis A. Traganitis , Alba Pagès-Zamora , Georgios B. Giannakis

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Federated Learning (FL) over wireless network enables data-conscious services by leveraging the ubiquitous intelligence at network edge for privacy-preserving model training. As the proliferation of context-aware services, the diversified…

Machine Learning · Computer Science 2022-02-08 Y. Li , X. Qin , H. Chen , K. Han , P. Zhang

Deep neural network ensembles combine the wisdom of multiple deep neural networks to improve the generalizability and robustness over individual networks. It has gained increasing popularity to study deep ensemble techniques in the deep…

Machine Learning · Computer Science 2023-11-20 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

Recent increase in online privacy concerns prompts the following question: can a recommender system be accurate if users do not entrust it with their private data? To answer this, we study the problem of learning item-clusters under local…

Machine Learning · Computer Science 2014-10-29 Siddhartha Banerjee , Nidhi Hegde , Laurent Massoulié

Ensemble learning methods are designed to benefit from multiple learning algorithms for better predictive performance. The tradeoff of this improved performance is slower speed and larger size of ensemble learning systems compared to single…

Machine Learning · Computer Science 2021-01-22 Abolfazl Nadi , Hadi Moradi , Khalil Taheri

Ensemble-based approaches are very effective in various fields in raising the accuracy of its individual members, when some voting rule is applied for aggregating the individual decisions. In this paper, we investigate how to find and…

Artificial Intelligence · Computer Science 2019-04-10 Attila Tiba , Andras Hajdu , Gyorgy Terdik , Henrietta Toman

It is well recognized that the project productivity is a key driver in estimating software project effort from Use Case Point size metric at early software development stages. Although, there are few proposed models for predicting…

Machine Learning · Computer Science 2018-12-18 Mohammad Azzeh , Ali Bou Nassif , Shadi Banitaan , Cuauhtemoc Lopez-Martin

A discriminative ensemble tracker employs multiple classifiers, each of which casts a vote on all of the obtained samples. The votes are then aggregated in an attempt to localize the target object. Such method relies on collective…

Computer Vision and Pattern Recognition · Computer Science 2017-05-01 Kourosh Meshgi , Maryam Sadat Mirzaei , Shigeyuki Oba , Shin Ishii

Tree ensembles, including boosting methods, are highly effective and widely used for tabular data. However, large ensembles lack interpretability and require longer inference times. We introduce a method to prune a tree ensemble into a…

Machine Learning · Computer Science 2025-01-22 Youssouf Emine , Alexandre Forel , Idriss Malek , Thibaut Vidal