English
Related papers

Related papers: Hybrid Algorithm Selection and Hyperparameter Tuni…

200 papers

The behavior of heterogeneous multi-agent systems is studied when the coupling matrices are possibly all different and/or singular, that is, its rank is less than the system dimension. Rank-deficient coupling allows exchange of limited…

Systems and Control · Computer Science 2021-09-21 Jin Gyu Lee , Hyungbo Shim

The proliferation of large language models (LLMs) has accelerated the adoption of agent-based workflows, where multiple autonomous agents reason, invoke functions, and collaborate to compose complex data pipelines. However, current…

Databases · Computer Science 2025-12-15 Zoi Kaoudi , Ioana Giurgiu

Adaptive cooperation in multi-agent reinforcement learning (MARL) requires policies to express homogeneous, specialised, or mixed behaviours, yet achieving this adaptivity remains a critical challenge. While parameter sharing (PS) is…

Machine Learning · Computer Science 2025-10-30 Kale-ab Abebe Tessera , Arrasy Rahman , Amos Storkey , Stefano V. Albrecht

Both feature selection and hyperparameter tuning are key tasks in machine learning. Hyperparameter tuning is often useful to increase model performance, while feature selection is undertaken to attain sparse models. Sparsity may yield…

Machine Learning · Statistics 2020-02-14 Martin Binder , Julia Moosbauer , Janek Thomas , Bernd Bischl

Hyper-parameter optimization is a crucial problem in machine learning as it aims to achieve the state-of-the-art performance in any model. Great efforts have been made in this field, such as random search, grid search, Bayesian…

Machine Learning · Computer Science 2021-12-09 Chaoyue Liu , Yulai Zhang

This paper addresses the problem of managing perishable inventory under multiple sources of uncertainty, including stochastic demand, unreliable supplier fulfillment, and probabilistic product shelf life. We develop a discrete-event…

Neural and Evolutionary Computing · Computer Science 2025-11-04 Leonardo Kanashiro Felizardo , Edoardo Fadda , Mariá Cristina Vasconcelos Nascimento

Zero-shot hyperparameter optimization (HPO) is a simple yet effective use of transfer learning for constructing a small list of hyperparameter (HP) configurations that complement each other. That is to say, for any given dataset, at least…

Machine Learning · Statistics 2020-07-28 Fela Winkelmolen , Nikita Ivkin , H. Furkan Bozkurt , Zohar Karnin

Feature selection aims to preprocess the target dataset, find an optimal and most streamlined feature subset, and enhance the downstream machine learning task. Among filter, wrapper, and embedded-based approaches, the reinforcement learning…

Artificial Intelligence · Computer Science 2025-09-17 Weiliang Zhang , Xiaohan Huang , Yi Du , Ziyue Qiao , Qingqing Long , Zhen Meng , Yuanchun Zhou , Meng Xiao

Effective coordination and cooperation among agents are crucial for accomplishing individual or shared objectives in multi-agent systems. In many real-world multi-agent systems, agents possess varying abilities and constraints, making it…

Multiagent Systems · Computer Science 2023-10-20 Yasin Findik , Paul Robinette , Kshitij Jerath , S. Reza Ahmadzadeh

Machine learning algorithms are very sensitive to the hyperparameters, and their evaluations are generally expensive. Users desperately need intelligent methods to quickly optimize hyperparameter settings according to known evaluation…

Machine Learning · Computer Science 2020-05-05 Chunnan Wang , Hongzhi Wang , Chang Zhou , Hanxiao Chen

We propose a framework for adaptive data-centric collaborative machine learning among self-interested agents, coordinated by an arbiter. Designed to handle the incremental nature of real-world data, the framework operates in an online…

Machine Learning · Computer Science 2025-02-07 Nithia Vijayan , Bryan Kian Hsiang Low

Automatic parameter tuning methods for planning algorithms, which integrate pipeline approaches with learning-based techniques, are regarded as promising due to their stability and capability to handle highly constrained environments. While…

Robotics · Computer Science 2025-03-25 Lu Wangtao , Wei Yufei , Xu Jiadong , Jia Wenhao , Li Liang , Xiong Rong , Wang Yue

Hyperparameter tuning is an active area of research in machine learning, where the aim is to identify the optimal hyperparameters that provide the best performance on the validation set. Hyperparameter tuning is often achieved using naive…

Machine Learning · Computer Science 2020-07-23 Ankur Sinha , Tanmay Khandait , Raja Mohanty

With neural networks having demonstrated their versatility and benefits, the need for their optimal performance is as prevalent as ever. A defining characteristic, hyperparameters, can greatly affect its performance. Thus engineers go…

Neural and Evolutionary Computing · Computer Science 2020-09-21 Keshav Ganapathy

Hyperparameters in machine learning (ML) have received a fair amount of attention, and hyperparameter tuning has come to be regarded as an important step in the ML pipeline. But just how useful is said tuning? While smaller-scale…

Machine Learning · Computer Science 2022-09-05 Moshe Sipper

This work proposes multi-agent systems setting for concurrent engineering system design optimization and gradually paves the way towards examining graph theoretic constructs in the context of multidisciplinary design optimization problem.…

Optimization and Control · Mathematics 2012-09-18 Amir Noori

This paper proposes the first-ever algorithmic framework for tuning hyper-parameters of stochastic optimization algorithm based on reinforcement learning. Hyper-parameters impose significant influences on the performance of stochastic…

Machine Learning · Computer Science 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

Multiagent systems aim to accomplish highly complex learning tasks through decentralised consensus seeking dynamics and their use has garnered a great deal of attention in the signal processing and computational intelligence societies. This…

Machine Learning · Statistics 2023-09-20 Sayed Pouria Talebi , Danilo Mandic

One of the key challenges for multi-agent learning is scalability. In this paper, we introduce a technique for speeding up multi-agent learning by exploiting concurrent and incremental experience sharing. This solution adaptively identifies…

Multiagent Systems · Computer Science 2017-03-07 Dan Garant , Bruno da Silva , Victor Lesser , Chongjie Zhang

The performance of modern reinforcement learning algorithms critically relies on tuning ever-increasing numbers of hyperparameters. Often, small changes in a hyperparameter can lead to drastic changes in performance, and different…

Machine Learning · Computer Science 2025-02-05 Jacob Adkins , Michael Bowling , Adam White