English
Related papers

Related papers: Hybrid Algorithm Selection and Hyperparameter Tuni…

200 papers

Recently, some challenging tasks in multi-agent systems have been solved by some hierarchical reinforcement learning methods. Inspired by the intra-level and inter-level coordination in the human nervous system, we propose a novel value…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Yunpeng Bai , Bin Zhang , Dapeng Li , Guoliang Fan

Sharing parameters in multi-agent deep reinforcement learning has played an essential role in allowing algorithms to scale to a large number of agents. Parameter sharing between agents significantly decreases the number of trainable…

Multiagent Systems · Computer Science 2021-06-15 Filippos Christianos , Georgios Papoudakis , Arrasy Rahman , Stefano V. Albrecht

With the advent of automated machine learning, automated hyperparameter optimization methods are by now routinely used in data mining. However, this progress is not yet matched by equal progress on automatic analyses that yield information…

Machine Learning · Statistics 2018-05-30 J. N. van Rijn , F. Hutter

Given a user's complex information need, a multi-agent Deep Research system iteratively plans, retrieves, and synthesizes evidence across hundreds of documents to produce a high-quality answer. In one possible architecture, an orchestrator…

Information Retrieval · Computer Science 2026-04-06 Arthur Câmara , Vincent Slot , Jakub Zavrel

Currently, many machine learning algorithms contain lots of iterations. When it comes to existing large-scale distributed systems, some slave nodes may break down or have lower efficiency. Therefore traditional machine learning algorithm…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-22 Junxiong Wang , Hongzhi Wang , Chenxu Zhao

Deep reinforcement learning (deep RL) has achieved tremendous success on various domains through a combination of algorithmic design and careful selection of hyper-parameters. Algorithmic improvements are often the result of iterative…

Machine Learning · Computer Science 2024-12-02 Johan Obando-Ceron , João G. M. Araújo , Aaron Courville , Pablo Samuel Castro

Hyperparameter optimization is critical in modern machine learning, requiring expert knowledge, numerous trials, and high computational and human resources. Despite the advancements in Automated Machine Learning (AutoML), challenges in…

Machine Learning · Computer Science 2025-02-27 Siyi Liu , Chen Gao , Yong Li

Selecting the optimal combination of a machine learning (ML) algorithm and its hyper-parameters is crucial for the development of high-performance ML systems. However, since the combination of ML algorithms and hyper-parameters is enormous,…

Machine Learning · Computer Science 2025-02-14 Kazuki Ishikawa , Ryota Ozaki , Yohei Kanzaki , Ichiro Takeuchi , Masayuki Karasuyama

Automatic performance tuning (auto-tuning) is widely used to optimize performance-critical applications across many scientific domains by finding the best program variant among many choices. Efficient optimization algorithms are crucial for…

Machine Learning · Computer Science 2025-10-10 Floris-Jan Willemsen , Rob V. van Nieuwpoort , Ben van Werkhoven

In this paper a deep reinforcement based multi-agent path planning approach is introduced. The experiments are realized in a simulation environment and in this environment different multi-agent path planning problems are produced. The…

Machine Learning · Computer Science 2021-10-05 Mert Çetinkaya

Modern artificial intelligence relies on networks of agents that collect data, process information, and exchange it with neighbors to collaboratively solve optimization and learning problems. This article introduces a novel distributed…

Optimization and Control · Mathematics 2026-01-15 Diego Deplano , Nicola Bastianello , Mauro Franceschelli , Karl H. Johansson

This paper proposes a policy-based deep reinforcement learning hyper-heuristic framework for solving the Job Shop Scheduling Problem. The hyper-heuristic agent learns to switch scheduling rules based on the system state dynamically. We…

Artificial Intelligence · Computer Science 2026-01-19 Sofiene Lassoued , Asrat Gobachew , Stefan Lier , Andreas Schwung

This paper presents a novel distributed robust optimization scheme for steering distributions of multi-agent systems under stochastic and deterministic uncertainty. Robust optimization is a subfield of optimization which aims to discover an…

Robotics · Computer Science 2025-01-31 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

Central to all machine learning algorithms is data representation. For multi-agent systems, selecting a representation which adequately captures the interactions among agents is challenging due to the latent group structure which tends to…

Machine Learning · Computer Science 2020-01-01 Jennifer Hobbs , Matthew Holbrook , Nathan Frank , Long Sha , Patrick Lucey

Heterogeneous networks comprise agents with varying capabilities in terms of computation, storage, and communication. In such settings, it is crucial to factor in the operating characteristics in allowing agents to choose appropriate…

Optimization and Control · Mathematics 2022-09-07 Yichuan Li , Petros Voulgaris , Nikolaos M. Freris

The combined algorithm selection and hyperparameter tuning (CASH) problem is characterized by large hierarchical hyperparameter spaces. Model-free hyperparameter tuning methods can explore such large spaces efficiently since they are highly…

Machine Learning · Computer Science 2019-11-22 Dimitrios Sarigiannis , Thomas Parnell , Haris Pozidis

In this paper, we propose multi-agent automated machine learning (MA2ML) with the aim to effectively handle joint optimization of modules in automated machine learning (AutoML). MA2ML takes each machine learning module, such as data…

Machine Learning · Computer Science 2022-10-18 Zhaozhi Wang , Kefan Su , Jian Zhang , Huizhu Jia , Qixiang Ye , Xiaodong Xie , Zongqing Lu

The use of skills (a.k.a., options) can greatly accelerate exploration in reinforcement learning, especially when only sparse reward signals are available. While option discovery methods have been proposed for individual agents, in…

Machine Learning · Computer Science 2023-09-22 Jiayu Chen , Marina Haliem , Tian Lan , Vaneet Aggarwal

Automatically optimizing the hyperparameters of Machine Learning algorithms is one of the primary open questions in AI. Existing work in Hyperparameter Optimization (HPO) trains surrogate models for approximating the response surface of…

Machine Learning · Computer Science 2023-05-23 Abdus Salam Khazi , Sebastian Pineda Arango , Josif Grabocka

The rapid development of the mobile Internet and the Internet of Things is leading to a diversification of user devices and the emergence of new mobile applications on a regular basis. Such applications include those that are…

Computational Engineering, Finance, and Science · Computer Science 2024-08-13 Xirui Tang , Zeyu Wang , Xiaowei Cai , Honghua Su , Changsong Wei