English
Related papers

Related papers: Balancing the exploration-exploitation trade-off i…

200 papers

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

Robotics · Computer Science 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

A well-balanced exploration-exploitation trade-off is crucial for successful acquisition functions in Bayesian optimization. However, there is a lack of quantitative measures for exploration, making it difficult to analyze and compare…

Machine Learning · Computer Science 2026-05-15 Leonard Papenmeier , Nuojin Cheng , Stephen Becker , Luigi Nardi

Multi-Objective Evolutionary Algorithms (MOEAs) have proven effective at solving Multi-Objective Optimisation Problems (MOOPs). However, their performance can be significantly hindered when applied to computationally intensive industrial…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Tiwonge Msulira Banda , Alexandru-Ciprian Zăvoianu

We solve a min-max problem in a robust exploratory mean-variance problem with drift uncertainty in this paper. It is verified that robust investors choose the Sharpe ratio with minimal $L^2$ norm in an admissible set. A reinforcement…

Optimization and Control · Mathematics 2021-08-10 Chenchen Mou , Weiwei Zhang , Chao Zhou

Meta-Reinforcement learning approaches aim to develop learning procedures that can adapt quickly to a distribution of tasks with the help of a few examples. Developing efficient exploration strategies capable of finding the most useful…

Machine Learning · Computer Science 2019-11-12 Swaminathan Gurumurthy , Sumit Kumar , Katia Sycara

We study the problem of exploration in Reinforcement Learning and present a novel model-free solution. We adopt an information-theoretical viewpoint and start from the instance-specific lower bound of the number of samples that have to be…

Machine Learning · Computer Science 2024-07-02 Alessio Russo , Alexandre Proutiere

The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to…

Machine Learning · Computer Science 2019-09-10 Lior Shani , Yonathan Efroni , Shie Mannor

High-Performance Computing (HPC) schedulers must balance user performance with facility-wide resource constraints. The task boils down to selecting the optimal number of nodes for a given job. We present a surrogate-assisted multi-objective…

Machine Learning · Computer Science 2026-01-23 Ashna Nawar Ahmed , Banooqa Banday , Terry Jones , Tanzima Z. Islam

The majority of multi-agent system (MAS) implementations aim to optimise agents' policies with respect to a single objective, despite the fact that many real-world problem domains are inherently multi-objective in nature. Multi-objective…

Multiagent Systems · Computer Science 2020-11-17 Roxana Rădulescu , Patrick Mannion , Diederik M. Roijers , Ann Nowé

In this paper, an active control policy design for a fractional order (FO) financial system is attempted, considering multiple conflicting objectives. An active control template as a nonlinear state feedback mechanism is developed and the…

Optimization and Control · Mathematics 2016-11-30 Indranil Pan , Saptarshi Das , Shantanu Das

High sample complexity remains a barrier to the application of reinforcement learning (RL), particularly in multi-agent systems. A large body of work has demonstrated that exploration mechanisms based on the principle of optimism under…

Machine Learning · Computer Science 2021-08-02 Robert Loftin , Aadirupa Saha , Sam Devlin , Katja Hofmann

Classical evolutionary approaches for multiobjective optimization are quite accurate but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving…

Optimization and Control · Mathematics 2025-02-18 Ashwin Renganathan , Kade E. Carlson

In Bayesian optimization (BO) for expensive black-box optimization tasks, acquisition function (AF) guides sequential sampling and plays a pivotal role for efficient convergence to better optima. Prevailing AFs usually rely on artificial…

Machine Learning · Computer Science 2022-10-04 Zijing Liu , Xiyao Qu , Xuejun Liu , Hongqiang Lyu

Learning-enabled control systems increasingly rely on multiple sensing modalities (e.g., vision, audio, language, etc.) for perception and decision support. A key challenge is that multi-modal sensor training dynamics are often imbalanced:…

Machine Learning · Computer Science 2026-04-01 Heshan Fernando , Quan Xiao , Parikshit Ram , Yi Zhou , Horst Samulowitz , Nathalie Baracaldo , Tianyi Chen

This paper proposes a new method for hyperparameter optimization (HPO) that balances exploration and exploitation. While evolutionary algorithms (EAs) show promise in HPO, they often struggle with effective exploitation. To address this, we…

Neural and Evolutionary Computing · Computer Science 2025-04-11 Chul Kim , Inwhee Joe

Several methods have been proposed in the literature to solve reliability-based optimization problems, where failure probabilities are design constraints. However, few methods address the problem of life-cycle cost or risk optimization,…

Computation · Statistics 2020-07-09 H. M. Kroetz , M. Moustapha , A. T. Beck , B. Sudret

We consider the problem of black-box multi-objective optimization (MOO) using expensive function evaluations (also referred to as experiments), where the goal is to approximate the true Pareto set of solutions by minimizing the total…

Machine Learning · Computer Science 2021-11-05 Syrine Belakaria , Aryan Deshwal , Janardhan Rao Doppa

Efficiently solving multi-objective optimization problems for simulation optimization of important scientific and engineering applications such as materials design is becoming an increasingly important research topic. This is due largely to…

Artificial Intelligence · Computer Science 2023-06-27 Eric Hans Lee , Bolong Cheng , Michael McCourt

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Recent advances in reinforcement learning for foundation models, such as Group Relative Policy Optimization (GRPO), have significantly improved the performance of foundation models on reasoning tasks. Notably, the advantage function serves…

Artificial Intelligence · Computer Science 2025-09-26 Wenke Huang , Quan Zhang , Yiyang Fang , Jian Liang , Xuankun Rong , Huanjin Yao , Guancheng Wan , Ke Liang , Wenwen He , Mingjun Li , Leszek Rutkowski , Mang Ye , Bo Du , Dacheng Tao