English
Related papers

Related papers: Balancing the exploration-exploitation trade-off i…

200 papers

In designing stellarators, any design decision ultimately comes with a trade-off. Improvements in particle confinement, for instance, may increase the burden on engineers to build more complex coils, and the tightening of financial…

Plasma Physics · Physics 2023-04-19 David Bindel , Matt Landreman , Misha Padidar

In contrast to single-objective optimization (SOO), multi-objective optimization (MOO) requires an optimizer to find the Pareto frontier, a subset of feasible solutions that are not dominated by other feasible solutions. In this paper, we…

Machine Learning · Computer Science 2024-08-13 Yiyang Zhao , Linnan Wang , Kevin Yang , Tianjun Zhang , Tian Guo , Yuandong Tian

Exploration-exploitation is a powerful and practical tool in multi-agent learning (MAL), however, its effects are far from understood. To make progress in this direction, we study a smooth analogue of Q-learning. We start by showing that…

Computer Science and Game Theory · Computer Science 2020-12-16 Stefanos Leonardos , Georgios Piliouras

In this paper, we deal with batch Bayesian Optimization (Bayes-Opt) problems over a box and we propose a novel bi-objective optimization (BOO) acquisition strategy to sample points where to evaluate the objective function. The BOO problem…

Optimization and Control · Mathematics 2025-05-27 Francesco Carciaghi , Simone Magistri , Pierluigi Mansueto , Fabio Schoen

Multi-Objective Optimization (MOO) techniques have become increasingly popular in recent years due to their potential for solving real-world problems in various fields, such as logistics, finance, environmental management, and engineering.…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Noor A. Rashed , Yossra H. Ali , Tarik A. Rashid , A. Salih

The tradeoff between accuracy and speed is considered fundamental to individual and collective decision-making. In this paper, we focus on collective estimation as an example of collective decision-making. The task is to estimate the…

Multiagent Systems · Computer Science 2022-01-19 Mohsen Raoufi , Heiko Hamann , Pawel Romanczuk

Model-based deep reinforcement learning has achieved success in various domains that require high sample efficiencies, such as Go and robotics. However, there are some remaining issues, such as planning efficient explorations to learn more…

Machine Learning · Computer Science 2021-07-06 Yao Yao , Li Xiao , Zhicheng An , Wanpeng Zhang , Dijun Luo

We consider an agent who is involved in a Markov decision process and receives a vector of outcomes every round. Her objective is to maximize a global concave reward function on the average vectorial outcome. The problem models applications…

Machine Learning · Computer Science 2019-05-17 Wang Chi Cheung

Design optimization of engineering systems with multiple competing objectives is a painstakingly tedious process especially when the objective functions are expensive-to-evaluate computer codes with parametric uncertainties. The…

Optimization and Control · Mathematics 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal , B. P. Gautham , Amol Joshi , Pramod Zagade

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

Machine Learning · Computer Science 2019-01-23 Reazul Hasan Russel

Recently, there has been an increasing interest in the application of multiobjective optimization (MOO) in machine learning (ML). This interest is driven by the numerous real-life situations where multiple objectives must be optimized…

Machine Learning · Computer Science 2025-04-30 Junaid Akhter , Paul David Fährmann , Konstantin Sonntag , Sebastian Peitz , Daniel Schwietert

Balancing safety, efficiency, and operational costs in highway driving poses a challenging decision-making problem for heavy-duty vehicles. A central difficulty is that conventional scalar reward formulations, obtained by aggregating these…

Machine Learning · Computer Science 2026-01-27 Deepthi Pathare , Leo Laine , Morteza Haghir Chehreghani

Multi-objective optimization (MOO) is a well-studied problem for several important recommendation problems. While multiple approaches have been proposed, in this work, we focus on using constrained optimization formulations (e.g., quadratic…

Applications · Statistics 2016-02-16 Kinjal Basu , Ankan Saha , Shaunak Chatterjee

Model-free reinforcement learning methods such as the Proximal Policy Optimization algorithm (PPO) have successfully applied in complex decision-making problems such as Atari games. However, these methods suffer from high variances and high…

Machine Learning · Computer Science 2018-11-20 Feiyang Pan , Qingpeng Cai , An-Xiang Zeng , Chun-Xiang Pan , Qing Da , Hualin He , Qing He , Pingzhong Tang

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

Machine Learning · Computer Science 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

Reinforcement learning with multiple, potentially conflicting objectives is pervasive in real-world applications, while this problem remains theoretically under-explored. This paper tackles the multi-objective reinforcement learning (MORL)…

Machine Learning · Computer Science 2024-05-10 Tianchen Zhou , FNU Hairi , Haibo Yang , Jia Liu , Tian Tong , Fan Yang , Michinari Momma , Yan Gao

Active learning methods have recently surged in the literature due to their ability to solve complex structural reliability problems within an affordable computational cost. These methods are designed by adaptively building an inexpensive…

Computation · Statistics 2022-02-08 M. Moustapha , S. Marelli , B. Sudret

Large-scale multiobjective optimization problems (LSMOPs) refer to optimization problems with multiple conflicting optimization objectives and hundreds or even thousands of decision variables. A key point in solving LSMOPs is how to balance…

Neural and Evolutionary Computing · Computer Science 2023-04-17 Haokai Hong , Min Jiang , Liang Feng , Qiuzhen Lin , Kay Chen Tan

The exploration-exploitation trade-off is central to the description of adaptive behaviour in fields ranging from machine learning, to biology, to economics. While many approaches have been taken, one approach to solving this trade-off has…

Machine Learning · Computer Science 2021-11-29 Beren Millidge , Anil Seth , Christopher Buckley

Expensive multi-objective optimization problems can be found in many real-world applications, where their objective function evaluations involve expensive computations or physical experiments. It is desirable to obtain an approximate Pareto…

Neural and Evolutionary Computing · Computer Science 2022-10-18 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang