English
Related papers

Related papers: Balancing the exploration-exploitation trade-off i…

200 papers

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Continual learning aims to learn multiple tasks sequentially. A key challenge in continual learning is balancing between two objectives: retaining knowledge from old tasks (stability) and adapting to new tasks (plasticity). Experience…

Machine Learning · Computer Science 2025-04-01 Song Lai , Zhe Zhao , Fei Zhu , Xi Lin , Qingfu Zhang , Gaofeng Meng

For the problem of task-agnostic reinforcement learning (RL), an agent first collects samples from an unknown environment without the supervision of reward signals, then is revealed with a reward and is asked to compute a corresponding…

Machine Learning · Computer Science 2022-03-16 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

We propose a model for making data acquisition decisions for variables in contextual stochastic optimisation problems. Data acquisition decisions are typically treated as separate and fixed. We explore problem settings in which the…

Optimization and Control · Mathematics 2025-04-22 Egon Peršak , Miguel F. Anjos

Reliability-based design optimization (RBDO) is an active field of research with an ever increasing number of contributions. Numerous methods have been proposed for the solution of RBDO, a complex problem that combines optimization and…

Methodology · Statistics 2019-01-11 M. Moustapha , B. Sudret

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

The masking-one-out (MOO) procedure, masking an observed entry and comparing it versus its imputed values, is a very common procedure for comparing imputation models. We study the optimum of this procedure and generalize it to a missing…

Methodology · Statistics 2025-11-14 Yanjiao Yang , Daniel Suen , Yen-Chi Chen

Many real-world situations allow for the acquisition of additional relevant information when making an assessment with limited or uncertain data. However, traditional ML approaches either require all features to be acquired beforehand or…

Machine Learning · Computer Science 2021-02-12 Yang Li , Junier B. Oliva

Multi-objective optimization (MOO) aims at finding a set of optimal configurations for a given set of objectives. A recent line of work applies MOO methods to the typical Machine Learning (ML) setting, which becomes multi-objective if a…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

Machine Learning · Computer Science 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Multi-fidelity optimization employs surrogate models that integrate information from varying levels of fidelity to guide efficient exploration of complex design spaces while minimizing the reliance on (expensive) high-fidelity objective…

Real-world black-box optimization often involves time-consuming or costly experiments and simulations. Multi-fidelity optimization (MFO) stands out as a cost-effective strategy that balances high-fidelity accuracy with computational…

Machine Learning · Computer Science 2024-02-16 Ke Li , Fan Li

Imitation learning is a data-driven approach to learning policies from expert behavior, but it is prone to unreliable outcomes in out-of-sample (OOS) regions. While previous research relying on stable dynamical systems guarantees…

Machine Learning · Computer Science 2025-03-27 Amin Abyaneh , Mahrokh G. Boroujeni , Hsiu-Chin Lin , Giancarlo Ferrari-Trecate

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

Machine Learning · Statistics 2021-10-19 Tristan Fauvel , Matthew Chalk

Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed significant advances in the reasoning capabilities of Large Language Models (LLMs). However, effectively managing the exploration and exploitation trade-off remains a…

Machine Learning · Computer Science 2026-04-16 Xiaofan Li , Ming Yang , Zhiyuan Ma , Shichao Ma , Jintao Du , Yu Cheng , Weiqiang Wang , Zhizhong Zhang , Xin Tan , Yanyun Qu , Lizhuang Ma , Yuan Xie

Reachability computations that rely on learned or estimated models require calibration in order to uphold confidence about their guarantees. Calibration generally involves sampling scenarios inside the reachable set. However, producing…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sampada Deglurkar , Ebonye Smith , Jingqi Li , Claire J. Tomlin

In Multi-objective Reinforcement Learning (MORL) agents are tasked with optimising decision-making behaviours that trade-off between multiple, possibly conflicting, objectives. MORL based on decomposition is a family of solution methods…

Machine Learning · Computer Science 2025-06-17 Yucheng Shi , David Lynch , Alexandros Agapitos

Multi-objective optimization has burgeoned as a potent methodology for informed decision-making in enhanced geothermal systems, aiming to concurrently maximize economic yield, ensure enduring geothermal energy provision, and curtail carbon…

Neural and Evolutionary Computing · Computer Science 2024-11-04 Guodong Chen , Jiu Jimmy Jiao , Qiqi Liu , Zhongzheng Wang , Yaochu Jin

Many scientific and industrial applications require the joint optimization of multiple, potentially competing objectives. Multi-objective Bayesian optimization (MOBO) is a sample-efficient framework for identifying Pareto-optimal solutions.…

Machine Learning · Computer Science 2024-06-10 Ji Won Park , Nataša Tagasovska , Michael Maser , Stephen Ra , Kyunghyun Cho

Software engineers must make decisions that trade off competing goals (faster vs. cheaper, secure vs. usable, accurate vs. interpretable, etc.). Despite MSR's proven techniques for exploring such goals, researchers still struggle with these…

Software Engineering · Computer Science 2026-02-10 Tim Menzies , Tao Chen , Yulong Ye , Kishan Kumar Ganguly , Amirali Rayegan , Srinath Srinivasan , Andre Lustosa