English
Related papers

Related papers: Balancing the exploration-exploitation trade-off i…

200 papers

Active multi-fidelity surrogate modeling is developed for multi-condition airfoil shape optimization to reduce high-fidelity CFD cost while retaining RANS-level accuracy. The framework couples a low-fidelity-informed Gaussian process…

We present MOSS, a multi-objective optimization framework for constructing stable sets of decision rules. MOSS incorporates three important criteria for interpretability: sparsity, accuracy, and stability, into a single multi-objective…

Optimization and Control · Mathematics 2025-07-31 Brian Liu , Rahul Mazumder

Multi-agent reinforcement learning (MARL) algorithms often struggle to find strategies close to Pareto optimal Nash Equilibrium, owing largely to the lack of efficient exploration. The problem is exacerbated in sparse-reward settings,…

Machine Learning · Computer Science 2024-05-03 Zhicheng Zhang , Yancheng Liang , Yi Wu , Fei Fang

Model-based reinforcement learning (RL), which finds an optimal policy using an empirical model, has long been recognized as one of the corner stones of RL. It is especially suitable for multi-agent RL (MARL), as it naturally decouples the…

Machine Learning · Computer Science 2023-08-10 Kaiqing Zhang , Sham M. Kakade , Tamer Başar , Lin F. Yang

Model-Based Reinforcement Learning (MBRL) offers a promising direction for sample efficient learning, often achieving state of the art results for continuous control tasks. However, many existing MBRL methods rely on combining greedy…

Machine Learning · Computer Science 2020-02-10 Philip Ball , Jack Parker-Holder , Aldo Pacchiano , Krzysztof Choromanski , Stephen Roberts

Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), yet its efficacy is primarily confined to domains with verifiable ground truths. Extending GRPO to open-domain…

Machine Learning · Computer Science 2026-04-14 Yang Zhao , Hepeng Wang , Xiao Ding , Yangou Ouyang , Bibo Cai , Kai Xiong , Jinglong Gao , Zhouhao Sun , Li Du , Bing Qin , Ting Liu

By searching for shared inductive biases across tasks, meta-learning promises to accelerate learning on novel tasks, but with the cost of solving a complex bilevel optimization problem. We introduce and rigorously define the trade-off…

Machine Learning · Computer Science 2021-04-15 Katelyn Gao , Ozan Sener

The performance of offline reinforcement learning (RL) suffers from the limited size and quality of static datasets. Model-based offline RL addresses this issue by generating synthetic samples through a dynamics model to enhance overall…

Machine Learning · Computer Science 2024-11-13 Zhongjian Qiao , Jiafei Lyu , Kechen Jiao , Qi Liu , Xiu Li

We study zeroth-order optimization where solutions must minimize a cost $d(s)$ while maintaining high probability under a complex generative prior $L(s)$ (e.g., a parameterized model). This reduces to sampling from a target distribution…

Machine Learning · Computer Science 2026-05-06 Pranjal Awasthi , Sreenivas Gollapudi , Ravi Kumar , Kamesh Munagala

Pareto Front Learning (PFL) was recently introduced as an effective approach to obtain a mapping function from a given trade-off vector to a solution on the Pareto front, which solves the multi-objective optimization (MOO) problem. Due to…

Machine Learning · Computer Science 2023-05-02 Long P. Hoang , Dung D. Le , Tran Anh Tuan , Tran Ngoc Thang

Reinforcement Learning aims at identifying and evaluating efficient control policies from data. In many real-world applications, the learner is not allowed to experiment and cannot gather data in an online manner (this is the case when…

Machine Learning · Computer Science 2024-07-02 Daniele Foffano , Alessio Russo , Alexandre Proutiere

Optimization has found numerous applications in engineering, particularly since 1960s. Many optimization applications in engineering have more than one objective (or performance criterion). Such applications require multi-objective (or…

Chemical Physics · Physics 2024-07-16 Zhiyuan Wang , Seyed Reza Nabavi , Gade Pandu Rangaiah

We employ an evolutionary optimization framework that perturbs initial states to generate informative and diverse policy demonstrations. A joint surrogate fitness function guides the optimization by combining local diversity, behavioral…

Machine Learning · Computer Science 2025-04-22 Philipp Altmann , Céline Davignon , Maximilian Zorn , Fabian Ritz , Claudia Linnhoff-Popien , Thomas Gabor

The goal of meta-reinforcement learning (meta-RL) is to build agents that can quickly learn new tasks by leveraging prior experience on related tasks. Learning a new task often requires both exploring to gather task-relevant information and…

Machine Learning · Computer Science 2021-11-15 Evan Zheran Liu , Aditi Raghunathan , Percy Liang , Chelsea Finn

Bayesian Optimization (BO) is a key methodology for accelerating molecular discovery by estimating the mapping from molecules to their properties while seeking the optimal candidate. Typically, BO iteratively updates a probabilistic…

Machine Learning · Computer Science 2025-12-17 Qi Chen , Fabio Ramos , Alán Aspuru-Guzik , Florian Shkurti

Multi-Objective Optimization (MOO) is very difficult for expensive functions because most current MOO methods rely on a large number of function evaluations to get an accurate solution. We address this problem with surrogate approximation…

Neural and Evolutionary Computing · Computer Science 2019-03-07 Taimoor Akhtar , Christine A. Shoemaker

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

In surrogate ensemble attacks, using more surrogate models yields higher transferability but lower resource efficiency. This practical trade-off between transferability and efficiency has largely limited existing attacks despite many…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Yang , Hengwei Zhang , Jindong Wang , Yuchen Ren , Chenhao Lin , Chao Shen , Zhengyu Zhao

The exploration-exploitation dilemma in reinforcement learning (RL) is a fundamental challenge to efficient RL algorithms. Existing algorithms for finite state and action discounted RL problems address this by assuming sufficient…

Machine Learning · Computer Science 2025-12-09 Caleb Ju , Guanghui Lan

An important question that often arises in the operation of networked systems is whether to collect the real-time data or to estimate them based on the previously collected data. Various factors should be taken into account such as how…

Optimization and Control · Mathematics 2021-03-30 Jalal Arabneydi , Amir G. Aghdam