English
Related papers

Related papers: Black-Box Combinatorial Optimization with Order-In…

200 papers

In this paper, we try to improve exploration in Blackbox methods, particularly Evolution strategies (ES), when applied to Reinforcement Learning (RL) problems where intermediate waypoints/subgoals are available. Since Evolutionary…

Robotics · Computer Science 2023-07-04 Kiran Lekkala , Laurent Itti

Compact optimization algorithms are a class of Estimation of Distribution Algorithms (EDAs) characterized by extremely limited memory requirements (hence they are called "compact"). As all EDAs, compact algorithms build and update a…

Artificial Intelligence · Computer Science 2019-04-11 Giovanni Iacca , Fabio Caraffini

Prior work in multi-objective reinforcement learning typically uses linear reward scalarization with fixed weights, which provably fails to capture non-convex Pareto fronts and thus yields suboptimal results. This limitation becomes…

Machine Learning · Computer Science 2026-04-01 Yining Lu , Zilong Wang , Shiyang Li , Xin Liu , Changlong Yu , Qingyu Yin , Zhan Shi , Zixuan Zhang , Meng Jiang

This work investigates the formal policy synthesis of continuous-state stochastic dynamic systems given high-level specifications in linear temporal logic. To learn an optimal policy that maximizes the satisfaction probability, we take a…

Artificial Intelligence · Computer Science 2023-04-21 Lening Li , Zhentian Qian

Finding optimal bidding strategies for generation units in electricity markets would result in higher profit. However, it is a challenging problem due to the system uncertainty which is due to the unknown other generation units' strategies.…

Artificial Intelligence · Computer Science 2022-08-15 Pegah Rokhforoz , Olga Fink

The design of good heuristics or approximation algorithms for NP-hard combinatorial optimization problems often requires significant specialized knowledge and trial-and-error. Can we automate this challenging, tedious process, and learn the…

Machine Learning · Computer Science 2018-02-23 Hanjun Dai , Elias B. Khalil , Yuyu Zhang , Bistra Dilkina , Le Song

We propose Ephemeral Value Adjusments (EVA): a means of allowing deep reinforcement learning agents to rapidly adapt to experience in their replay buffer. EVA shifts the value predicted by a neural network with an estimate of the value…

Machine Learning · Computer Science 2018-10-19 Steven Hansen , Pablo Sprechmann , Alexander Pritzel , André Barreto , Charles Blundell

Deep reinforcement learning algorithms can perform poorly in real-world tasks due to the discrepancy between source and target environments. This discrepancy is commonly viewed as the disturbance in transition dynamics. Many existing…

Machine Learning · Computer Science 2021-12-21 Yufei Kuang , Miao Lu , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

Recent work has shown that standard training via empirical risk minimization (ERM) can produce models that achieve high accuracy on average but low accuracy on underrepresented groups due to the prevalence of spurious features. A…

Machine Learning · Computer Science 2023-05-11 Yachuan Liu , Bohan Zhang , Qiaozhu Mei , Paramveer Dhillon

Approaches based on Binary decision diagrams (BDDs) have recently achieved state-of-the-art results for multiobjective integer programming problems. The variable ordering used in constructing BDDs can have a significant impact on their size…

Artificial Intelligence · Computer Science 2023-07-07 Rahul Patel , Elias B. Khalil

Black-box optimization is a very active area of research, with many new algorithms being developed every year. This variety is needed, on the one hand, since different algorithms are most suitable for different types of optimization…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Anja Jankovic , Tome Eftimov , Carola Doerr

Online black-box optimization (BBO) aims to optimize an objective function by iteratively querying a black-box oracle in a sample-efficient way. While prior studies focus on forward approaches such as Gaussian Processes (GPs) to learn a…

Machine Learning · Computer Science 2025-02-04 Dongxia Wu , Nikki Lijing Kuang , Ruijia Niu , Yi-An Ma , Rose Yu

Bayesian Optimization (BO) has shown significant success in tackling expensive low-dimensional black-box optimization problems. Many optimization problems of interest are high-dimensional, and scaling BO to such settings remains an…

Machine Learning · Statistics 2022-06-02 Eric Han , Ishank Arora , Jonathan Scarlett

Evolutionary computation (EC) algorithms, renowned as powerful black-box optimizers, leverage a group of individuals to cooperatively search for the optimum. The exploration-exploitation tradeoff (EET) plays a crucial role in EC, which,…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Zeyuan Ma , Jiacheng Chen , Hongshu Guo , Yining Ma , Yue-Jiao Gong

Although in recent years reinforcement learning has become very popular the number of successful applications to different kinds of operations research problems is rather scarce. Reinforcement learning is based on the well-studied dynamic…

Machine Learning · Computer Science 2020-04-03 Manuel Schneckenreither

Large Reasoning Models are typically trained via reinforcement learning from verifiable rewards (RLVR). However, existing approaches adopt fixed weights for positive and negative samples, and the conclusions hardly generalize to open-ended…

Artificial Intelligence · Computer Science 2026-05-28 Yunsheng Zeng , Gen Li , Yuwei Miao , Xiandong Li , Yujin Wang , Siyu Chen , Luning Wang , Yunhao Qiao , Junfeng Wang , Jianwei Lv , Bo Yuan

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

Empirical data plays an important role in evolutionary computation research. To make better use of the available data, ontologies have been proposed in the literature to organize their storage in a structured way. However, the full…

Neural and Evolutionary Computing · Computer Science 2023-01-25 Ana Kostovska , Diederick Vermetten , Sašo Džeroski , Panče Panov , Tome Eftimov , Carola Doerr

This research reports on the recent development of a black-box optimization method based on single-step deep reinforcement learning (DRL), and on its conceptual proximity to evolution strategy (ES) techniques. In the fashion of policy…

Optimization and Control · Mathematics 2021-11-29 Jonathan Viquerat , Régis Duvigneau , Philippe Meliga , Alexander Kuhnle , Elie Hachem