English
Related papers

Related papers: KL-based Control of the Learning Schedule for Surr…

200 papers

We propose a model-based reinforcement learning (RL) approach for noisy time-dependent gate optimization with improved sample complexity over model-free RL. Sample complexity is the number of controller interactions with the physical…

The Continual Learning (CL) problem involves performing well on a sequence of tasks under limited compute. Current algorithms in the domain are either slow, offline or sensitive to hyper-parameters. La-MAML, an optimization-based…

Machine Learning · Computer Science 2021-05-21 Joel Joseph , Alex Gu

Experimental robot optimization often requires evaluating each candidate policy for seconds to minutes. The chosen evaluation time influences optimization because of a speed-accuracy tradeoff: shorter evaluations enable faster iteration,…

Neural and Evolutionary Computing · Computer Science 2026-01-15 Russell M. Martin , Steven H. Collins

Discrete and mixed-variable optimization problems have appeared in several real-world applications. Most of the research on mixed-variable optimization considers a mixture of integer and continuous variables, and several integer handlings…

Optimization and Control · Mathematics 2024-08-26 Kento Uchida , Ryoki Hamano , Masahiro Nomura , Shota Saito , Shinichi Shirakawa

We propose RHEA CL, which combines Curriculum Learning (CL) with Rolling Horizon Evolutionary Algorithms (RHEA) to automatically produce effective curricula during the training of a reinforcement learning agent. RHEA CL optimizes a…

Artificial Intelligence · Computer Science 2024-08-13 Mohit Jiwatode , Leon Schlecht , Alexander Dockhorn

We address multi-robot motion planning under Signal Temporal Logic (STL) specifications with kinodynamic constraints. Exact approaches face scalability bottlenecks and limited adaptability, while conventional sampling-based methods require…

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

Neural and Evolutionary Computing · Computer Science 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

Restart strategy helps the covariance matrix adaptation evolution strategy (CMA-ES) to increase the probability of finding the global optimum in optimization, while a single run CMA-ES is easy to be trapped in local optima. In this paper,…

Neural and Evolutionary Computing · Computer Science 2020-04-28 Yang Lou , Shiu Yin Yuen , Guanrong Chen , Xin Zhang

In recent years, solving optimization problems involving black-box simulators has become a point of focus for the machine learning community due to their ubiquity in science and engineering. The simulators describe a forward process…

Machine Learning · Computer Science 2024-06-07 Fabio Valerio Massoli , Tim Bakker , Thomas Hehn , Tribhuvanesh Orekondy , Arash Behboodi

Black-box optimization problems often require simultaneously optimizing different types of variables, such as continuous, integer, and categorical variables. Unlike integer variables, categorical variables do not necessarily have a…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Ryoki Hamano , Shota Saito , Masahiro Nomura , Kento Uchida , Shinichi Shirakawa

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Recent works in learning-integrated optimization have shown promise in settings where the optimization problem is only partially observed or where general-purpose optimizers perform poorly without expert tuning. By learning an optimizer…

Machine Learning · Computer Science 2023-11-06 Arman Zharmagambetov , Brandon Amos , Aaron Ferber , Taoan Huang , Bistra Dilkina , Yuandong Tian

Offline optimization is a fundamental challenge in science and engineering, where the goal is to optimize black-box functions using only offline datasets. This setting is particularly relevant when querying the objective function is…

Machine Learning · Computer Science 2026-01-07 Minsu Kim , Jiayao Gu , Ye Yuan , Taeyoung Yun , Zixuan Liu , Yoshua Bengio , Can Chen

A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for…

Machine Learning · Computer Science 2021-07-28 Laurens Bliek , Arthur Guijt , Sicco Verwer , Mathijs de Weerdt

Bayesian optimization (BO) has demonstrated potential for optimizing control performance in data-limited settings, especially for systems with unknown dynamics or unmodeled performance objectives. The BO algorithm efficiently trades-off…

Machine Learning · Computer Science 2022-11-02 Ankush Chakrabarty

Recent advancements in Machine Learning (ML) have substantially improved its predictive and computational abilities, offering promising opportunities for surrogate modeling in scientific applications. By accurately approximating complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zane Fink , Konstantinos Parasyris , Praneet Rathi , Giorgis Georgakoudis , Harshitha Menon , Peer-Timo Bremer

Optimum implementation of non-conventional wells allows us to increase considerably hydrocarbon recovery. By considering the high drilling cost and the potential improvement in well productivity, well placement decision is an important…

Computational Engineering, Finance, and Science · Computer Science 2010-11-25 Zyed Bouzarkouna , Didier Yu Ding , Anne Auger

The problem of scheduling of workloads onto heterogeneous processors (e.g., CPUs, GPUs, FPGAs) is of fundamental importance in modern data centers. Current system schedulers rely on application/system-specific heuristics that have to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-01 Subho S Banerjee , Saurabh Jha , Zbigniew T. Kalbarczyk , Ravishankar K. Iyer

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an…

Neural and Evolutionary Computing · Computer Science 2026-05-01 Khoirul Faiq Muzakka , Sören Möller , Martin Finsterbusch

Surrogate-assisted evolutionary algorithms have been widely developed to solve complex and computationally expensive multi-objective optimization problems in recent years. However, when dealing with high-dimensional optimization problems,…

Neural and Evolutionary Computing · Computer Science 2024-03-19 Guodong Chen , Jiu Jimmy Jiao , Xiaoming Xue , Zhongzheng Wang