English
Related papers

Related papers: Learning to Do or Learning While Doing: Reinforcem…

200 papers

To avoid myopic behavior, multi-step lookahead Bayesian optimization (BO) algorithms consider the sequential nature of BO and have demonstrated promising results in recent years. However, owing to the curse of dimensionality, most of these…

Machine Learning · Computer Science 2026-04-24 Mujin Cheon , Jay H. Lee , Dong-Yeun Koh , Calvin Tsay

Bayesian optimisation has been successfully applied to a variety of reinforcement learning problems. However, the traditional approach for learning optimal policies in simulators does not utilise the opportunity to improve learning by…

Bayesian optimization (BO) has become a popular strategy for global optimization of many expensive real-world functions. Contrary to a common belief that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

Machine Learning · Computer Science 2022-07-08 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zelda Mariet , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Learning to optimize (L2O) has gained increasing attention since classical optimizers require laborious problem-specific design and hyperparameter tuning. However, there is a gap between the practical demand and the achievable performance…

Machine Learning · Computer Science 2020-10-20 Tianlong Chen , Weiyi Zhang , Jingyang Zhou , Shiyu Chang , Sijia Liu , Lisa Amini , Zhangyang Wang

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

Towards designing learned optimization algorithms that are usable beyond their training setting, we identify key principles that classical algorithms obey, but have up to now, not been used for Learning to Optimize (L2O). Following these…

Machine Learning · Computer Science 2025-09-19 Camille Castera , Peter Ochs

Meta-Bayesian optimisation (meta-BO) aims to improve the sample efficiency of Bayesian optimisation by leveraging data from related tasks. While previous methods successfully meta-learn either a surrogate model or an acquisition function…

Machine Learning · Computer Science 2023-12-25 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Haitham Bou Ammar

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

Machine Learning · Computer Science 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

Systems and machines undergo various failure modes that result in machine health degradation, so maintenance actions are required to restore them back to a state where they can perform their expected functions. Since maintenance tasks are…

Machine Learning · Computer Science 2023-07-11 Oluwaseyi Ogunfowora , Homayoun Najjaran

Reinforcement learning (RL) is a general and well-known method that a robot can use to learn an optimal control policy to solve a particular task. We would like to build a versatile robot that can learn multiple tasks, but using RL for each…

Artificial Intelligence · Computer Science 2015-12-01 Lisa Lee

Learning to Optimize (L2O) enhances optimization efficiency with integrated neural networks. L2O paradigms achieve great outcomes, e.g., refitting optimizer, generating unseen solutions iteratively or directly. However, conventional L2O…

Machine Learning · Computer Science 2025-03-17 Mingjia Shi , Ruihan Lin , Xuxi Chen , Yuhao Zhou , Zezhen Ding , Pingzhi Li , Tong Wang , Kai Wang , Zhangyang Wang , Jiheng Zhang , Tianlong Chen

Policy optimization in reinforcement learning requires the selection of numerous hyperparameters across different environments. Fixing them incorrectly may negatively impact optimization performance leading notably to insufficient or…

Robotics · Computer Science 2021-03-26 Jiancong Huang , Juan Rojas , Matthieu Zimmer , Hongmin Wu , Yisheng Guan , Paul Weng

Learning to Optimize (LtO) is a problem setting in which a machine learning (ML) model is trained to emulate a constrained optimization solver. Learning to produce optimal and feasible solutions subject to complex constraints is a difficult…

Machine Learning · Computer Science 2024-03-18 James Kotary , Ferdinando Fioretto

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

Computation · Statistics 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Deep Reinforcement Learning (DRL) experiments are commonly performed in simulated environments due to the tremendous training sample demands from deep neural networks. In contrast, model-based Bayesian Learning allows a robot to learn good…

Robotics · Computer Science 2022-01-11 Jingyi Huang , Yizheng Zhang , Fabio Giardina , Andre Rosendo

Reinforcement learning (RL) is attracting increasing interests in autonomous driving due to its potential to solve complex classification and control problems. However, existing RL algorithms are rarely applied to real vehicles for two…

Machine Learning · Computer Science 2020-03-04 Lu Wen , Jingliang Duan , Shengbo Eben Li , Shaobing Xu , Huei Peng

We investigate machine learning approaches for optimizing real-time staffing decisions in semi-automated warehouse sortation systems. Operational decision-making can be supported at different levels of abstraction, with different…

Machine Learning · Computer Science 2026-03-27 Kalle Kujanpää , Yuying Zhu , Kristina Klinkner , Shervin Malmasi

Developments in reinforcement learning (RL) have allowed algorithms to achieve impressive performance in highly complex, but largely static problems. In contrast, biological learning seems to value efficiency of adaptation to a…

Artificial Intelligence · Computer Science 2022-05-20 Eric Chalmers , Artur Luczak

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

Machine Learning · Computer Science 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen