English
Related papers

Related papers: EARL-BO: Reinforcement Learning for Multi-Step Loo…

200 papers

Bayesian optimization (BO) is a popular approach for optimizing expensive-to-evaluate black-box objective functions. An important challenge in BO is its application to high-dimensional search spaces due in large part to the curse of…

Machine Learning · Computer Science 2025-05-27 Wei-Ting Tang , Joel A. Paulson

Model-based reinforcement learning (RL) algorithms allow us to combine model-generated data with those collected from interaction with the real system in order to alleviate the data efficiency problem in RL. However, designing such…

Machine Learning · Computer Science 2020-06-25 Yinlam Chow , Brandon Cui , MoonKyung Ryu , Mohammad Ghavamzadeh

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

Machine Learning · Computer Science 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

Multi-echelon inventory optimization (MEIO) is critical for effective supply chain management, but its inherent complexity can pose significant challenges. Heuristics are commonly used to address this complexity, yet they often face…

Machine Learning · Computer Science 2025-03-25 Georg Ziegner , Michael Choi , Hung Mac Chan Le , Sahil Sakhuja , Arash Sarmadi

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

Machine Learning · Computer Science 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang

When it comes to expensive black-box optimization problems, Bayesian Optimization (BO) is a well-known and powerful solution. Many real-world applications involve a large number of dimensions, hence scaling BO to high dimension is of much…

Machine Learning · Statistics 2024-12-18 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

Machine Learning · Computer Science 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

While image generation techniques are now capable of producing high-quality images that respect prompts which span multiple sentences, the task of text-guided image editing remains a challenge. Even edit requests that consist of only a few…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Saba Ahmadi , Rabiul Awal , Ankur Sikarwar , Amirhossein Kazemnejad , Ge Ya Luo , Juan A. Rodriguez , Sai Rajeswar , Siva Reddy , Christopher Pal , Benno Krojer , Aishwarya Agrawal

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

Machine Learning · Computer Science 2026-01-16 Nadav Merlis

Optimal setting of several hyper-parameters in machine learning algorithms is key to make the most of available data. To this aim, several methods such as evolutionary strategies, random search, Bayesian optimization and heuristic rules of…

Machine Learning · Computer Science 2021-12-16 Juan Cruz Barsce , Jorge A. Palombarini , Ernesto C. Martínez

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

In robotics, deep learning (DL) methods are used more and more widely, but their general inability to provide reliable confidence estimates will ultimately lead to fragile and unreliable systems. This impedes the potential deployments of DL…

Robotics · Computer Science 2020-11-02 Matthias Humt , Jongseok Lee , Rudolph Triebel

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision…

Machine Learning · Computer Science 2021-05-25 Michael Tashman , John Hoffman , Jiayi Xie , Fengdan Ye , Atefeh Morsali , Lee Winikor , Rouzbeh Gerami

The exponential growth of data-intensive applications has placed unprecedented demands on modern storage systems, necessitating dynamic and efficient optimization strategies. Traditional heuristics employed for storage performance…

Operating Systems · Computer Science 2025-08-25 Chiyu Cheng , Chang Zhou , Yang Zhao

This paper introduces Bayesian Hierarchical Low-Rank Adaption (BoRA), a novel method for finetuning multi-task Large Language Models (LLMs). Current finetuning approaches, such as Low-Rank Adaption (LoRA), perform exeptionally well in…

Machine Learning · Computer Science 2025-01-08 Simen Eide , Arnoldo Frigessi

Reinforcement learning (RL) has emerged as a powerful tool for fine-tuning large language models (LLMs) to improve complex reasoning abilities. However, state-of-the-art policy optimization methods often suffer from high computational…

Machine Learning · Computer Science 2025-05-28 Kianté Brantley , Mingyu Chen , Zhaolin Gao , Jason D. Lee , Wen Sun , Wenhao Zhan , Xuezhou Zhang

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

Particle accelerator beamline optimization is a high-dimensional control problem traditionally requiring significant expert intervention. We present RLABC (Reinforcement Learning for Accelerator Beamline Control), an open-source Python…

Machine Learning · Computer Science 2026-04-22 Anwar Ibrahim , Fedor Ratnikov , Maxim Kaledin , Alexey Petrenko , Denis Derkach

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

Robotics · Computer Science 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin