English
Related papers

Related papers: Generalizing Beyond Suboptimality: Offline Reinfor…

200 papers

Model-based reinforcement learning algorithms, which aim to learn a model of the environment to make decisions, are more sample efficient than their model-free counterparts. The sample efficiency of model-based approaches relies on whether…

Machine Learning · Computer Science 2021-12-21 Zhihai Wang , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

Learned construction heuristics for scheduling problems have become increasingly competitive with established solvers and heuristics in recent years. In particular, significant improvements have been observed in solution approaches using…

Artificial Intelligence · Computer Science 2024-06-12 Constantin Waubert de Puiseau , Christian Dörpelkus , Jannik Peters , Hasan Tercan , Tobias Meisen

Job-shop scheduling problem (JSP) is a mathematical optimization problem widely used in industries like manufacturing, and flexible JSP (FJSP) is also a common variant. Since they are NP-hard, it is intractable to find the optimal solution…

Artificial Intelligence · Computer Science 2023-10-04 Kuo-Hao Ho , Ruei-Yu Jheng , Ji-Han Wu , Fan Chiang , Yen-Chi Chen , Yuan-Yu Wu , I-Chen Wu

Sample efficiency is critical when applying learning-based methods to robotic manipulation due to the high cost of collecting expert demonstrations and the challenges of on-robot policy learning through online Reinforcement Learning (RL).…

Machine Learning · Computer Science 2024-06-21 Arsh Tangri , Ondrej Biza , Dian Wang , David Klee , Owen Howell , Robert Platt

Reinforcement Learning (RL) has recently received significant attention from the process systems engineering and control communities. Recent works have investigated the application of RL to identify optimal scheduling decision in the…

Systems and Control · Electrical Eng. & Systems 2022-03-11 Max Mowbray , Dongda Zhang , Ehecatl Antonio Del Rio Chanona

Training Reinforcement Learning (RL) agents in high-stakes applications might be too prohibitive due to the risk associated to exploration. Thus, the agent can only use data previously collected by safe policies. While previous work…

Machine Learning · Computer Science 2021-02-11 Núria Armengol Urpí , Sebastian Curi , Andreas Krause

Offline reinforcement learning (RL) is a promising approach for many control applications but faces challenges such as limited data coverage and value function overestimation. In this paper, we propose an implicit actor-critic (iAC)…

Machine Learning · Computer Science 2024-08-29 Vanshaj Khattar , Ming Jin

The Flexible Job Shop Scheduling Problem (FJSP) is the optimal allocation of a set of jobs to machines. Two primary challenges persist in FJSP: the unpredictable arrival of future jobs and the combinatorial complexity of the problem,…

Artificial Intelligence · Computer Science 2026-05-22 Yu Tang , Muhammad Zakwan , Efe Balta , John Lygeros , Alisa Rupenyan

The following interdisciplinary article presents a memetic algorithm with applying deep reinforcement learning (DRL) for solving practically oriented dual resource constrained flexible job shop scheduling problems (DRC-FJSSP). From research…

Machine Learning · Computer Science 2023-07-10 Felix Grumbach , Nour Eldin Alaa Badr , Pascal Reusch , Sebastian Trojahn

We introduce D2AC, a new model-free reinforcement learning (RL) algorithm designed to train expressive diffusion policies online effectively. At its core is a policy improvement objective that avoids the high variance of typical policy…

Machine Learning · Computer Science 2026-05-25 Lunjun Zhang , Shuo Han , Hanrui Lyu , Bradly C Stadie

Actor-critic Reinforcement Learning (RL) algorithms have achieved impressive performance in continuous control tasks. However, they still suffer two nontrivial obstacles, i.e., low sample efficiency and overestimation bias. To this end, we…

Machine Learning · Computer Science 2022-05-10 Qing Li , Wengang Zhou , Zhenbo Lu , Houqiang Li

We focus on a simulation-based optimization problem of choosing the best design from the feasible space. Although the simulation model can be queried with finite samples, its internal processing rule cannot be utilized in the optimization…

Machine Learning · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia , Jiaqi Yan

The Flexible Job-shop Scheduling Problem (FJSP) is a classical combinatorial optimization problem that has a wide-range of applications in the real world. In order to generate fast and accurate scheduling solutions for FJSP, various deep…

Machine Learning · Computer Science 2025-09-10 Xinquan Wu , Xuefeng Yan , Mingqiang Wei , Donghai Guan

Deploying reinforcement learning in the real world remains challenging due to sample inefficiency, sparse rewards, and noisy visual observations. Prior work leverages demonstrations and human feedback to improve learning efficiency and…

Artificial Intelligence · Computer Science 2026-01-23 Xiefeng Wu , Mingyu Hu , Shu Zhang

Offline reinforcement learning (RL), which seeks to learn an optimal policy using offline data, has garnered significant interest due to its potential in critical applications where online data collection is infeasible or expensive. This…

Machine Learning · Computer Science 2024-02-09 Jiin Woo , Laixi Shi , Gauri Joshi , Yuejie Chi

In reinforcement learning (RL), function approximation errors are known to easily lead to the Q-value overestimations, thus greatly reducing policy performance. This paper presents a distributional soft actor-critic (DSAC) algorithm, which…

Machine Learning · Computer Science 2021-06-14 Jingliang Duan , Yang Guan , Shengbo Eben Li , Yangang Ren , Bo Cheng

Offline constrained reinforcement learning (RL) aims to learn a policy that maximizes the expected cumulative reward subject to constraints on expected cumulative cost using an existing dataset. In this paper, we propose Primal-Dual-Critic…

Machine Learning · Computer Science 2023-10-23 Kihyuk Hong , Yuhang Li , Ambuj Tewari

We study the problem of safe offline reinforcement learning (RL), the goal is to learn a policy that maximizes long-term reward while satisfying safety constraints given only offline data, without further interaction with the environment.…

Machine Learning · Computer Science 2022-04-11 Haoran Xu , Xianyuan Zhan , Xiangyu Zhu

The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other…

Artificial Intelligence · Computer Science 2023-10-19 Jianlan Luo , Perry Dong , Jeffrey Wu , Aviral Kumar , Xinyang Geng , Sergey Levine

Offline reinforcement learning (RL) provides a promising approach to avoid costly online interaction with the real environment. However, the performance of offline RL highly depends on the quality of the datasets, which may cause…

Robotics · Computer Science 2024-05-08 Yiwen Hou , Haoyuan Sun , Jinming Ma , Feng Wu