中文
相关论文

相关论文: Solving robust MDPs as a sequence of static RL pro…

200 篇论文

Model-based Deep Reinforcement Learning (RL) assumes the availability of a model of an environment's underlying transition dynamics. This model can be used to predict future effects of an agent's possible actions. When no such model is…

机器学习 · 计算机科学 2021-12-15 Andreas Sedlmeier , Michael Kölle , Robert Müller , Leo Baudrexel , Claudia Linnhoff-Popien

Reinforcement learning (RL) has shown promise in solving various combinatorial optimization problems. However, conventional RL faces challenges when dealing with complex, real-world constraints, especially when action space feasibility is…

机器学习 · 计算机科学 2025-08-12 Jaike van Twiller , Yossiri Adulyasak , Erick Delage , Djordje Grbic , Rune Møller Jensen

One key challenge for multi-task Reinforcement learning (RL) in practice is the absence of task indicators. Robust RL has been applied to deal with task ambiguity, but may result in over-conservative policies. To balance the worst-case…

机器学习 · 计算机科学 2022-10-25 Mengdi Xu , Peide Huang , Yaru Niu , Visak Kumar , Jielin Qiu , Chao Fang , Kuan-Hui Lee , Xuewei Qi , Henry Lam , Bo Li , Ding Zhao

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

机器学习 · 计算机科学 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

The energy transition potentially poses an existential risk for major international oil companies (IOCs) if they fail to adapt to low-carbon business models. Projections of energy futures, however, are met with diverging assumptions on its…

In recent years, robust Markov decision processes (MDPs) have emerged as a prominent modeling framework for dynamic decision problems affected by uncertainty. In contrast to classical MDPs, which only account for stochasticity by modeling…

最优化与控制 · 数学 2023-12-14 Chin Pang Ho , Marek Petrik , Wolfram Wiesemann

In the rapidly changing healthcare landscape, the implementation of offline reinforcement learning (RL) in dynamic treatment regimes (DTRs) presents a mix of unprecedented opportunities and challenges. This position paper offers a critical…

机器学习 · 计算机科学 2024-06-05 Zhiyao Luo , Yangchen Pan , Peter Watkinson , Tingting Zhu

Portfolio management is a fundamental problem in finance. It involves periodic reallocations of assets to maximize the expected returns within an appropriate level of risk exposure. Deep reinforcement learning (RL) has been considered a…

计算金融 · 定量金融 2022-10-05 Hui Niu , Siyuan Li , Jian Li

We investigate robust model-free reinforcement learning algorithms designed for environments that may be dynamic or even adversarial. Traditional state-based policies often struggle to accommodate the challenges imposed by the presence of…

机器学习 · 计算机科学 2023-11-02 Udaya Ghai , Arushi Gupta , Wenhan Xia , Karan Singh , Elad Hazan

Traditional linear control strategies have been extensively researched and utilized in many robotic and industrial applications and yet they do not respond to the total dynamics of the systems. To avoid tedious calculations for nonlinear…

机器人学 · 计算机科学 2022-03-16 Kanishk . , Rushil Kumar , Vikas Rastogi , Ajeet Kumar

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

系统与控制 · 计算机科学 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

In this work we address the problem of performing a repetitive task when we have uncertain observations and dynamics. We formulate this problem as an iterative infinite horizon optimal control problem with output feedback. Previously, this…

系统与控制 · 电气工程与系统科学 2021-10-04 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

Reactive synthesis algorithms allow automatic construction of policies to control an environment modeled as a Markov Decision Process (MDP) that are optimal with respect to high-level temporal logic specifications. However, they assume that…

形式语言与自动机理论 · 计算机科学 2022-05-31 Rajeev Alur , Suguman Bansal , Osbert Bastani , Kishor Jothimurugan

Non-stationary environments are challenging for reinforcement learning algorithms. If the state transition and/or reward functions change based on latent factors, the agent is effectively tasked with optimizing a behavior that maximizes…

机器学习 · 计算机科学 2021-05-21 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

Decision and control are core functionalities of high-level automated vehicles. Current mainstream methods, such as functionality decomposition and end-to-end reinforcement learning (RL), either suffer high time complexity or poor…

机器学习 · 计算机科学 2021-05-12 Yang Guan , Yangang Ren , Qi Sun , Shengbo Eben Li , Haitong Ma , Jingliang Duan , Yifan Dai , Bo Cheng

Solving control tasks in complex environments automatically through learning offers great potential. While contemporary techniques from deep reinforcement learning (DRL) provide effective solutions, their decision-making is not transparent.…

机器学习 · 计算机科学 2023-07-03 Martin Tappler , Edi Muškardin , Bernhard K. Aichernig , Bettina Könighofer

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

人工智能 · 计算机科学 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

The rapid development of machine learning (ML) and artificial intelligence (AI) applications requires the training of large numbers of models. This growing demand highlights the importance of training models without human supervision, while…

机器学习 · 计算机科学 2025-05-26 Alexey Boldyrev , Fedor Ratnikov , Andrey Shevelev

Ensuring the robustness of deep reinforcement learning (DRL) agents against adversarial attacks is critical for their trustworthy deployment. Recent research highlights the challenges of achieving state-adversarial robustness and suggests…

机器学习 · 计算机科学 2025-02-25 Haoran Li , Zicheng Zhang , Wang Luo , Congying Han , Jiayu Lv , Tiande Guo , Yudong Hu

Recently, deep reinforcement learning (DRL) models have shown promising results in solving NP-hard Combinatorial Optimization (CO) problems. However, most DRL solvers can only scale to a few hundreds of nodes for combinatorial optimization…

机器学习 · 计算机科学 2022-10-26 Ruizhong Qiu , Zhiqing Sun , Yiming Yang