English
Related papers

Related papers: A Differential Dynamic Programming Framework for I…

200 papers

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

Machine Learning · Computer Science 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Inverse reinforcement learning (IRL) learns a reward function and a corresponding policy that best fit the demonstration data of an expert. However, in the current IRL setting, the learner is isolated from the expert and can only passively…

Machine Learning · Computer Science 2026-05-12 Yue Mao , Shicheng Liu , Siyuan Xu , Minghui Zhu

We introduce a new algorithm to solve constrained nonlinear optimal control problem, with an emphasis on low-thrust trajectory in highly nonlinear dynamics. The algorithm, dubbed Pontryagin-Bellman Differential Dynamic Programming (PDDP),…

Optimization and Control · Mathematics 2026-05-27 Yanis Sidhoum , Kenshiro Oguri

This letter presents a method to reduce the computational demands of including second-order dynamics sensitivity information into the Differential Dynamic Programming (DDP) trajectory optimization algorithm. An approach to DDP is developed…

Robotics · Computer Science 2022-07-01 John N. Nganga , Patrick M. Wensing

The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is…

Machine Learning · Computer Science 2022-05-17 Kishan Panaganti , Dileep Kalathil

Deep reinforcement learning (DRL) is one promising approach to teaching robots to perform complex tasks. Because methods that directly reuse the stored experience data cannot follow the change of the environment in robotic problems with a…

Robotics · Computer Science 2022-01-26 Taisuke Kobayashi

In this work, we devise a new, general-purpose reinforcement learning strategy for the optimal control of parametric dynamical systems. Such problems frequently arise in applied sciences and engineering and entail a significant complexity…

Machine Learning · Computer Science 2026-02-12 Nicolò Botteghi , Stefania Fresca , Mengwu Guo , Andrea Manzoni

This article presents a motion planning and control framework for flexible robotic manipulators, integrating deep reinforcement learning (DRL) with a nonlinear partial differential equation (PDE) controller. Unlike conventional approaches…

Robotics · Computer Science 2025-06-11 Amir Hossein Barjini , Seyed Adel Alizadeh Kolagar , Sadeq Yaqubi , Jouni Mattila

A common strategy today to generate efficient locomotion movements is to split the problem into two consecutive steps: the first one generates the contact sequence together with the centroidal trajectory, while the second one computes the…

Robotics · Computer Science 2019-04-11 Rohan Budhiraja , Justin Carpentier , Carlos Mastalli , Nicolas Mansard

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

Robotics · Computer Science 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

Inverse reinforcement learning (IRL) is computationally challenging, with common approaches requiring the solution of multiple reinforcement learning (RL) sub-problems. This work motivates the use of potential-based reward shaping to reduce…

Machine Learning · Computer Science 2023-12-19 Lauren H. Cooke , Harvey Klyne , Edwin Zhang , Cassidy Laidlaw , Milind Tambe , Finale Doshi-Velez

Reward functions are difficult to design and often hard to align with human intent. Preference-based Reinforcement Learning (RL) algorithms address these problems by learning reward functions from human feedback. However, the majority of…

Machine Learning · Computer Science 2023-11-28 Joey Hejna , Dorsa Sadigh

We consider the problem of learning from demonstrated trajectories with inverse reinforcement learning (IRL). Motivated by a limitation of the classical maximum entropy model in capturing the structure of the network of states, we propose…

Machine Learning · Computer Science 2020-08-19 Tien Mai , Kennard Chan , Patrick Jaillet

When applying reinforcement learning (RL) to a new problem, reward engineering is a necessary, but often difficult and error-prone task a system designer has to face. To avoid this step, we propose LR4GPM, a novel (deep) RL method that can…

Machine Learning · Computer Science 2023-03-17 Junqi Qian , Paul Weng , Chenmien Tan

In many reinforcement learning applications, the underlying environment reward and transition functions are explicitly known differentiable functions. This enables us to use recent research which applies machine learning tools to stochastic…

Portfolio Management · Quantitative Finance 2022-04-08 Thibault Jaisson

We introduce a deep reinforcement learning (DRL) approach for solving management problems including inventory management, dynamic pricing, and recommendation. This DRL approach has the potential to lead to a large management model based on…

Artificial Intelligence · Computer Science 2024-03-04 Jinyang Jiang , Xiaotian Liu , Tao Ren , Qinghao Wang , Yi Zheng , Yufu Du , Yijie Peng , Cheng Zhang

Inverse reinforcement learning (IRL) methods assume that the expert data is generated by an agent optimizing some reward function. However, in many settings, the agent may optimize a reward function subject to some constraints, where the…

Machine Learning · Computer Science 2023-05-01 Ashish Gaurav , Kasra Rezaee , Guiliang Liu , Pascal Poupart

The problem of inverse reinforcement learning (IRL) is relevant to a variety of tasks including value alignment and robot learning from demonstration. Despite significant algorithmic contributions in recent years, IRL remains an ill-posed…

Machine Learning · Computer Science 2020-11-18 Sreejith Balakrishnan , Quoc Phong Nguyen , Bryan Kian Hsiang Low , Harold Soh