English
Related papers

Related papers: HJB Optimal Feedback Control with Deep Differentia…

200 papers

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

Many applications -- including power systems, robotics, and economics -- involve a dynamical system interacting with a stochastic and hard-to-model environment. We adopt a reinforcement learning approach to control such systems.…

Optimization and Control · Mathematics 2025-08-26 Abed AlRahman Al Makdah , Oliver Kosut , Lalitha Sankar , Shaofeng Zou

We study automated intrusion prevention using reinforcement learning. In a novel approach, we formulate the problem of intrusion prevention as an optimal stopping problem. This formulation allows us insight into the structure of the optimal…

Artificial Intelligence · Computer Science 2024-04-23 Kim Hammar , Rolf Stadler

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yi Shen , Zachary Bell , Scott Nivison , Boyuan Chen , Michael M. Zavlanos

We present a neural network approach for approximating the value function of high-dimensional stochastic control problems. Our training process simultaneously updates our value function estimate and identifies the part of the state space…

Optimization and Control · Mathematics 2024-05-08 Xingjian Li , Deepanshu Verma , Lars Ruthotto

Learning to control unknown nonlinear dynamical systems is a fundamental problem in reinforcement learning and control theory. A commonly applied approach is to first explore the environment (exploration), learn an accurate model of it…

Machine Learning · Computer Science 2023-06-16 Andrew Wagenmaker , Guanya Shi , Kevin Jamieson

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Reference tracking systems involve a plant that is stabilized by a local feedback controller and a command center that indicates the reference set-point the plant should follow. Typically, these systems are subject to limitations such as…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Maria Angelica Arroyo , Luis Felipe Giraldo

We consider a new form of reinforcement learning (RL) that is based on opportunities to directly learn the optimal control policy and a general Markov decision process (MDP) framework devised to support these opportunities. Derivations of…

Machine Learning · Computer Science 2021-04-02 Yingdong Lu , Mark S. Squillante , Chai Wah Wu

We study the inverse optimal control problem in social sciences: we aim at learning a user's true cost function from the observed temporal behavior. In contrast to traditional phenomenological works that aim to learn a generative model to…

Machine Learning · Computer Science 2018-05-23 Yichen Wang , Le Song , Hongyuan Zha

Continuous control and planning remains a major challenge in robotics and machine learning. Neuroscience offers the possibility of learning from animal brains that implement highly successful controllers, but it is unclear how to relate an…

Artificial Intelligence · Computer Science 2019-08-14 Saurabh Daptardar , Paul Schrater , Xaq Pitkow

We develop a deep reinforcement learning framework for tactical decision making in an autonomous truck, specifically for Adaptive Cruise Control (ACC) and lane change maneuvers in a highway scenario. Our results demonstrate that it is…

Machine Learning · Computer Science 2025-11-10 Deepthi Pathare , Leo Laine , Morteza Haghir Chehreghani

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

In many real-world decision making problems, reaching an optimal decision requires taking into account a variable number of objects around the agent. Autonomous driving is a domain in which this is especially relevant, since the number of…

Machine Learning · Computer Science 2020-08-13 Maria Hügle , Gabriel Kalweit , Branka Mirchevska , Moritz Werling , Joschka Boedecker

Deep reinforcement learning (DRL) allows a system to interact with its environment and take actions by training an efficient policy that maximizes self-defined rewards. In autonomous driving, it can be used as a strategy for high-level…

Robotics · Computer Science 2024-07-02 Xibo Li , Shruti Patel , Christof Büskens

The optimal tracking problem is addressed in the robotics literature by using a variety of robust and adaptive control approaches. However, these schemes are associated with implementation limitations such as applicability in uncertain…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Mohammed Abouheaf , Wail Gueaieb , Davide Spinello

Motion planning for autonomous vehicles requires spatio-temporal motion plans (i.e. state trajectories) to account for dynamic obstacles. This requires a trajectory tracking control process which faithfully tracks planned trajectories. In…

Robotics · Computer Science 2018-11-13 Peng Liu , Brian Paden , Umit Ozguner

Conveying complex objectives to reinforcement learning (RL) agents can often be difficult, involving meticulous design of reward functions that are sufficiently informative yet easy enough to provide. Human-in-the-loop RL methods allow…

Machine Learning · Computer Science 2021-06-10 Kimin Lee , Laura Smith , Pieter Abbeel

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear…

Systems and Control · Electrical Eng. & Systems 2021-05-03 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker