English
Related papers

Related papers: Learning a Unified Control Policy for Safe Falling

200 papers

We present an Imitation Learning approach for the control of dynamical systems with a known model. Our policy search method is guided by solutions from MPC. Typical policy search methods of this kind minimize a distance metric between the…

Robotics · Computer Science 2020-02-18 Jan Carius , Farbod Farshidian , Marco Hutter

We consider the problem of reinforcement learning when provided with (1) a baseline control policy and (2) a set of constraints that the learner must satisfy. The baseline policy can arise from demonstration data or a teacher agent and may…

Machine Learning · Computer Science 2021-07-13 Tsung-Yen Yang , Justinian Rosca , Karthik Narasimhan , Peter J. Ramadge

We study automated intrusion prevention using reinforcement learning. In a novel approach, we formulate the problem of intrusion prevention as an optimal stopping problem. This formulation allows us insight into the structure of the optimal…

Artificial Intelligence · Computer Science 2024-04-23 Kim Hammar , Rolf Stadler

The ability to accurately predict others' behavior is central to the safety and efficiency of interactive robotics. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as other agents'…

Robotics · Computer Science 2023-11-02 Haimin Hu , David Isele , Sangjae Bae , Jaime F. Fisac

Robot control through contact is challenging as it requires reasoning over long horizons and discontinuous system dynamics. Highly dynamic tasks such as Air Hockey additionally require agile behavior, making the corresponding optimal…

Robotics · Computer Science 2025-05-19 Julius Jankowski , Ante Marić , Puze Liu , Davide Tateo , Jan Peters , Sylvain Calinon

Synchronizing decisions across multiple agents in realistic settings is problematic since it requires agents to wait for other agents to terminate and communicate about termination reliably. Ideally, agents should learn and execute…

Machine Learning · Computer Science 2022-10-12 Yuchen Xiao , Weihao Tan , Christopher Amato

In this work, we consider policy-based methods for solving the reinforcement learning problem, and establish the sample complexity guarantees. A policy-based algorithm typically consists of an actor and a critic. We consider using various…

Machine Learning · Computer Science 2023-01-16 Zaiwei Chen , Siva Theja Maguluri

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

Machine Learning · Computer Science 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

In this paper, we consider the problem of deploying a robot from a specification given as a temporal logic statement about some properties satisfied by the regions of a large, partitioned environment. We assume that the robot has noisy…

Robotics · Computer Science 2012-02-24 Xu Chu Ding , Jing Wang , Morteza Lahijanian , Ioannis Ch. Paschalidis , Calin A. Belta

We propose a reinforcement learning (RL)-based algorithm to jointly train (1) a trajectory planner and (2) a tracking controller in a layered control architecture. Our algorithm arises naturally from a rewrite of the underlying optimal…

Systems and Control · Electrical Eng. & Systems 2024-12-18 Fengjun Yang , Nikolai Matni

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli

Humanoid robots have demonstrated impressive motor skills in a wide range of tasks, yet whole-body control for humanlike long-time, dynamic fighting remains particularly challenging due to the stringent requirements on agility and…

Robotics · Computer Science 2026-04-24 Yucheng Xin , Jiacheng Bao , Yubo Dong , Xueqian Wang , Bin Zhao , Xuelong Li , Junbo Tan , Dong Wang

Controllable Markov chains describe the dynamics of sequential decision making tasks and are the central component in optimal control and reinforcement learning. In this work, we give the general form of an optimal policy for learning…

Machine Learning · Computer Science 2025-12-24 Peter N. Loxley

Planning under uncertainty is a crucial capability for autonomous systems to operate reliably in uncertain and dynamic environments. The concern of safety becomes even more critical in healthcare settings where robots interact with human…

Robotics · Computer Science 2021-03-29 Roya Sabbagh Novin , Amir Yazdani , Andrew Merryweather , Tucker Hermans

The ability to adapt to uncertainties, recover from failures, and coordinate between hand and fingers are essential sensorimotor skills for fully autonomous robotic grasping. In this paper, we aim to study a unified feedback control policy…

Robotics · Computer Science 2020-03-02 Wenbin Hu , Chuanyu Yang , Kai Yuan , Zhibin Li

Developing a safe and efficient collision avoidance policy for multiple robots is challenging in the decentralized scenarios where each robot generate its paths without observing other robots' states and intents. While other distributed…

Robotics · Computer Science 2018-05-22 Pinxin Long , Tingxiang Fan , Xinyi Liao , Wenxi Liu , Hao Zhang , Jia Pan

Intelligent behaviour in the physical world exhibits structure at multiple spatial and temporal scales. Although movements are ultimately executed at the level of instantaneous muscle tensions or joint torques, they must be selected to…

Deploying a safe mobile robot policy in scenarios with human pedestrians is challenging due to their unpredictable movements. Current Reinforcement Learning-based motion planners rely on a single policy to simulate pedestrian movements and…

Robotics · Computer Science 2024-10-17 Wen Zheng Terence Ng , Jianda Chen , Sinno Jialin Pan , Tianwei Zhang

The impact forces during switching operations of short-stroke actuators may cause bouncing, audible noise and mechanical wear. The application of soft-landing control strategies to these devices aims at minimizing the impact velocities of…

Systems and Control · Electrical Eng. & Systems 2024-04-02 Eduardo Moya-Lasheras , Edgar Ramirez-Laboreo , Carlos Sagues

For safe and efficient planning and control in autonomous driving, we need a driving policy which can achieve desirable driving quality in long-term horizon with guaranteed safety and feasibility. Optimization-based approaches, such as…

Artificial Intelligence · Computer Science 2017-07-11 Liting Sun , Cheng Peng , Wei Zhan , Masayoshi Tomizuka