English
Related papers

Related papers: Constraint Learning for Control Tasks with Limited…

200 papers

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Jan Drgona , Truong X. Nghiem , Thomas Beckers , Mahyar Fazlyab , Enrique Mallada , Colin Jones , Draguna Vrabie , Steven L. Brunton , Rolf Findeisen

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

Guaranteeing constraint satisfaction is challenging in imitation learning (IL), particularly in tasks that require operating near a system's handling limits. Traditional IL methods, such as Behavior Cloning (BC), often struggle to enforce…

Machine Learning · Computer Science 2025-08-29 Shengfan Cao , Eunhyek Joa , Francesco Borrelli

Deep Reinforcement Learning (RL) has demonstrated impressive results in solving complex robotic tasks such as quadruped locomotion. Yet, current solvers fail to produce efficient policies respecting hard constraints. In this work, we…

This paper presents a constrained policy gradient algorithm. We introduce constraints for safe learning with the following steps. First, learning is slowed down (lazy learning) so that the episodic policy change can be computed with the…

Machine Learning · Computer Science 2022-01-24 Balázs Varga , Balázs Kulcsár , Morteza Haghir Chehreghani

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

This paper proposes a data-driven method for learning convergent control policies from offline data using Contraction theory. Contraction theory enables constructing a policy that makes the closed-loop system trajectories inherently…

Machine Learning · Computer Science 2022-02-04 Navid Rezazadeh , Maxwell Kolarich , Solmaz S. Kia , Negar Mehr

In this paper, we develop safe reinforcement-learning-based controllers for systems tasked with accomplishing complex missions that can be expressed as linear temporal logic specifications, similar to those required by search-and-rescue…

Systems and Control · Electrical Eng. & Systems 2022-03-30 Aris Kanellopoulos , Filippos Fotiadis , Chuangchuang Sun , Zhe Xu , Kyriakos G. Vamvoudakis , Ufuk Topcu , Warren E. Dixon

Vision-language-action models (VLAs) show potential as generalist robot policies. However, these models pose extreme safety challenges during real-world deployment, including the risk of harm to the environment, the robot itself, and…

Robotics · Computer Science 2026-04-21 Borong Zhang , Yuhao Zhang , Jiaming Ji , Yingshan Lei , Yishuai Cai , Josef Dai , Yuanpei Chen , Yaodong Yang

Although learning-based methods have great potential for robotics, one concern is that a robot that updates its parameters might cause large amounts of damage before it learns the optimal policy. We formalize the idea of safe learning in a…

Robotics · Computer Science 2017-05-17 David Held , Zoe McCarthy , Michael Zhang , Fred Shentu , Pieter Abbeel

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Deep Reinforcement Learning (DRL) algorithms have recently made significant strides in improving network performance. Nonetheless, their practical use is still limited in the absence of safe exploration and safe decision-making. In the…

Networking and Internet Architecture · Computer Science 2024-01-12 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

Robotics · Computer Science 2022-07-13 Yiannis Kantaros

Recently, learning-based controllers have been shown to push mobile robotic systems to their limits and provide the robustness needed for many real-world applications. However, only classical optimization-based control frameworks offer the…

Robotics · Computer Science 2023-04-04 Leonard Bauersfeld , Elia Kaufmann , Davide Scaramuzza

Barrier Lyapunov functions are suitable for learning control designs, due to their feature of finite duration tracking. This paper presents fractional barrier Lyapunov functions, provided and compared with the conventional ones in the…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Mingxuan Sun

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

Control Barrier Functions (CBFs) provide an elegant framework for constraining nonlinear control system dynamics to remain within an invariant subset of a designated safe set. However, identifying a CBF that balances performance-by…

Machine Learning · Computer Science 2024-11-05 Lakshmideepakreddy Manda , Shaoru Chen , Mahyar Fazlyab

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban