English
Related papers

Related papers: Decomposing Control Lyapunov Functions for Efficie…

200 papers

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

Complex high-dimensional spaces with high Degree-of-Freedom and complicated action spaces, such as humanoid robots equipped with dexterous hands, pose significant challenges for reinforcement learning (RL) algorithms, which need to wisely…

Robotics · Computer Science 2025-02-25 Zifeng Zhuang , Diyuan Shi , Runze Suo , Xiao He , Hongyin Zhang , Ting Wang , Shangke Lyu , Donglin Wang

Multi-robot systems can benefit from reinforcement learning (RL) algorithms that learn behaviours in a small number of trials, a property known as sample efficiency. This research thus investigates the use of learned world models to improve…

Robotics · Computer Science 2021-03-08 Daniël Willemsen , Mario Coppola , Guido C. H. E. de Croon

Automating robotic surgery via learning from demonstration (LfD) techniques is extremely challenging. This is because surgical tasks often involve sequential decision-making processes with complex interactions of physical objects and have…

Robotics · Computer Science 2024-10-11 Zohre Karimi , Shing-Hei Ho , Bao Thach , Alan Kuntz , Daniel S. Brown

Reinforcement learning (RL) excels in applications such as video games, but ensuring safety as well as the ability to achieve the specified goals remains challenging when using RL for real-world problems, such as human-aligned tasks where…

Machine Learning · Computer Science 2024-05-21 Liqun Zhao , Keyan Miao , Konstantinos Gatsis , Antonis Papachristodoulou

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively…

Artificial Intelligence · Computer Science 2017-03-03 Xiao Li , Cristian-Ioan Vasile , Calin Belta

This paper considers the problem of designing motion planning algorithms for control-affine systems that generate collision-free paths from an initial to a final destination and can be executed using safe and dynamically-feasible…

Robotics · Computer Science 2025-03-14 Pol Mestres , Carlos Nieto-Granda , Jorge Cortés

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

Machine Learning · Computer Science 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

Machine Learning · Computer Science 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

Deep reinforcement learning (RL) has gained widespread adoption in recent years but faces significant challenges, particularly in unknown and complex environments. Among these, high-dimensional action selection stands out as a critical…

Machine Learning · Statistics 2025-07-08 Wenbo Zhang , Hengrui Cai

This paper introduces a novel reinforcement learning (RL) strategy designed to facilitate rapid autonomy transfer by utilizing pre-trained critic value functions from multiple environments. Unlike traditional methods that require extensive…

Decentralized safe control plays an important role in multi-agent systems given the scalability and robustness without reliance on a central authority. However, without an explicit global coordinator, the decentralized control methods are…

Systems and Control · Electrical Eng. & Systems 2025-03-14 Yanze Zhang , Yiwei Lyu , Siwon Jo , Yupeng Yang , Wenhao Luo

Adaptive Control Lyapunov Functions (aCLFs) were introduced 20 years ago, and provided a Lyapunov-based methodology for stabilizing systems with parameter uncertainty. The goal of this paper is to revisit this classic formulation in the…

Systems and Control · Electrical Eng. & Systems 2020-11-20 Andrew J. Taylor , Aaron D. Ames

This paper proposes novel approaches for designing control Lyapunov functions (CLFs) for constrained linear systems. We leverage recent configuration-constrained polyhedral computing techniques to devise piecewise affine convex CLFs.…

Optimization and Control · Mathematics 2025-03-21 Boris Houska , Matthias A. Müller , Mario E. Villanueva

We propose a general formulation for addressing reinforcement learning (RL) problems in settings with observational data. That is, we consider the problem of learning good policies solely from historical data in which unobserved factors…

Machine Learning · Computer Science 2018-12-31 Chaochao Lu , Bernhard Schölkopf , José Miguel Hernández-Lobato

Robots and autonomous agents often complete goal-based tasks with limited resources, relying on imperfect models and sensor measurements. In particular, reinforcement learning (RL) and feedback control can be used to help a robot achieve a…

Artificial Intelligence · Computer Science 2018-09-26 Aleksandra Faust , James B. Aimone , Conrad D. James , Lydia Tapia

Transient stability of power systems is becoming increasingly important because of the growing integration of renewable resources. These resources lead to a reduction in mechanical inertia but also provide increased flexibility in frequency…

Systems and Control · Electrical Eng. & Systems 2021-05-07 Wenqi Cui , Baosen Zhang

We study lifelong reinforcement learning (RL) in a regret minimization setting of linear contextual Markov decision process (MDP), where the agent needs to learn a multi-task policy while solving a streaming sequence of tasks. We propose an…

Machine Learning · Computer Science 2022-06-02 Sanae Amani , Lin F. Yang , Ching-An Cheng

In cooperative multi-agent reinforcement learning, a collection of agents learns to interact in a shared environment to achieve a common goal. We propose the use of reward machines (RM) -- Mealy machines used as structured representations…

Multiagent Systems · Computer Science 2021-06-16 Cyrus Neary , Zhe Xu , Bo Wu , Ufuk Topcu

As more inverter-connected renewable resources are integrated into the grid, frequency stability may degrade because of the reduction in mechanical inertia and damping. A common approach to mitigate this degradation in performance is to use…

Systems and Control · Electrical Eng. & Systems 2021-12-30 Wenqi Cui , Yan Jiang , Baosen Zhang