English
Related papers

Related papers: Compositional Policy Learning in Stochastic Contro…

200 papers

Reinforcement learning (RL) algorithms struggle with learning optimal policies for tasks where reward feedback is sparse and depends on a complex sequence of events in the environment. Probabilistic reward machines (PRMs) are finite-state…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Hadi Partovi Aria , Daniel Neider , Zhe Xu

Navigating fluently around pedestrians is a necessary capability for mobile robots deployed in human environments, such as buildings and homes. While research on social navigation has focused mainly on the scalability with the number of…

Multi-task reinforcement learning trains generalist policies that can execute multiple tasks. While recent years have seen significant progress, existing approaches rarely provide formal performance guarantees, which are indispensable when…

Machine Learning · Computer Science 2026-02-03 Yannik Schnitzer , Mathias Jackermeier , Alessandro Abate , David Parker

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

Machine Learning · Computer Science 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli

Reinforcement learning (RL) has demonstrated its ability to solve high dimensional tasks by leveraging non-linear function approximators. However, these successes are mostly achieved by 'black-box' policies in simulated domains. When…

Machine Learning · Computer Science 2021-11-19 Riad Akrour , Davide Tateo , Jan Peters

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

We present a reinforcement learning algorithm for learning sparse non-parametric controllers in a Reproducing Kernel Hilbert Space. We improve the sample complexity of this approach by imposing a structure of the state-action function…

Robotics · Computer Science 2021-03-30 Ekaterina Tolstaya , Ethan Stump , Alec Koppel , Alejandro Ribeiro

We present a general theoretical analysis of structured prediction with a series of new results. We give new data-dependent margin guarantees for structured prediction for a very wide family of loss functions and a general family of…

Machine Learning · Statistics 2016-12-02 Corinna Cortes , Mehryar Mohri , Vitaly Kuznetsov , Scott Yang

This work addresses the design of multi-agent coordination through high-order consensus protocols. While first-order consensus strategies are well-studied -- with known robustness to uncertainties such as time delays, time-varying weights,…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Jonas Hansson , Emma Tegling

Deep reinforcement learning has been successfully applied to many control tasks, but the application of such agents in safety-critical scenarios has been limited due to safety concerns. Rigorous testing of these controllers is challenging,…

Artificial Intelligence · Computer Science 2020-07-09 Edoardo Bacci , David Parker

Robust reinforcement learning (RL) aims to find a policy that optimizes the worst-case performance in the face of uncertainties. In this paper, we focus on action robust RL with the probabilistic policy execution uncertainty, in which,…

Machine Learning · Computer Science 2023-07-21 Guanlin Liu , Zhihan Zhou , Han Liu , Lifeng Lai

Many tasks in control, robotics, and planning can be specified using desired goal configurations for various entities in the environment. Learning goal-conditioned policies is a natural paradigm to solve such tasks. However, current…

Machine Learning · Computer Science 2022-03-14 Allan Zhou , Vikash Kumar , Chelsea Finn , Aravind Rajeswaran

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

We study robust reinforcement learning (RL) with the goal of determining a well-performing policy that is robust against model mismatch between the training simulator and the testing environment. Previous policy-based robust RL algorithms…

Machine Learning · Computer Science 2023-12-12 Ruida Zhou , Tao Liu , Min Cheng , Dileep Kalathil , P. R. Kumar , Chao Tian

The field of reinforcement learning (RL) is concerned with algorithms for learning optimal policies in unknown stochastic environments. Programmatic RL studies representations of policies as programs, meaning involving higher order…

Machine Learning · Computer Science 2025-01-13 Guruprerana Shabadi , Nathanaël Fijalkow , Théo Matricon

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Thanh Long Vu

Many of the challenges facing today's reinforcement learning (RL) algorithms, such as robustness, generalization, transfer, and computational efficiency are closely related to compression. Prior work has convincingly argued why minimizing…

Machine Learning · Computer Science 2021-09-08 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Recurrent neural networks (RNNs) have emerged as an effective representation of control policies in sequential decision-making problems. However, a major drawback in the application of RNN-based policies is the difficulty in providing…

Artificial Intelligence · Computer Science 2020-02-14 Steven Carr , Nils Jansen , Ufuk Topcu