English
Related papers

Related papers: Guarded Policy Optimization with Imperfect Online …

200 papers

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

We investigate the important problem of certifying stability of reinforcement learning policies when interconnected with nonlinear dynamical systems. We show that by regulating the input-output gradients of policies, strong guarantees of…

Systems and Control · Computer Science 2018-10-30 Ming Jin , Javad Lavaei

Inverse Reinforcement Learning addresses the problem of inferring an expert's reward function from demonstrations. However, in many applications, we not only have access to the expert's near-optimal behavior, but we also observe part of her…

Machine Learning · Computer Science 2021-09-03 Giorgia Ramponi , Gianluca Drappo , Marcello Restelli

Flow Matching (FM) has shown remarkable ability in modeling complex distributions and achieves strong performance in offline imitation learning for cloning expert behaviors. However, despite its behavioral cloning expressiveness, FM-based…

Machine Learning · Computer Science 2025-10-14 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor Tsang

Safety is a critical feature of controller design for physical systems. When designing control policies, several approaches to guarantee this aspect of autonomy have been proposed, such as robust controllers or control barrier functions.…

Machine Learning · Computer Science 2021-02-26 Miguel Calvo-Fullana , Luiz F. O. Chamon , Santiago Paternain

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

We address the challenge of offline reinforcement learning using realistic data, specifically non-expert data collected through sub-optimal behavior policies. Under such circumstance, the learned policy must be safe enough to manage…

Machine Learning · Computer Science 2025-04-04 Ke Jiang , Wen Jiang , Yao Li , Xiaoyang Tan

While intelligent tutoring systems (ITSs) can use information from past students to personalize instruction, each new student is unique. Moreover, the education problem is inherently difficult because the learning process is only partially…

Machine Learning · Computer Science 2025-11-20 Jeffrey Jiang , Kevin Hong , Emily Kuczynski , Gregory Pottie

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

Machine Learning · Computer Science 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

Artificial Intelligence · Computer Science 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Trustworthy Federated Learning (TFL) typically leverages protection mechanisms to guarantee privacy. However, protection mechanisms inevitably introduce utility loss or efficiency reduction while protecting data privacy. Therefore,…

Machine Learning · Computer Science 2024-02-29 Xiaojin Zhang , Yan Kang , Lixin Fan , Kai Chen , Qiang Yang

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

We study a security threat to reinforcement learning where an attacker poisons the learning environment to force the agent into executing a target policy chosen by the attacker. As a victim, we consider RL agents whose objective is to find…

Machine Learning · Computer Science 2020-11-24 Amin Rakhsha , Goran Radanovic , Rati Devidze , Xiaojin Zhu , Adish Singla

Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale…

Machine Learning · Computer Science 2021-11-10 Akifumi Wachi , Yunyue Wei , Yanan Sui

Imitation learning with a privileged teacher has proven effective for learning complex control behaviors from high-dimensional inputs, such as images. In this framework, a teacher is trained with privileged task information, while a student…

Robotics · Computer Science 2025-02-28 Nico Messikommer , Jiaxu Xing , Elie Aljalbout , Davide Scaramuzza

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

Machine Learning · Computer Science 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Reinforcement learning (RL) has been shown to be effective at learning control from experience. However, RL typically requires a large amount of online interaction with the environment. This limits its applicability to real-world settings,…

Triangular tethered formation system (TTFS) provide a promising platform for deep space exploration and distributed sensing due to its intrinsic spatial-orientation stability and capability of adjusting distances among node satellites…

Systems and Control · Electrical Eng. & Systems 2026-01-09 Xinyi Tao , Panfeng Huang , Fan Zhang

Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet existing GRPO-based methods remain fundamentally constrained by sparse reward signals and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiaze Li , Hao Yin , Haoran Xu , Boshen Xu , Wenhui Tan , Zewen He , Jianzhong Ju , Zhenbo Luo , Jian Luan

Off-policy learning ability is an important feature of reinforcement learning (RL) for practical applications. However, even one of the most elementary RL algorithms, temporal-difference (TD) learning, is known to suffer form divergence…

Machine Learning · Computer Science 2025-04-21 Han-Dong Lim , Donghwan Lee