中文
相关论文

相关论文: Guarded Policy Optimization with Imperfect Online …

200 篇论文

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

系统与控制 · 电气工程与系统科学 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

We investigate the important problem of certifying stability of reinforcement learning policies when interconnected with nonlinear dynamical systems. We show that by regulating the input-output gradients of policies, strong guarantees of…

系统与控制 · 计算机科学 2018-10-30 Ming Jin , Javad Lavaei

Inverse Reinforcement Learning addresses the problem of inferring an expert's reward function from demonstrations. However, in many applications, we not only have access to the expert's near-optimal behavior, but we also observe part of her…

机器学习 · 计算机科学 2021-09-03 Giorgia Ramponi , Gianluca Drappo , Marcello Restelli

Flow Matching (FM) has shown remarkable ability in modeling complex distributions and achieves strong performance in offline imitation learning for cloning expert behaviors. However, despite its behavioral cloning expressiveness, FM-based…

机器学习 · 计算机科学 2025-10-14 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor Tsang

Safety is a critical feature of controller design for physical systems. When designing control policies, several approaches to guarantee this aspect of autonomy have been proposed, such as robust controllers or control barrier functions.…

机器学习 · 计算机科学 2021-02-26 Miguel Calvo-Fullana , Luiz F. O. Chamon , Santiago Paternain

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

系统与控制 · 电气工程与系统科学 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

We address the challenge of offline reinforcement learning using realistic data, specifically non-expert data collected through sub-optimal behavior policies. Under such circumstance, the learned policy must be safe enough to manage…

机器学习 · 计算机科学 2025-04-04 Ke Jiang , Wen Jiang , Yao Li , Xiaoyang Tan

While intelligent tutoring systems (ITSs) can use information from past students to personalize instruction, each new student is unique. Moreover, the education problem is inherently difficult because the learning process is only partially…

机器学习 · 计算机科学 2025-11-20 Jeffrey Jiang , Kevin Hong , Emily Kuczynski , Gregory Pottie

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

机器学习 · 计算机科学 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

人工智能 · 计算机科学 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Trustworthy Federated Learning (TFL) typically leverages protection mechanisms to guarantee privacy. However, protection mechanisms inevitably introduce utility loss or efficiency reduction while protecting data privacy. Therefore,…

机器学习 · 计算机科学 2024-02-29 Xiaojin Zhang , Yan Kang , Lixin Fan , Kai Chen , Qiang Yang

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

机器学习 · 计算机科学 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

We study a security threat to reinforcement learning where an attacker poisons the learning environment to force the agent into executing a target policy chosen by the attacker. As a victim, we consider RL agents whose objective is to find…

机器学习 · 计算机科学 2020-11-24 Amin Rakhsha , Goran Radanovic , Rati Devidze , Xiaojin Zhu , Adish Singla

Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale…

机器学习 · 计算机科学 2021-11-10 Akifumi Wachi , Yunyue Wei , Yanan Sui

Imitation learning with a privileged teacher has proven effective for learning complex control behaviors from high-dimensional inputs, such as images. In this framework, a teacher is trained with privileged task information, while a student…

机器人学 · 计算机科学 2025-02-28 Nico Messikommer , Jiaxu Xing , Elie Aljalbout , Davide Scaramuzza

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

机器学习 · 计算机科学 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Reinforcement learning (RL) has been shown to be effective at learning control from experience. However, RL typically requires a large amount of online interaction with the environment. This limits its applicability to real-world settings,…

Triangular tethered formation system (TTFS) provide a promising platform for deep space exploration and distributed sensing due to its intrinsic spatial-orientation stability and capability of adjusting distances among node satellites…

系统与控制 · 电气工程与系统科学 2026-01-09 Xinyi Tao , Panfeng Huang , Fan Zhang

Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet existing GRPO-based methods remain fundamentally constrained by sparse reward signals and…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Jiaze Li , Hao Yin , Haoran Xu , Boshen Xu , Wenhui Tan , Zewen He , Jianzhong Ju , Zhenbo Luo , Jian Luan

Off-policy learning ability is an important feature of reinforcement learning (RL) for practical applications. However, even one of the most elementary RL algorithms, temporal-difference (TD) learning, is known to suffer form divergence…

机器学习 · 计算机科学 2025-04-21 Han-Dong Lim , Donghwan Lee