中文
相关论文

相关论文: Leveraging Analytic Gradients in Provably Safe Rei…

200 篇论文

When deploying machine learning algorithms in the real world, guaranteeing safety is an essential asset. Existing safe learning approaches typically consider continuous variables, i.e., regression tasks. However, in practice, robotic…

机器学习 · 计算机科学 2024-01-12 Dominik Baumann , Thomas B. Schön

Minimizing the empirical risk is a popular training strategy, but for learning tasks where the data may be noisy or heavy-tailed, one may require many observations in order to generalize well. To achieve better performance under less…

机器学习 · 统计学 2018-10-16 Matthew J. Holland , Kazushi Ikeda

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance, frequently without considering safety. In contrast, safe reinforcement learning seeks to reduce or avoid unsafe behavior.…

机器学习 · 计算机科学 2025-06-17 Zahra Shahrooei , Ali Baheri

Reinforcement learning (RL) is ubiquitous in the development of modern AI systems. However, state-of-the-art RL agents require extensive, and potentially unsafe, interactions with their environments to learn effectively. These limitations…

机器学习 · 计算机科学 2025-08-01 Yarden As , Bhavya Sukhija , Lenart Treven , Carmelo Sferrazza , Stelian Coros , Andreas Krause

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

机器学习 · 计算机科学 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

机器学习 · 计算机科学 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

Safe Reinforcement Learning (Safe RL) is one of the prevalently studied subcategories of trial-and-error-based methods with the intention to be deployed on real-world systems. In safe RL, the goal is to maximize reward performance while…

机器学习 · 计算机科学 2024-08-16 Homayoun Honari , Amir Mehdi Soufi Enayati , Mehran Ghafarian Tamizi , Homayoun Najjaran

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

人工智能 · 计算机科学 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

Policy Gradient (PG) algorithms are among the best candidates for the much-anticipated applications of reinforcement learning to real-world control tasks, such as robotics. However, the trial-and-error nature of these methods poses safety…

机器学习 · 计算机科学 2022-06-20 Matteo Papini , Matteo Pirotta , Marcello Restelli

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

机器人学 · 计算机科学 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

Training-time safety violations have been a major concern when we deploy reinforcement learning algorithms in the real world. This paper explores the possibility of safe RL algorithms with zero training-time safety violations in the…

机器学习 · 计算机科学 2022-03-14 Yuping Luo , Tengyu Ma

The gradient inversion attack has been demonstrated as a significant privacy threat to federated learning (FL), particularly in continuous domains such as vision models. In contrast, it is often considered less effective or highly dependent…

机器学习 · 计算机科学 2025-07-30 Xinguo Feng , Zhongkui Ma , Zihan Wang , Eu Joe Chegne , Mengyao Ma , Alsharif Abuadbba , Guangdong Bai

Artificial Neural Networks (ANNs) have demonstrated remarkable utility in various challenging machine learning applications. While formally verified properties of their behaviors are highly desired, they have proven notoriously difficult to…

机器学习 · 计算机科学 2020-10-05 Xuankang Lin , He Zhu , Roopsha Samanta , Suresh Jagannathan

Active learning methods have shown great promise in reducing the number of samples necessary for learning. As automated learning systems are adopted into real-time, real-world decision-making pipelines, it is increasingly important that…

机器学习 · 计算机科学 2022-06-23 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

This paper investigates the impact of using gradient norm reward signals in the context of Automatic Curriculum Learning (ACL) for deep reinforcement learning (DRL). We introduce a framework where the teacher model, utilizing the gradient…

机器学习 · 计算机科学 2023-12-22 Ryan Campbell , Junsang Yoon

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety…

系统与控制 · 电气工程与系统科学 2024-09-13 Xiang Huo , Boming Liu , Jin Dong , Jianming Lian , Mingxi Liu

The impact of inference-time data perturbation (e.g., adversarial attacks) has been extensively studied in machine learning, leading to well-established certification techniques for adversarial robustness. In contrast, certifying models…

机器学习 · 计算机科学 2025-11-13 Philip Sosnin , Matthew Wicker , Josh Collyer , Calvin Tsay

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

机器学习 · 计算机科学 2024-09-23 Narendra Patwardhan , Zequn Wang

Fine-tuning-as-a-Service introduces a critical vulnerability where a few malicious examples mixed into the user's fine-tuning dataset can compromise the safety alignment of Large Language Models (LLMs). While a recognized paradigm frames…

计算与语言 · 计算机科学 2025-08-12 Biao Yi , Jiahao Li , Baolei Zhang , Lihai Nie , Tong Li , Tiansheng Huang , Zheli Liu

The emergence of mobile robotics, particularly in the automotive industry, introduces a promising era of enriched user experiences and adept handling of complex navigation challenges. The realization of these advancements necessitates a…