中文
相关论文

相关论文: Incorporating System-level Safety Requirements in …

200 篇论文

Reward Machines (RMs) are an established mechanism in Reinforcement Learning (RL) to represent and learn sparse, temporally extended tasks with non-Markovian rewards. RMs rely on high-level information in the form of labels that are emitted…

机器学习 · 计算机科学 2026-03-04 Thomas Krug , Daniel Neider

The cross entropy loss is widely used due to its effectiveness and solid theoretical grounding. However, as training progresses, the loss tends to focus on hard to classify samples, which may prevent the network from obtaining gains in…

机器学习 · 计算机科学 2021-09-14 Barak Battash , Lior Wolf , Tamir Hazan

Our objective of this project is to make the extension based on the technique mentioned in the paper "Safety-Aware Apprenticeship Learning" to improve the utility and the efficiency of the existing Reinforcement Learning model from a…

人工智能 · 计算机科学 2022-01-25 Junchen Zhao

Ensuring that reinforcement learning (RL) controllers satisfy safety and reliability constraints in real-world settings remains challenging: state-avoidance and constrained Markov decision processes often fail to capture trajectory-level…

机器学习 · 计算机科学 2026-04-06 Alper Kamil Bozkurt , Calin Belta , Ming C. Lin

This paper investigates runtime monitoring of perception systems. Perception is a critical component of high-integrity applications of robotics and autonomous systems, such as self-driving cars. In these applications, failure of perception…

机器人学 · 计算机科学 2022-05-24 Pasquale Antonante , Heath Nilsen , Luca Carlone

Fine-tuning large language models (LLMs) for downstream tasks typically exhibit a fundamental safety-capability tradeoff, where improving task performance degrades safety alignment even on benign datasets. This degradation persists across…

In the field of reinforcement learning there has been recent progress towards safety and high-confidence bounds on policy performance. However, to our knowledge, no practical methods exist for determining high-confidence policy performance…

人工智能 · 计算机科学 2018-06-26 Daniel S. Brown , Scott Niekum

As the complexity of control systems increases, the need for systematic methods to guarantee their efficacy grows as well. However, direct testing of these systems is oftentimes costly, difficult, or impractical. As a result, the test and…

系统与控制 · 电气工程与系统科学 2021-09-10 Prithvi Akella , Ugo Rosolia , Aaron D. Ames

Deep learning-based methods have become the de facto standard for industrial defect detection. However, their data-hungry nature and inherent "black-box" characteristics often lead to performance bottlenecks and limited trustworthiness in…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Hang-Cheng Dong , Guodong Liu , Dong Ye , Bingguo Liu

In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. A risk measure often focuses on the worst returns out of the agent's experience. As a result, standard methods for risk-averse RL often…

机器学习 · 计算机科学 2022-10-13 Ido Greenberg , Yinlam Chow , Mohammad Ghavamzadeh , Shie Mannor

Reinforcement learning (RL) is a popular approach for robotic path planning in uncertain environments. However, the control policies trained for an RL agent crucially depend on user-defined, state-based reward functions. Poorly designed…

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…

机器人学 · 计算机科学 2023-11-07 Tom P. Huck , Martin Kaiser , Constantin Cronrath , Bengt Lennartson , Torsten Kröger , Tamim Asfour

In model-based reinforcement learning it is typical to decouple the problems of learning the dynamics model and learning the reward function. However, when the dynamics model is flawed, it may generate erroneous states that would never…

机器学习 · 计算机科学 2018-06-12 Erik Talvitie

Resilience of safety-critical systems is gaining importance, particularly with the increasing number of cyber and physical threats. Cyber-physical threats are becoming increasingly prevalent, as digital systems are ubiquitous in critical…

系统与控制 · 电气工程与系统科学 2025-01-22 Abhijeet Sahu , Venkatesh Venkataramanan , Richard Macwan

Safety comes first in many real-world applications involving autonomous agents. Despite a large number of reinforcement learning (RL) methods focusing on safety-critical tasks, there is still a lack of high-quality evaluation of those…

机器学习 · 计算机科学 2022-12-13 Linrui Zhang , Qin Zhang , Li Shen , Bo Yuan , Xueqian Wang , Dacheng Tao

This paper focuses on inverse reinforcement learning for autonomous navigation using distance and semantic category observations. The objective is to infer a cost function that explains demonstrated behavior while relying only on the…

机器学习 · 计算机科学 2021-01-05 Tianyu Wang , Vikas Dhiman , Nikolay Atanasov

Supervised machine learning often operates on the data-driven paradigm, wherein internal model parameters are autonomously optimized to converge predicted outputs with the ground truth, devoid of explicitly programming rules or a priori…

机器学习 · 计算机科学 2024-12-12 Daniel Geissler , Bo Zhou , Mengxi Liu , Paul Lukowicz

Although an ever-growing number of applications employ deep learning based systems for prediction, decision-making, or state estimation, almost no certification processes have been established that would allow such systems to be deployed in…

机器学习 · 计算机科学 2024-03-25 Romeo Valentin

Safety controllers is widely used to achieve safe reinforcement learning. Most methods that apply a safety controller are using handcrafted safety constraints to construct the safety controller. However, when the environment dynamics are…

人工智能 · 计算机科学 2023-09-22 Haoyu Wang , Xin Yuan , Qinqing Ren

Chip placement is a critical step in physical design. While reinforcement learning (RL)-based methods have recently emerged, their training primarily focuses on wirelength optimization, and therefore often fail to achieve expert-quality…

硬件体系结构 · 计算机科学 2026-04-29 Ruo-Tong Chen , Ke Xue , Chengrui Gao , Yunqi Shi , Tian Xu , Peng Xie , Siyuan Xu , Mingxuan Yuan , Chao Qian , Zhi-Hua Zhou