中文
相关论文

相关论文: Anomalous State Sequence Modeling to Enhance Safet…

200 篇论文

Anomaly detection is the task of detecting data which differs from the normal behaviour of a system in a given context. In order to approach this problem, data-driven models can be learned to predict current or future observations.…

机器学习 · 计算机科学 2020-10-30 Benedikt Eiteneuer , Oliver Niggemann

Reinforcement Learning (RL) is a promising approach for achieving autonomous driving due to robust decision-making capabilities. RL learns a driving policy through trial and error in traffic scenarios, guided by a reward function that…

机器人学 · 计算机科学 2026-03-06 Ahmed Abouelazm , Jonas Michel , Helen Gremmelmaier , Tim Joseph , Philip Schörner , J. Marius Zöllner

Autonomous vehicles have the potential to lower the accident rate when compared to human driving. Moreover, it is the driving force of the automated vehicles' rapid development over the last few years. In the higher Society of Automotive…

机器人学 · 计算机科学 2022-08-30 Dhanoop Karunakaran , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

Offline safe reinforcement learning (RL) seeks reward-maximizing policies from static datasets under strict safety constraints. Existing methods often rely on soft expected-cost objectives or iterative generative inference, which can be…

机器学习 · 计算机科学 2026-03-17 Mumuksh Tayal , Manan Tayal , Ravi Prakash

Despite the tremendous success of Reinforcement Learning (RL) algorithms in simulation environments, applying RL to real-world applications still faces many challenges. A major concern is safety, in another word, constraint satisfaction.…

机器学习 · 计算机科学 2023-07-04 Weiye Zhao , Tairan He , Rui Chen , Tianhao Wei , Changliu Liu

Safety guarantees are a prerequisite to the deployment of reinforcement learning (RL) agents in safety-critical tasks. Often, deployment environments exhibit non-stationary dynamics or are subject to changing performance goals, requiring…

机器学习 · 计算机科学 2026-04-13 Maksim Anisimov , Francesco Belardinelli , Matthew Wicker

Reinforcement learning (RL) is challenging in the common case of delays between events and their sensory perceptions. State-of-the-art (SOTA) state augmentation techniques either suffer from state space explosion or performance degeneration…

Recently, anomaly scores have been formulated using reconstruction loss of the adversarially learned generators and/or classification loss of discriminators. Unavailability of anomaly examples in the training data makes optimization of such…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Muhammad Zaigham Zaheer , Jin Ha Lee , Arif Mahmood , Marcella Astrid , Seung-Ik Lee

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

系统与控制 · 电气工程与系统科学 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

机器人学 · 计算机科学 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic…

机器学习 · 计算机科学 2025-02-28 Kaustubh Mani , Vincent Mai , Charlie Gauthier , Annie Chen , Samer Nashed , Liam Paull

We study the problem of safe offline reinforcement learning (RL), the goal is to learn a policy that maximizes long-term reward while satisfying safety constraints given only offline data, without further interaction with the environment.…

机器学习 · 计算机科学 2022-04-11 Haoran Xu , Xianyuan Zhan , Xiangyu Zhu

The security of cloud environments, such as Amazon Web Services (AWS), is complex and dynamic. Static security policies have become inadequate as threats evolve and cloud resources exhibit elasticity [1]. This paper addresses the…

密码学与安全 · 计算机科学 2025-05-15 Muhammad Saqib , Dipkumar Mehta , Fnu Yashu , Shubham Malhotra

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms, do not support…

系统与控制 · 计算机科学 2021-05-18 Kim P. Wabersich , Melanie N. Zeilinger

Reinforcement learning (RL) is an area of significant research interest, and safe RL in particular is attracting attention due to its ability to handle safety-driven constraints that are crucial for real-world applications of RL algorithms.…

系统与控制 · 电气工程与系统科学 2023-04-13 Song Bo , Xunyuan Yin , Jinfeng Liu

We address the problem of deploying a reinforcement learning (RL) agent on a physical system such as a datacenter cooling unit or robot, where critical constraints must never be violated. We show how to exploit the typically smooth dynamics…

人工智能 · 计算机科学 2018-01-29 Gal Dalal , Krishnamurthy Dvijotham , Matej Vecerik , Todd Hester , Cosmin Paduraru , Yuval Tassa

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

机器学习 · 计算机科学 2025-07-21 Thomas Banker , Ali Mesbah

This paper addresses the challenges of training end-to-end autonomous driving agents using Reinforcement Learning (RL). RL agents are typically trained in a fixed set of scenarios and nominal behavior of surrounding road users in…

机器人学 · 计算机科学 2026-03-06 Ahmed Abouelazm , Tim Weinstein , Tim Joseph , Philip Schörner , J. Marius Zöllner

Video Anomaly Detection (VAD) is crucial for applications such as security surveillance and autonomous driving. However, existing VAD methods provide little rationale behind detection, hindering public trust in real-world deployments. In…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yuchen Yang , Kwonjoon Lee , Behzad Dariush , Yinzhi Cao , Shao-Yuan Lo

Reinforcement learning (RL) is rapidly reaching and surpassing human-level control capabilities. However, state-of-the-art RL algorithms often require timesteps and reaction times significantly faster than human capabilities, which is…

机器学习 · 计算机科学 2025-07-29 Devdhar Patel , Hava Siegelmann