English
Related papers

Related papers: Rigorous Agent Evaluation: An Adversarial Approach…

200 papers

AI systems are increasingly applied to complex tasks that involve interaction with humans. During training, such systems are potentially dangerous, as they haven't yet learned to avoid actions that could cause serious harm. How can an AI…

Artificial Intelligence · Computer Science 2017-07-18 William Saunders , Girish Sastry , Andreas Stuhlmueller , Owain Evans

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

Machine Learning · Computer Science 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

Multi-agent reinforcement learning is difficult to be applied in practice, which is partially due to the gap between the simulated and real-world scenarios. One reason for the gap is that the simulated systems always assume that the agents…

Machine Learning · Computer Science 2022-03-17 Jian Zhao , Youpeng Zhao , Weixun Wang , Mingyu Yang , Xunhan Hu , Wengang Zhou , Jianye Hao , Houqiang Li

Autonomous systems such as self-driving cars and general-purpose robots are safety-critical systems that operate in highly uncertain and dynamic environments. We propose an interactive multi-agent framework where the system-under-design is…

Machine Learning · Computer Science 2021-07-07 Xin Qin , Nikos Aréchiga , Andrew Best , Jyotirmoy Deshmukh

Learning models capable of providing reliable predictions in the face of adversarial actions has become a central focus of the machine learning community in recent years. This challenge arises from observing that data encountered at…

Machine Learning · Computer Science 2025-05-05 Marco C. Campi , Algo Carè , Luis G. Crespo , Simone Garatti , Federico A. Ramponi

As deep reinforcement learning driven by visual perception becomes more widely used there is a growing need to better understand and probe the learned agents. Understanding the decision making process and its relationship to visual inputs…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Christian Rupprecht , Cyril Ibrahim , Christopher J. Pal

Faults are endemic to all systems. Adaptive fault-tolerant control maintains degraded performance when faults occur as opposed to unsafe conditions or catastrophic events. In systems with abrupt faults and strict time constraints, it is…

Machine Learning · Computer Science 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

In this paper, we use reinforcement learning for safety driving in adversary settings. In our work, the knowledge in state-of-art planning methods is reused by single-step options whose action suggestions are compared in parallel with…

Artificial Intelligence · Computer Science 2019-12-02 Nazmus Sakib , Hengshuai Yao , Hong Zhang , Shangling Jui

Reinforcement learning (RL) in real-world safety-critical target settings like urban driving is hazardous, imperiling the RL agent, other agents, and the environment. To overcome this difficulty, we propose a "safety-critical adaptation"…

Machine Learning · Computer Science 2021-01-19 Jesse Zhang , Brian Cheung , Chelsea Finn , Sergey Levine , Dinesh Jayaraman

In safety-critical applications, autonomous agents may need to learn in an environment where mistakes can be very costly. In such settings, the agent needs to behave safely not only after but also while learning. To achieve this, existing…

Machine Learning · Computer Science 2021-01-22 Matteo Turchetta , Andrey Kolobov , Shital Shah , Andreas Krause , Alekh Agarwal

An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo…

Machine Learning · Computer Science 2022-11-23 Anthony Corso , Kyu-Young Kim , Shubh Gupta , Grace Gao , Mykel J. Kochenderfer

Trajectory prediction is a critical component for autonomous vehicles (AVs) to perform safe planning and navigation. However, few studies have analyzed the adversarial robustness of trajectory prediction or investigated whether the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Qingzhao Zhang , Shengtuo Hu , Jiachen Sun , Qi Alfred Chen , Z. Morley Mao

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

Machine Learning · Computer Science 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Autonomous vehicle (AV) evaluation has been the subject of increased interest in recent years both in industry and in academia. This paper focuses on the development of a novel framework for generating adversarial driving behavior of…

Artificial Intelligence · Computer Science 2023-10-17 Zhen Liu , Hang Gao , Hao Ma , Shuo Cai , Yunfeng Hu , Ting Qu , Hong Chen , Xun Gong

Ensuring the safety of autonomous vehicles (AVs) requires identifying rare but critical failure cases that on-road testing alone cannot discover. High-fidelity simulations provide a scalable alternative, but automatically generating…

Machine Learning · Computer Science 2024-11-27 Amar Kulkarni , Shangtong Zhang , Madhur Behl

This paper addresses the challenges of training end-to-end autonomous driving agents using Reinforcement Learning (RL). RL agents are typically trained in a fixed set of scenarios and nominal behavior of surrounding road users in…

Robotics · Computer Science 2026-03-06 Ahmed Abouelazm , Tim Weinstein , Tim Joseph , Philip Schörner , J. Marius Zöllner

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

Machine Learning · Computer Science 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Vanilla Reinforcement Learning (RL) can efficiently solve complex tasks but does not provide any guarantees on system behavior. To bridge this gap, we propose a three-step safe RL procedure for continuous action spaces that provides…

Robotics · Computer Science 2023-09-29 Hanna Krasowski , Prithvi Akella , Aaron D. Ames , Matthias Althoff

Safe reinforcement learning has many variants and it is still an open research problem. Here, we focus on how to use action guidance by means of a non-expert demonstrator to avoid catastrophic events in a domain with sparse, delayed, and…

Machine Learning · Computer Science 2019-04-12 Bilal Kartal , Pablo Hernandez-Leal , Chao Gao , Matthew E. Taylor