English
Related papers

Related papers: SpecGuard: Specification Aware Recovery for Roboti…

200 papers

Vanilla Reinforcement Learning (RL) can efficiently solve complex tasks but does not provide any guarantees on system behavior. To bridge this gap, we propose a three-step safe RL procedure for continuous action spaces that provides…

Robotics · Computer Science 2023-09-29 Hanna Krasowski , Prithvi Akella , Aaron D. Ames , Matthias Althoff

Robotic Vehicles (RVs) have gained great popularity over the past few years. Meanwhile, they are also demonstrated to be vulnerable to sensor spoofing attacks. Although a wealth of research works have presented various attacks, some key…

Cryptography and Security · Computer Science 2023-03-03 Yuan Xu , Xingshuo Han , Gelei Deng , Jiwei Li , Yang Liu , Tianwei Zhang

Reinforcement Learning (RL) algorithms have achieved remarkable performance in decision making and control tasks due to their ability to reason about long-term, cumulative reward using trial and error. However, during RL training, applying…

Robotics · Computer Science 2021-03-03 Yifei Simon Shao , Chao Chen , Shreyas Kousik , Ram Vasudevan

Autonomous vehicles (AVs) promise efficient, clean and cost-effective transportation systems, but their reliance on sensors, wireless communications, and decision-making systems makes them vulnerable to cyberattacks and physical threats.…

Cryptography and Security · Computer Science 2026-04-15 Chieh Tsai , Murad Mehrab Abrar , Salim Hariri

The deep neural networks (DNNs)based autonomous driving systems (ADSs) are expected to reduce road accidents and improve safety in the transportation domain as it removes the factor of human error from driving tasks. The DNN based ADS…

Machine Learning · Computer Science 2022-04-06 Manzoor Hussain , Nazakat Ali , Jang-Eui Hong

In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on. An aspirational goal is to construct self-improving robots: robots that can learn and improve on their own, from…

Robotics · Computer Science 2023-03-03 Archit Sharma , Ahmed M. Ahmed , Rehaan Ahmad , Chelsea Finn

Logical specifications have been shown to help reinforcement learning algorithms in achieving complex tasks. However, when a task is under-specified, agents might fail to learn useful policies. In this work, we explore the possibility of…

Artificial Intelligence · Computer Science 2026-03-02 Tanmay Ambadkar , Đorđe Žikelić , Abhinav Verma

Reinforcement learning (RL) has transformed sequential decision-making, but traditional algorithms like Deep Q-Networks (DQNs) and Proximal Policy Optimization (PPO) often struggle with efficient exploration, stability, and adaptability in…

Machine Learning · Computer Science 2025-09-16 Umberto Gonçalves de Sousa

Vision Transformers (ViTs) are increasingly used in computer vision due to their high performance, but their vulnerability to adversarial attacks is a concern. Existing methods lack a solid theoretical basis, focusing mainly on empirical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xixu Hu , Runkai Zheng , Jindong Wang , Cheuk Hang Leung , Qi Wu , Xing Xie

Reinforcement learning is a promising approach for learning control policies for robot tasks. However, specifying complex tasks (e.g., with multiple objectives and safety constraints) can be challenging, since the user must design a reward…

Machine Learning · Computer Science 2020-10-30 Kishor Jothimurugan , Rajeev Alur , Osbert Bastani

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Unmanned Aerial Vehicles (UAVs) depend on onboard sensors for perception, navigation, and control. However, these sensors are susceptible to physical attacks, such as GPS spoofing, that can corrupt state estimates and lead to unsafe…

Machine Learning · Computer Science 2025-06-30 Pritam Dash , Ethan Chan , Nathan P. Lawrence , Karthik Pattabiraman

This paper introduces GRAD, a real-time anomaly detection method for autonomous vehicle sensors that integrates statistical analysis and deep learning to ensure the reliability of sensor data. The proposed approach combines the Reinforced…

Machine Learning · Computer Science 2025-10-28 Mohammad Hossein Jafari Naeimi , Ali Norouzi , Athena Abdi

As reinforcement learning (RL) deployments expand into safety-critical domains, existing evaluation methods fail to systematically identify hazards arising from the black-box nature of neural network enabled policies and distributional…

Ensuring safety is important for the practical deployment of reinforcement learning (RL). Various challenges must be addressed, such as handling stochasticity in the environments, providing rigorous guarantees of persistent state-wise…

Machine Learning · Computer Science 2023-09-26 Milan Ganai , Zheng Gong , Chenning Yu , Sylvia Herbert , Sicun Gao

Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance…

Systems and Control · Electrical Eng. & Systems 2024-06-25 Jingyuan Zhou , Longhao Yan , Kaidi Yang

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

The research addresses sensor task management for radar systems, focusing on efficiently searching and tracking multiple targets using reinforcement learning. The approach develops a 3D simulation environment with an active electronically…

Machine Learning · Computer Science 2025-02-20 Jan-Hendrik Ewers , David Cormack , Joe Gibbs , David Anderson

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

Machine Learning · Computer Science 2020-05-29 Hyun Jae Cho , Madhur Behl

The airworthiness and safety of a non-pedigreed autopilot must be verified, but the cost to formally do so can be prohibitive. We can bypass formal verification of non-pedigreed components by incorporating Runtime Safety Assurance (RTSA) as…

Machine Learning · Computer Science 2020-10-22 Christopher Lazarus , James G. Lopez , Mykel J. Kochenderfer