English
Related papers

Related papers: Synergistic Simplex: Cooperative Runtime Assurance…

200 papers

The rapid development of autonomous vehicles (AVs) holds vast potential for transportation systems through improved safety, efficiency, and access to mobility. However, the progression of these impacts, as AVs are adopted, is not well…

Artificial Intelligence · Computer Science 2022-01-03 Cathy Wu , Aboudy Kreidieh , Kanaad Parvate , Eugene Vinitsky , Alexandre M Bayen

In human-robot collaboration (HRC), software-based automatic safety controllers (ASCs) are used in various forms (e.g. shutdown mechanisms, emergency brakes, interlocks) to improve operational safety. Complex robotic tasks and increasingly…

Robotics · Computer Science 2025-03-21 Mario Gleirscher , Radu Calinescu

To reduce Operation and Maintenance (O&M) costs on offshore wind farms, wherein 80% of the O&M cost relates to deploying personnel, the offshore wind sector looks to Robotics and Artificial Intelligence (RAI) for solutions. Barriers to…

As machine learning (ML) components become increasingly integrated into software systems, the emphasis on the ethical or responsible aspects of their use has grown significantly. This includes building ML-based systems that adhere to…

Software Engineering · Computer Science 2023-10-11 Hira Naveed

Ensuring safety and explainability of machine learning (ML) is a topic of increasing relevance as data-driven applications venture into safety-critical application domains, traditionally committed to high safety standards that are not…

Machine Learning · Computer Science 2020-05-28 Koorosh Aslansefat , Ioannis Sorokos , Declan Whiting , Ramin Tavakoli Kolagari , Yiannis Papadopoulos

Applying reinforcement learning to autonomous driving has garnered widespread attention. However, classical reinforcement learning methods optimize policies by maximizing expected rewards but lack sufficient safety considerations, often…

Robotics · Computer Science 2025-03-28 Bo Leng , Ran Yu , Wei Han , Lu Xiong , Zhuoren Li , Hailong Huang

Run Time Assurance (RTA) systems are online safety verification techniques that filter the output of a primary controller to assure safety. RTA approaches are used in safety-critical control to intervene when a performance-driven primary…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Kyle Dunlap , Michael Hibbard , Mark Mote , Kerianne Hobbs

This paper presents a secure-by-construction planning and control framework for multi-agent systems subject to linear temporal logic (LTL) specifications. The framework protects sensitive information from a passive intruder with partial…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Georgios Mitsos , Dimos V. Dimarogonas , Siyuan Liu

Large vision-language models (LVLMs) are vulnerable to harmful input compared to their language-only backbones. We investigated this vulnerability by exploring LVLMs internal dynamics, framing their inherent safety understanding in terms of…

Artificial Intelligence · Computer Science 2025-07-30 Wanying Wang , Zeyu Ma , Han Zheng , Xin Tan , Mingang Chen

Context: Machine Learning (ML) has been at the heart of many innovations over the past years. However, including it in so-called 'safety-critical' systems such as automotive or aeronautic has proven to be very challenging, since the shift…

Ensuring the functional safety of motion planning modules in autonomous vehicles remains a critical challenge, especially when dealing with complex or learning-based software. Online verification has emerged as a promising approach to…

Robotics · Computer Science 2025-07-11 Korbinian Moller , Rafael Neher , Marvin Seegert , Johannes Betz

We introduce a goal-aware extension of responsibility-sensitive safety (RSS), a recent methodology for rule-based safety guarantee for automated driving systems (ADS). Making RSS rules guarantee goal achievement -- in addition to collision…

It is recognized that the control of mixed-autonomy platoons comprising connected and automated vehicles (CAVs) and human-driven vehicles (HDVs) can enhance traffic flow. Among existing methods, Multi-Agent Reinforcement Learning (MARL)…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Jingyuan Zhou , Longhao Yan , Jinhao Liang , Kaidi Yang

Even modern AI models often remain vulnerable to multimodal queries in which harmful intent is embedded in images. A widely used approach for safety alignment is training with extensive multimodal safety datasets, but the costs of data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jonghyun Park , Minhyuk Seo , Chaewon Yeo , Jonghyun Choi

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

Robotics · Computer Science 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Autonomous Driving Systems (ADS) are safety-critical, where failures can be severe. While Metamorphic Testing (MT) is effective for fault detection in ADS, existing methods rely heavily on manual effort and lack automation. We present…

Software Engineering · Computer Science 2025-10-23 Linfeng Liang , Chenkai Tan , Yao Deng , Yingfeng Cai , T. Y Chen , Xi Zheng

Reinforcement Learning (RL) has shown promise in various robotics applications, yet its deployment on real systems is still limited due to safety and operational constraints. The safe RL field has gained considerable attention in recent…

Robotics · Computer Science 2026-03-19 Sadık Bera Yüksel , Ali Tevfik Buyukkocak , Derya Aksaray

Connected Autonomous Vehicles (CAVs) operate in dynamic, open, and multi-domain networks, rendering them vulnerable to various threats. Trust Management Systems (TMS) systematically organize essential steps in the trust mechanism,…

Artificial Intelligence · Computer Science 2025-05-14 Qian Xu , Lei Zhang , Yixiao Liu

We present SaSTL -- a novel Spatial Aggregation Signal Temporal Logic -- for the efficient runtime monitoring of safety and performance requirements in smart cities. We first describe a study of over 1,000 smart city requirements, some of…

Computers and Society · Computer Science 2021-12-16 Meiyi Ma , Ezio Bartocci , Eli Lifland , John Stankovic , Lu Feng

Multi-Agent Reinforcement Learning (MARL) holds significant promise for enabling cooperative driving among Connected and Automated Vehicles (CAVs). However, its practical application is hindered by a critical limitation, i.e., insufficient…

Robotics · Computer Science 2025-12-01 Yuchen Shi , Huaxin Pei , Yi Zhang , Danya Yao