English
Related papers

Related papers: Limits of Probabilistic Safety Guarantees when Con…

200 papers

To safely navigate unknown environments, robots must accurately perceive dynamic obstacles. Instead of directly measuring the scene depth with a LiDAR sensor, we explore the use of a much cheaper and higher resolution sensor: programmable…

Machine Learning · Computer Science 2021-07-09 Siddharth Ancha , Gaurav Pathak , Srinivasa G. Narasimhan , David Held

Continued adoption of agricultural robots postulates the farmer's trust in the reliability, robustness and safety of the new technology. This motivates our work on safety assurance of agricultural robots, particularly their ability to…

Robotics · Computer Science 2025-06-25 Mustafa Adam , Kangfeng Ye , David A. Anisi , Ana Cavalcanti , Jim Woodcock , Robert Morris

Autonomous vehicles rely on machine learning to solve challenging tasks in perception and motion planning. However, automotive software safety standards have not fully evolved to address the challenges of machine learning safety such as…

Machine Learning · Computer Science 2019-12-23 Sina Mohseni , Mandar Pitale , Vasu Singh , Zhangyang Wang

Achieving safe control under uncertainty is a key problem that needs to be tackled for enabling real-world autonomous robots and cyber-physical systems. This paper introduces Probabilistic Safety Programs (PSP) that embed both the…

Robotics · Computer Science 2016-10-19 Ashish Kapoor , Debadeepta Dey , Shital Shah

In order for autonomous vehicles to become a part of the Intelligent Transportation Ecosystem, they are required to guarantee a particular level of safety. For that to happen a safe vehicle control algorithms need to be developed, which…

Robotics · Computer Science 2020-03-03 Vladislav Kibalov , Oleg Shipitko

Data-driven models are subject to model errors due to limited and noisy training data. Key to the application of such models in safety-critical domains is the quantification of their model error. Gaussian processes provide such a measure…

Machine Learning · Computer Science 2024-09-23 Armin Lederer , Jonas Umlauft , Sandra Hirche

Autonomous vehicles are more likely to be accepted if they drive accurately, comfortably, but also similar to how human drivers would. This is especially true when autonomous and human-driven vehicles need to share the same road. The main…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Simon Hecker , Dengxin Dai , Luc Van Gool

This paper presents the framework \textbf{GUARD} (\textbf{G}uided robot control via \textbf{U}ncertainty attribution and prob\textbf{A}bilistic kernel optimization for \textbf{R}isk-aware \textbf{D}ecision making) that combines traditional…

Robotics · Computer Science 2025-09-30 Johannes A. Gaus , Junheon Yoon , Woo-Jeong Baek , Seungwon Choi , Suhan Park , Jaeheung Park

Density of the reachable states can help understand the risk of safety-critical systems, especially in situations when worst-case reachability is too conservative. Recent work provides a data-driven approach to compute the density…

Robotics · Computer Science 2022-09-19 Yue Meng , Zeng Qiu , Md Tawhid Bin Waez , Chuchu Fan

Driving on roads is restricted by various traffic rules, aiming to ensure safety for all traffic participants. However, human road users usually do not adhere to these rules strictly, resulting in varying degrees of rule conformity. Such…

Robotics · Computer Science 2022-07-25 Daniel Bogdoll , Moritz Nekolla , Tim Joseph , J. Marius Zöllner

Human trust in automation plays an essential role in interactions between humans and automation. While a lack of trust can lead to a human's disuse of automation, over-trust can result in a human trusting a faulty autonomous system which…

Human-Computer Interaction · Computer Science 2023-04-17 Kumar Akash , Griffon McMahon , Tahira Reid , Neera Jain

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

The deployment of Large Language Models (LLMs) in robotic systems presents unique safety challenges, particularly in unpredictable environments. Although LLMs, leveraging zero-shot learning, enhance human-robot interaction and…

Robotics · Computer Science 2025-03-07 Ahmad Hafez , Alireza Naderi Akhormeh , Amr Hegazy , Amr Alanwar

Ensuring safety for human-interactive robotics is important due to the potential for human injury. The key challenge is defining safety in a way that accounts for the complex range of human behaviors without modeling the human as an…

Robotics · Computer Science 2021-10-12 Jeevana Priya Inala , Yecheng Jason Ma , Osbert Bastani , Xin Zhang , Armando Solar-Lezama

To assure that an autonomous car is driving safely on public roads, its object detection module should not only work correctly, but show its prediction confidence as well. Previous object detectors driven by deep learning do not explicitly…

Robotics · Computer Science 2018-09-10 Di Feng , Lars Rosenbaum , Klaus Dietmayer

Human drivers naturally balance the risks of different concerns while driving, including traffic rule violations, minor accidents, and fatalities. However, achieving the same behavior in autonomous driving systems remains an open problem.…

Systems and Control · Electrical Eng. & Systems 2026-03-06 Shuhao Qi , Zengjie Zhang , Zhiyong Sun , Sofie Haesaert

Safe control methods are often intended to behave safely even in worst-case human uncertainties. However, humans may exploit such safety-first systems, which results in greater risk for everyone. Despite their significance, no prior work…

Human-Computer Interaction · Computer Science 2023-02-13 Zixuan Zhang , Maitham AL-Sunni , Haoming Jing , Hirokazu Shirado , Yorie Nakahira

A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from…

Machine Learning · Computer Science 2018-11-19 Rhiannon Michelmore , Marta Kwiatkowska , Yarin Gal

In order to develop provably safe human-in-the-loop systems, accurate and precise models of human behavior must be developed. In the case of intelligent vehicles, one can imagine the need for predicting driver behavior to develop minimally…

Systems and Control · Computer Science 2017-05-03 Katherine Driggs-Campbell , Roy Dong , S. Shankar Sastry , Ruzena Bajcsy

Robots deployed in unstructured, real-world environments operate under considerable uncertainty due to imperfect state estimates, model error, and disturbances. Given this real-world context, the goal of this paper is to develop controllers…

Systems and Control · Electrical Eng. & Systems 2023-02-27 Ryan K. Cosner , Preston Culbertson , Andrew J. Taylor , Aaron D. Ames