English
Related papers

Related papers: Oversight of Unsafe Systems via Dynamic Safety Env…

200 papers

Artificial Intelligence-enabled systems are increasingly being deployed in real-world safety-critical settings involving human participants. It is vital to ensure the safety of such systems and stop the evolution of the system with error…

Human-Computer Interaction · Computer Science 2024-07-30 Aranyak Maity , Ayan Banerjee , Sandeep Gupta

We extend the learning from demonstration paradigm by providing a method for learning unknown constraints shared across tasks, using demonstrations of the tasks, their cost functions, and knowledge of the system dynamics and control…

Robotics · Computer Science 2019-02-22 Glen Chou , Dmitry Berenson , Necmiye Ozay

We approach the fundamental problem of obstacle avoidance for robotic systems via the lens of online learning. In contrast to prior work that either assumes worst-case realizations of uncertainty in the environment or a stationary…

Robotics · Computer Science 2023-11-07 David Snyder , Meghan Booker , Nathaniel Simon , Wenhan Xia , Daniel Suo , Elad Hazan , Anirudha Majumdar

Identifying and controlling an unstable, underactuated robot to enable reference tracking is a challenging control problem. In this paper, a ballbot (robot balancing on a ball) is used as an experimental setup to demonstrate and test…

Optimization and Control · Mathematics 2024-04-24 Tobias Fischer , Dimitrios S. Karachalios , Ievgen Zhavzharov , Hossam S. Abbas

Intercepting dynamic objects in uncertain environments involves a significant unresolved challenge in modern robotic systems. Current control approaches rely solely on estimated information, and results lack guarantees of robustness and…

Robotics · Computer Science 2025-12-16 Tommaso Faraci , Roberto Lampariello

Modern computing systems inherently trust human input devices, creating an exploitable attack surface for adversarial automation. USB Human Interface Device (HID) emulation attacks, such as those enabled by the USB Rubber Ducky, exploit…

Cryptography and Security · Computer Science 2026-04-20 Alessandro Lotto , Francesco Marchiori , Mauro Conti

Control affine assumptions, human inputs are external disturbances, in certified safe controller synthesis approaches are frequently violated in operational deployment under causal human actions. This paper takes a human-in-the-loop…

Human-Computer Interaction · Computer Science 2024-09-09 Ayan Banerjee , Aranyak Maity , Imane Lamrani , Sandeep K. S. Gupta

We present a rigorous, human-in-the-loop evaluation framework for assessing the performance of AI agents on the task of Air Traffic Control, grounded in a regulator-certified simulator-based curriculum used for training and testing…

Human-Computer Interaction · Computer Science 2026-01-13 Ben Carvell , Marc Thomas , Andrew Pace , Christopher Dorney , George De Ath , Richard Everson , Nick Pepper , Adam Keane , Samuel Tomlinson , Richard Cannon

The black-box nature of machine learning models limits their use in case-critical applications, raising faithful and ethical concerns that lead to trust crises. One possible way to mitigate this issue is to understand how a (mispredicted)…

Artificial Intelligence · Computer Science 2021-06-25 Xianlong Zeng , Fanghao Song , Zhongen Li , Krerkkiat Chusap , Chang Liu

Visual navigation is a core capability for mobile robots, yet end-to-end learning-based methods often struggle with generalization and safety in unseen, cluttered, or narrow environments. These limitations are especially pronounced in dense…

Robotics · Computer Science 2026-03-03 Lingjie Zhang , Zeyu Jiang , Changhao Chen

This paper presents a framework for the safety-critical control of robotic systems, when safety is defined on safe regions in the configuration space. To maintain safety, we synthesize a safe velocity based on control barrier function…

Robotics · Computer Science 2022-11-21 Tamas G. Molnar , Ryan K. Cosner , Andrew W. Singletary , Wyatt Ubellacker , Aaron D. Ames

The development of safety-critical systems requires the control of hazards that can potentially cause harm. To this end, safety engineers rely during the development phase on architectural solutions, called safety patterns, such as safety…

Systems and Control · Electrical Eng. & Systems 2020-09-23 Yuri Gil Dantas , Antoaneta Kondeva , Vivek Nigam

Fully automatic deep learning has become the state-of-the-art technique for many tasks including image acquisition, analysis and interpretation, and for the extraction of clinically useful information for computer-aided detection,…

Machine Learning · Computer Science 2021-05-06 Samuel Budd , Emma C Robinson , Bernhard Kainz

Shared autonomy provides a framework where a human and an automated system, such as a robot, jointly control the system's behavior, enabling an effective solution for various applications, including human-robot interaction. However, a…

Robotics · Computer Science 2021-12-02 Binghan He , Mahsa Ghasemi , Ufuk Topcu , Luis Sentis

Ball and hoop system is a well-known model for the education of linear control systems. In this paper, we have a look at this system from another perspective and show that it is also suitable for demonstration of more advanced control…

Systems and Control · Computer Science 2017-06-23 Martin Gurtner , Jiří Zemánek

Emergency stop (E-stop) mechanisms are the de facto standard for robot safety. However, for humanoid robots, abruptly cutting power can itself cause catastrophic failures; instead, an emergency stop must execute a predefined fallback…

Robotics · Computer Science 2026-03-25 Yifan Sun , Yiyuan Pan , Shangtao Li , Caiwu Ding , Tao Cui , Lingyun Wang , Changliu Liu

This paper proposes a robot action planning scheme that provides an efficient and probabilistically safe plan for a robot interacting with an unconcerned human -- someone who is either unaware of the robot's presence or unwilling to engage…

Robotics · Computer Science 2025-08-19 Mohsen Amiri , Mehdi Hosseinzadeh

The integration of collaborative robots into industrial environments has improved productivity, but has also highlighted significant challenges related to operator safety and ergonomics. This paper proposes an innovative framework that…

Robotics · Computer Science 2025-04-15 Francesco Iodice , Elena De Momi , Arash Ajoudani

A new framework is developed for control of constrained nonlinear systems with structured parametric uncertainties. Forward invariance of a safe set is achieved through online parameter adaptation and data-driven model estimation. The new…

Systems and Control · Electrical Eng. & Systems 2020-06-01 Brett T. Lopez , Jean-Jacques E. Slotine , Jonathan P. How

Robot learning methods have recently made great strides, but generalization and robustness challenges still hinder their widespread deployment. Failing to detect and address potential failures renders state-of-the-art learning systems not…

Robotics · Computer Science 2024-03-11 Huihan Liu , Shivin Dass , Roberto Martín-Martín , Yuke Zhu