English
Related papers

Related papers: Human-Robot Red Teaming for Safety-Aware Reasoning

200 papers

Humans engaged in collaborative activities are naturally able to convey their intentions to teammates through multi-modal communication, which is made up of explicit and implicit cues. Similarly, a more natural form of human-robot…

Robotics · Computer Science 2022-07-01 Simone Macciò , Alessandro Carfì , Fulvio Mastrogiovanni

Tight coordination is required for effective human-robot teams in domains involving fast dynamics and tactical decisions, such as multi-car racing. In such settings, robot teammates must react to cues of a human teammate's tactical…

Recent works explore collaboration between humans and teams of robots. These approaches make sense if the human is already working with the robot team; but how should robots encourage nearby humans to join their teams in the first place?…

Robotics · Computer Science 2022-05-10 Soheil Habibian , Dylan P Losey

Red teaming has evolved from its origins in military applications to become a widely adopted methodology in cybersecurity and AI. In this paper, we take a critical look at the practice of AI red teaming. We argue that despite its current…

Artificial Intelligence · Computer Science 2025-11-03 Subhabrata Majumdar , Brian Pendleton , Abhishek Gupta

The foundation of successful human collaboration is deeply rooted in the principles of fairness. As robots are increasingly prevalent in various parts of society where they are working alongside groups and teams of humans, their ability to…

Robotics · Computer Science 2024-06-03 Houston Claure

Ensuring human safety in collaborative robotics can compromise efficiency because traditional safety measures increase robot cycle time when human interaction is frequent. This paper proposes a safety-aware approach to mitigate efficiency…

Robotics · Computer Science 2025-12-22 M. Faroni , A. Spano , A. M. Zanchettin , P. Rocco

As robots become ubiquitous in the workforce, it is essential that human-robot collaboration be both intuitive and adaptive. A robot's quality improves based on its ability to explicitly reason about the time-varying (i.e. learning curves)…

Robotics · Computer Science 2020-07-10 Ruisen Liu , Manisha Natarajan , Matthew Gombolay

Studies of human-robot interaction in dynamic and unstructured environments show that as more advanced robotic capabilities are deployed, the need for cooperative competencies to support collaboration with human problem-holders increases.…

Robotics · Computer Science 2025-12-18 Martijn IJtsma , Salvatore Hargis

Human-robot interaction can be divided into two categories based on the physical distance between the human and robot: remote and proximal. In proximal interaction, the human and robot often engage in close coordination; in remote…

Artificial Intelligence · Computer Science 2014-12-10 Vignesh Narayanan , Yu Zhang , Nathaniel Mendoza , Subbarao Kambhampati

This paper addresses motion replanning in human-robot collaborative scenarios, emphasizing reactivity and safety-compliant efficiency. While existing human-aware motion planners are effective in structured environments, they often struggle…

Collaboration is a central theme in multi-robot systems as tasks and demands increasingly require capabilities that go beyond what any one individual robot possesses. Yet, despite extensive work on cooperative control and coordinated…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Riwa Karam , Alexander A. Nguyen , Ruoyu Lin , David R. Martin , Diana Morales , Brooks A. Butler , Magnus Egerstedt

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

Cryptography and Security · Computer Science 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

Humans often assume that robots are rational. We believe robots take optimal actions given their objective; hence, when we are uncertain about what the robot's objective is, we interpret the robot's actions as optimal with respect to our…

Robotics · Computer Science 2019-09-13 Dylan P. Losey , Dorsa Sadigh

As humans move toward collaborating with coordinated robot teams, understanding how these teams coordinate and fail is essential for building trust and ensuring safety. However, exposing human collaborators to coordination failures during…

Robotics · Computer Science 2026-04-09 Yuanchen Bai , Zijian Ding , Shaoyue Wen , Xiang Chang , Angelique Taylor

Mobile robots with some degree of autonomy could deliver significant advantages in high-risk missions such as search and rescue and firefighting. Integrated into a human-robot team (HRT), robots could work effectively to help search…

Human-Computer Interaction · Computer Science 2025-10-28 Nicola Webb , Zijun Huang , Sanja Milivojevic , Chris Baber , Edmund R. Hunt

Often, when modeling human decision-making behaviors in the context of human-robot teaming, the emotion aspect of human is ignored. Nevertheless, the influence of emotion, in some cases, is not only undeniable but beneficial. This work…

Artificial Intelligence · Computer Science 2019-10-02 Longsheng Jiang , Yue Wang

Our goal is to model and experimentally assess trust evolution to predict future beliefs and behaviors of human-robot teams in dynamic environments. Research suggests that maintaining trust among team members in a human-robot team is vital…

Robotics · Computer Science 2025-11-12 Dong Hae Mangalindan , Ericka Rovira , Vaibhav Srivastava

Red teaming has emerged as a critical practice in assessing the possible risks of AI models and systems. It aids in the discovery of novel risks, stress testing possible gaps in existing mitigations, enriching existing quantitative safety…

Computers and Society · Computer Science 2025-03-24 Lama Ahmad , Sandhini Agarwal , Michael Lampe , Pamela Mishkin

Effective communication is essential in collaborative tasks, so AI-equipped robots working alongside humans need to be able to explain their behaviour in order to cooperate effectively and earn trust. We analyse and classify communications…

Human-Computer Interaction · Computer Science 2024-11-20 Marc Roig Vilamala , Jack Furby , Julian de Gortari Briseno , Mani Srivastava , Alun Preece , Carolina Fuentes Toro

As robots increasingly operate in shared, safety critical environments, acting safely is no longer sufficient robots must also make their safety decisions intelligible to human collaborators. In human robot collaboration (HRC), behaviours…