English
Related papers

Related papers: Auditing Robot Learning for Safety and Compliance …

200 papers

Trust in robots has been gathering attention from multiple directions, as it has special relevance in the theoretical descriptions of human-robot interactions. It is essential for reaching high acceptance and usage rates of robotic…

Robotics · Computer Science 2021-06-07 Hebert Azevedo-Sa , X. Jessie Yang , Lionel P. Robert , Dawn M. Tilbury

Recent years have seen growing interest among both researchers and practitioners in user-engaged approaches to algorithm auditing, which directly engage users in detecting problematic behaviors in algorithmic systems. However, we know…

Human-Computer Interaction · Computer Science 2023-02-22 Wesley Hanwen Deng , Bill Boyuan Guo , Alicia DeVrio , Hong Shen , Motahhare Eslami , Kenneth Holstein

Thanks to the great progress of machine learning in the last years, several Artificial Intelligence (AI) techniques have been increasingly moving from the controlled research laboratory settings to our everyday life. AI is clearly…

Artificial Intelligence · Computer Science 2021-06-07 Tatiana Tommasi , Silvia Bucci , Barbara Caputo , Pietro Asinari

Human and robot partners increasingly need to work together to perform tasks as a team. Robots designed for such collaboration must reason about how their task-completion strategies interplay with the behavior and skills of their human team…

Robotics · Computer Science 2022-11-08 Michelle Zhao , Reid Simmons , Henny Admoni

Human feedback is critical for aligning AI systems to human values. As AI capabilities improve and AI is used to tackle more challenging tasks, verifying quality and safety becomes increasingly challenging. This paper explores how we can…

Artificial Intelligence · Computer Science 2025-10-31 Rishub Jain , Sophie Bridgers , Lili Janzer , Rory Greig , Tian Huey Teh , Vladimir Mikulik

With the growing capabilities of intelligent systems, the integration of robots in our everyday life is increasing. However, when interacting in such complex human environments, the occasional failure of robotic systems is inevitable. The…

Artificial Intelligence · Computer Science 2021-08-05 Devleena Das , Siddhartha Banerjee , Sonia Chernova

Benchmarks are important measures to evaluate safety and compliance of AI models at scale. However, they typically do not offer verifiable results and lack confidentiality for model IP and benchmark datasets. We propose Attestable Audits,…

Artificial Intelligence · Computer Science 2025-07-01 Christoph Schnabl , Daniel Hugenroth , Bill Marino , Alastair R. Beresford

Roboticists usually test new control software in simulation environments before evaluating its functionality on real-world robots. Simulations reduce the risk of damaging the hardware and can significantly increase the development process's…

Robotics · Computer Science 2021-02-17 Felix Sygulla , Daniel Rixen

This study explores the significance of robot hearing systems, emphasizing their importance for robots operating in diverse and uncertain environments. It introduces the hardware design principles using robotaxis as an example, where…

Sound · Computer Science 2023-12-06 Xuan Zhong

In a time of rapidly evolving military threats and increasingly complex operational environments, the integration of AI into military operations proves significant advantages. At the same time, this implies various challenges and risks…

Artificial Intelligence · Computer Science 2025-10-03 Clara Maathuis , Kasper Cools

Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to…

Robotics · Computer Science 2023-01-04 Ran Tian , Masayoshi Tomizuka , Anca Dragan , Andrea Bajcsy

In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of…

Artificial Intelligence · Computer Science 2021-05-17 Jens Braband , Hendrik Schäbe

Algorithm audits have increased in recent years due to a growing need to independently assess the performance of automatically curated services that process, filter, and rank the large and dynamic amount of information available on the…

Computers and Society · Computer Science 2023-04-06 Roberto Ulloa , Mykola Makhortykh , Aleksandra Urman

Recent years have seen significant progress in the realm of robot autonomy, accompanied by the expanding reach of robotic technologies. However, the emergence of new deployment domains brings unprecedented challenges in ensuring safe…

Systems and Control · Electrical Eng. & Systems 2023-09-13 Kai-Chieh Hsu , Haimin Hu , Jaime Fernández Fisac

The rapid advancement of artificial intelligence (AI) has brought significant challenges to the education and workforce skills required to take advantage of AI for human-AI collaboration in the workplace. As AI continues to reshape…

Artificial Intelligence · Computer Science 2024-05-31 Margarida Romero

Artificial Intelligence (AI) is an effective science which employs strong enough approaches, methods, and techniques to solve unsolvable real world based problems. Because of its unstoppable rise towards the future, there are also some…

Artificial Intelligence · Computer Science 2017-06-12 Alice Pavaloiu , Utku Kose

Powerful predictive AI systems have demonstrated great potential in augmenting human decision making. Recent empirical work has argued that the vision for optimal human-AI collaboration requires 'appropriate reliance' of humans on AI…

Artificial Intelligence · Computer Science 2024-09-24 Gaole He , Abri Bharos , Ujwal Gadiraju

Artificial intelligence (AI) systems are deployed as collaborators in human decision-making. Yet, evaluation practices focus primarily on model accuracy rather than whether human-AI teams are prepared to collaborate safely and effectively.…

Human-Computer Interaction · Computer Science 2026-03-20 Min Hun Lee

In this paper we focus on artificial intelligence (AI) for governance, not governance for AI, and on just one aspect of governance, namely ethics audit. Different kinds of ethical audit bots are possible, but who makes the choices and what…

Artificial Intelligence · Computer Science 2021-03-30 Siani Pearson , Martin Lloyd , Vivek Nallur

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch