English
Related papers

Related papers: Moral Testing of Autonomous Driving Systems

200 papers

We show how to assess a language model's knowledge of basic concepts of morality. We introduce the ETHICS dataset, a new benchmark that spans concepts in justice, well-being, duties, virtues, and commonsense morality. Models predict…

Computers and Society · Computer Science 2023-02-20 Dan Hendrycks , Collin Burns , Steven Basart , Andrew Critch , Jerry Li , Dawn Song , Jacob Steinhardt

Autonomous driving vehicles provide a vast potential for realizing use cases in the on-road and off-road domains. Consequently, remarkable solutions exist to autonomous systems' environmental perception and control. Nevertheless, proof of…

Robotics · Computer Science 2024-03-29 Patrick Wolf

Testing Autonomous Driving Systems (ADS) is crucial for ensuring their safety, reliability, and performance. Despite numerous testing methods available that can generate diverse and challenging scenarios to uncover potential…

Software Engineering · Computer Science 2025-02-13 Renzhi Wang , Mingfei Cheng , Xiaofei Xie , Yuan Zhou , Lei Ma

As AI systems become more advanced and widely deployed, there will likely be increasing debate over whether AI systems could have conscious experiences, desires, or other states of potential moral significance. It is important to inform…

Machine Learning · Computer Science 2023-11-16 Ethan Perez , Robert Long

Work on morality in large language models (LLMs) has progressed via constitutional AI, reinforcement learning from human feedback (RLHF) and systematic benchmarking, yet it still lacks tools to connect internal moral representations to…

Human-Computer Interaction · Computer Science 2026-03-25 Gunter Bombaerts

Increasing automation in the healthcare sector calls for a Hybrid Intelligence (HI) approach to closely study and design the collaboration of humans and autonomous machines. Ensuring that medical HI systems' decision-making is ethical is…

Human-Computer Interaction · Computer Science 2021-02-23 Jip van Stijn

This case study delves into the ethical ramifications of an incident involving Tesla's Autopilot, emphasizing Tesla Motors' moral responsibility. Using a seven-step ethical decision-making process, it examines user behavior, system…

Computers and Society · Computer Science 2024-09-27 Aravinda Jatavallabha

The development of autonomous vehicles has brought a great impact and changes to the transportation industry, offering numerous benefits in terms of safety and efficiency. However, one of the key challenges that autonomous driving faces is…

Robotics · Computer Science 2023-08-03 Wen Wei , Jiankun Wang

This paper elaborates on the concept of moral exercises as a means to help AI actors cultivate virtues that enable effective human oversight of AI systems. We explore the conceptual framework and significance of moral exercises, situating…

Computers and Society · Computer Science 2025-05-23 Silvia Crafa , Teresa Scantamburlo

Machine Ethics (ME) is concerned with the design of Artificial Moral Agents (AMAs), i.e. autonomous agents capable of reasoning and behaving according to moral values. Previous approaches have treated values as labels associated with some…

Artificial Intelligence · Computer Science 2023-02-20 Nieves Montes , Nardine Osman , Carles Sierra , Marija Slavkovik

Research in Responsible AI has developed a range of principles and practices to ensure that machine learning systems are used in a manner that is ethical and aligned with human values. However, a critical yet often neglected aspect of…

Computers and Society · Computer Science 2024-08-21 Neha R. Gupta , Jessica Hullman , Hari Subramonyam

The proliferation of Artificial Intelligence (AI) systems exhibiting complex and seemingly agentive behaviours necessitates a critical philosophical examination of their agency, autonomy, and moral status. In this paper we undertake a…

Computers and Society · Computer Science 2026-02-03 Paul Formosa , Inês Hipólito , Thomas Montefiore

The Multi-valued Action Reasoning System (MARS) is an automated value-based ethical decision-making model for artificial agents (AI). Given a set of available actions and an underlying moral paradigm, by employing MARS one can identify the…

Artificial Intelligence · Computer Science 2023-02-08 Cosmin Badea

As the laws have become more complicated and enormous, the role of software systems in navigating and understanding these intricacies has become more critical. Given their socio-economic and legally critical implications, ensuring software…

Software Engineering · Computer Science 2024-10-23 Saeid Tizpaz-Niari , Shiva Darian , Ashutosh Trivedi

The field of machine ethics is concerned with the question of how to embed ethical behaviors, or a means to determine ethical behaviors, into artificial intelligence (AI) systems. The goal is to produce artificial moral agents (AMAs) that…

Artificial Intelligence · Computer Science 2019-03-19 Adam Poulsen , Michael Anderson , Susan L. Anderson , Ben Byford , Fabio Fossa , Erica L. Neely , Alejandro Rosas , Alan Winfield

Morality in dialogue systems has raised great attention in research recently. A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. In this paper, we propose a framework, MoralDial to…

Computation and Language · Computer Science 2023-05-29 Hao Sun , Zhexin Zhang , Fei Mi , Yasheng Wang , Wei Liu , Jianwei Cui , Bin Wang , Qun Liu , Minlie Huang

Autonomous vehicles (AVs) are poised to revolutionize global transportation systems. However, its widespread acceptance and market penetration remain significantly below expectations. This gap is primarily driven by persistent challenges in…

Robotics · Computer Science 2026-02-10 Yuxin Zhang , Cheng Wang , Hubert P. H. Shum

Automated decision systems (ADS) are increasingly used for consequential decision-making. These systems often rely on sophisticated yet opaque machine learning models, which do not allow for understanding how a given decision was arrived…

Artificial Intelligence · Computer Science 2022-05-03 Jakob Schoeffer

One major challenge for the adoption and acceptance of automated vehicles (AVs) is ensuring that they can make sound decisions in everyday situations that involve ethical tension. Much attention has focused on rare, high-stakes dilemmas…

Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks…

Computers and Society · Computer Science 2019-10-30 Hazel Si Min Lim , Araz Taeihagh