English
Related papers

Related papers: Moral Dilemmas for Moral Machines

200 papers

Humans display significant uncertainty when confronted with moral dilemmas, yet the extent of such uncertainty in machines and AI agents remains underexplored. Recent studies have confirmed the overly confident tendencies of…

Artificial Intelligence · Computer Science 2025-11-18 Jea Kwon , Luiz Felipe Vecchietti , Sungwon Park , Meeyoung Cha

Artificial intelligence (AI) is advancing at a pace that raises urgent questions about how to align machine decision-making with human moral values. This working paper investigates how leading AI systems prioritize moral outcomes and what…

Artificial Intelligence · Computer Science 2025-09-15 Eoin O'Doherty , Nicole Weinrauch , Andrew Talone , Uri Klempner , Xiaoyuan Yi , Xing Xie , Yi Zeng

An Artificially Intelligent system (an AI) has debatable personhood if it's epistemically possible either that the AI is a person or that it falls far short of personhood. Debatable personhood is a likely outcome of AI development and might…

Computers and Society · Computer Science 2023-03-31 Eric Schwitzgebel

This paper describes current progress on developing an ethical architecture for robots that are designed to follow human ethical decision-making processes. We surveyed both regular adults (folks) and ethics experts (experts) on what they…

Robotics · Computer Science 2022-06-23 Shengkang Chen , Vidullan Surendran , Alan R. Wagner , Jason Borenstein , Ronald C. Arkin

Artificial Intelligence (AI) is an effective science which employs strong enough approaches, methods, and techniques to solve unsolvable real world based problems. Because of its unstoppable rise towards the future, there are also some…

Artificial Intelligence · Computer Science 2017-06-12 Alice Pavaloiu , Utku Kose

As artificial intelligence systems become increasingly agentic, capable of general reasoning, planning, and value prioritization, current safety practices that treat obedience as a proxy for ethical behavior are becoming inadequate. This…

Artificial Intelligence · Computer Science 2025-07-04 Joseph Boland

Human moral judgment is context-dependent and modulated by interpersonal relationships. As large language models (LLMs) increasingly function as decision-support systems, determining whether they encode these social nuances is critical. We…

Computation and Language · Computer Science 2026-04-24 Jiseon Kim , Jea Kwon , Luiz Felipe Vecchietti , Wenchao Dong , Jaehong Kim , Meeyoung Cha

Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely…

Computation and Language · Computer Science 2025-05-26 Ya Wu , Qiang Sheng , Danding Wang , Guang Yang , Yifan Sun , Zhengjia Wang , Yuyan Bu , Juan Cao

As large language models (LLMs) increasingly participate in high-stakes decision-making, a central societal debate has revolved around which moral frameworks-deontological or utilitarian-should guide machine behavior. However, a largely…

Computers and Society · Computer Science 2026-04-14 Pengzhao Lyu , Yeun Joon Kim , Yingyue Luna Luan , Jungmin Choi

The development of autonomous vehicles has brought a great impact and changes to the transportation industry, offering numerous benefits in terms of safety and efficiency. However, one of the key challenges that autonomous driving faces is…

Robotics · Computer Science 2023-08-03 Wen Wei , Jiankun Wang

Autonomous Driving System (ADS) testing plays a crucial role in their development, with the current focus primarily on functional and safety testing. However, evaluating the non-functional morality of ADSs, particularly their…

Software Engineering · Computer Science 2025-05-07 Wenbing Tang , Mingfei Cheng , Yuan Zhou , Yang Liu

AI-based systems can increasingly perform work tasks autonomously. In safety-critical tasks, human oversight of these systems is required to mitigate risks and to ensure responsibility in case something goes wrong. Since people often…

Human-Computer Interaction · Computer Science 2026-02-12 Cedric Faas , Richard Uth , Sarah Sterz , Markus Langer , Anna Maria Feit

Knowing the reflection of game theory and ethics, we develop a mathematical representation to bridge the gap between the concepts in moral philosophy (e.g., Kantian and Utilitarian) and AI ethics industry technology standard (e.g., IEEE…

Artificial Intelligence · Computer Science 2017-11-17 Yijia Wang , Yan Wan , Zhijian Wang

Artificially intelligent systems, given a set of non-trivial ethical rules to follow, will inevitably be faced with scenarios which call into question the scope of those rules. In such cases, human reasoners typically will engage in…

Artificial Intelligence · Computer Science 2019-11-06 John Licato , Zaid Marji , Sophia Abraham

Artificial intelligence (AI) was initially developed as an implicit moral agent to solve simple and clearly defined tasks where all options are predictable. However, it is now part of our daily life powering cell phones, cameras, watches,…

Computers and Society · Computer Science 2020-02-11 Mohamed Akrout , Robert Steinbauer

Growing concerns about safety and alignment of AI systems highlight the importance of embedding moral capabilities in artificial agents: a promising solution is the use of learning from experience, i.e., Reinforcement Learning. In…

Multiagent Systems · Computer Science 2026-02-11 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

A computational ethics framework is essential for AI and autonomous systems operating in complex, real-world environments. Existing approaches often lack the adaptability needed to integrate ethical principles into dynamic and ambiguous…

Artificial Intelligence · Computer Science 2025-03-03 Nijesh Upreti , Jessica Ciupa , Vaishak Belle

The transfer of tasks with sometimes far-reaching moral implications to autonomous systems raises a number of ethical questions. In addition to fundamental questions about the moral agency of these systems, behavioral issues arise. This…

Computers and Society · Computer Science 2021-01-28 Till Feier , Jan Gogoll , Matthias Uhl

The recent surge in interest in ethics in artificial intelligence may leave many educators wondering how to address moral, ethical, and philosophical issues in their AI courses. As instructors we want to develop curriculum that not only…

Artificial Intelligence · Computer Science 2017-01-27 Emanuelle Burton , Judy Goldsmith , Sven Koenig , Benjamin Kuipers , Nicholas Mattei , Toby Walsh

As the range of potential uses for Artificial Intelligence (AI), in particular machine learning (ML), has increased, so has awareness of the associated ethical issues. This increased awareness has led to the realisation that existing…

Computers and Society · Computer Science 2021-02-19 Jessica Morley , Anat Elhalal , Francesca Garcia , Libby Kinsey , Jakob Mokander , Luciano Floridi