English
Related papers

Related papers: Moral Dilemmas for Moral Machines

200 papers

While many see the prospect of autonomous machines as threatening, autonomy may be exactly what we want in a superintelligent machine. There is a sense of autonomy, deeply rooted in the ethical literature, in which an autonomous machine is…

Artificial Intelligence · Computer Science 2018-12-07 John Hooker

With the rise of AI and automation, moral decisions are being put into the hands of algorithms that were formerly the preserve of humans. In autonomous driving, a variety of such decisions with ethical implications are made by algorithms…

Robotics · Computer Science 2022-12-19 Maximilian Geisslinger , Franziska Poszler , Markus Lienkamp

While people generally trust AI to make decisions in various aspects of their lives, concerns arise when AI is involved in decisions with significant moral implications. The absence of a precise mathematical framework for moral reasoning…

Artificial Intelligence · Computer Science 2024-07-11 Vincent Conitzer

Machine ethics has received increasing attention over the past few years because of the need to ensure safe and reliable artificial intelligence (AI). The two dominantly used theories in machine ethics are deontological and utilitarian…

Artificial Intelligence · Computer Science 2023-01-10 Ajay Vishwanath , Einar Duenger Bøhn , Ole-Christoffer Granmo , Charl Maree , Christian Omlin

Given the fast rise of increasingly autonomous artificial agents and robots, a key acceptability criterion will be the possible moral implications of their actions. In particular, intelligent persuasive systems (systems designed to…

Computers and Society · Computer Science 2014-04-16 Marco Guerini , Fabio Pianesi , Oliviero Stock

While various traditions under the 'virtue ethics' umbrella have been studied extensively and advocated by ethicists, it has not been clear that there exists a version of virtue ethics rigorous enough to be a target for machine ethics…

Artificial Intelligence · Computer Science 2019-01-01 Naveen Sundar Govindarajulu , Selmer Bringsjord , Rikhiya Ghosh

Increasingly complex and autonomous systems require machine ethics to maximize the benefits and minimize the risks to society arising from the new technology. It is challenging to decide which type of ethical theory to employ and how to…

Artificial Intelligence · Computer Science 2021-01-25 Suzanne Tolmeijer , Markus Kneer , Cristina Sarasua , Markus Christen , Abraham Bernstein

Recent advances in large language models (LLMs) have enabled their use in complex agentic roles, involving decision-making with humans or other agents, making ethical alignment a key AI safety concern. While prior work has examined both…

Computation and Language · Computer Science 2025-05-27 Steffen Backmann , David Guzman Piedrahita , Emanuel Tewolde , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

In this essay, I argue that explicit ethical machines, whose moral principles are inferred through a bottom-up approach, are unable to replicate human-like moral reasoning and cannot be considered moral agents. By utilizing Alan Turing's…

Computers and Society · Computer Science 2024-07-25 Massimo Passamonti

As large language models (LLMs) become more deeply integrated into various sectors, understanding how they make moral judgments has become crucial, particularly in the realm of autonomous driving. This study utilized the Moral Machine…

Computation and Language · Computer Science 2024-02-08 Kazuhiro Takemoto

Automated vehicles have received much attention recently, particularly the DARPA Urban Challenge vehicles, Google's self-driving cars, and various others from auto manufacturers. These vehicles have the potential to significantly reduce…

Computers and Society · Computer Science 2020-11-02 Noah Goodall

The rapid advancement of Large Language Models (LLMs) and their potential integration into autonomous driving systems necessitates understanding their moral decision-making capabilities. While our previous study examined four prominent LLMs…

Computers and Society · Computer Science 2025-05-23 Muhammad Shahrul Zaim bin Ahmad , Kazuhiro Takemoto

This study examines the ethical reasoning of six prominent generative large language models: OpenAI GPT-4o, Meta LLaMA 3.1, Perplexity, Anthropic Claude 3.5 Sonnet, Google Gemini, and Mistral 7B. The research explores how these models…

Artificial Intelligence · Computer Science 2025-01-16 W. Russell Neuman , Chad Coleman , Manan Shah

Machine Ethics decisions should consider the implications of uncertainty over decisions. Decisions should be made over sequences of actions to reach preferable outcomes long term. The evaluation of outcomes, however, may invoke one or more…

Artificial Intelligence · Computer Science 2025-05-08 Simon Kolker , Louise A. Dennis , Ramon Fraga Pereira , Mengwei Xu

Ethical dilemmas are a common challenge in everyday driving, requiring human drivers to balance competing priorities such as safety, efficiency, and rule compliance. However, much of the existing research in automated vehicles (AVs) has…

Systems and Control · Electrical Eng. & Systems 2025-08-01 Lucas Elbert Suryana , Saeed Rahmani , Simeon Craig Calvert , Arkady Zgonnikov , Bart van Arem

Development of the intelligent autonomous robot technology presupposes its anticipated beneficial effect on the individuals and societies. In the case of such disruptive emergent technology, not only questions of how to build, but also why…

Robotics · Computer Science 2021-07-20 Gordana Dodig-Crnkovic , Tobias Holstein , Patrizio Pelliccione

As we grant artificial intelligence increasing power and independence in contexts like healthcare, policing, and driving, AI faces moral dilemmas but lacks the tools to solve them. Warnings from regulators, philosophers, and computer…

Artificial Intelligence · Computer Science 2022-07-22 Lavanya Singh

As large language models (LLMs) increasingly mediate ethically sensitive decisions, understanding their moral reasoning processes becomes imperative. This study presents a comprehensive empirical evaluation of 14 leading LLMs, both…

Computation and Language · Computer Science 2025-08-12 Junchen Ding , Penghao Jiang , Zihao Xu , Ziqi Ding , Yichen Zhu , Jiaojiao Jiang , Yuekang Li

Large-scale behavioral datasets enable researchers to use complex machine learning algorithms to better predict human behavior, yet this increased predictive power does not always lead to a better understanding of the behavior in question.…

Computers and Society · Computer Science 2019-05-14 Mayank Agrawal , Joshua C. Peterson , Thomas L. Griffiths

We present a general approach to automating ethical decisions, drawing on machine learning and computational social choice. In a nutshell, we propose to learn a model of societal preferences, and, when faced with a specific ethical dilemma…