English
Related papers

Related papers: Moral Dilemmas for Moral Machines

200 papers

Much of the existing research on the social and ethical impact of Artificial Intelligence has been focused on defining ethical principles and guidelines surrounding Machine Learning (ML) and other Artificial Intelligence (AI) algorithms…

Computers and Society · Computer Science 2019-12-30 Alexandra Luccioni , Yoshua Bengio

Making moral judgments is an essential step toward developing ethical AI systems. Prevalent approaches are mostly implemented in a bottom-up manner, which uses a large set of annotated data to train models based on crowd-sourced opinions…

Computation and Language · Computer Science 2024-07-02 Jingyan Zhou , Minda Hu , Junan Li , Xiaoying Zhang , Xixin Wu , Irwin King , Helen Meng

We evaluate the moral alignment of LLMs with human preferences in multilingual trolley problems. Building on the Moral Machine experiment, which captures over 40 million human judgments across 200+ countries, we develop a cross-lingual…

Research in Responsible AI has developed a range of principles and practices to ensure that machine learning systems are used in a manner that is ethical and aligned with human values. However, a critical yet often neglected aspect of…

Computers and Society · Computer Science 2024-08-21 Neha R. Gupta , Jessica Hullman , Hari Subramonyam

Why should moral philosophers, moral psychologists, and machine ethicists care about computational complexity? Debates on whether artificial intelligence (AI) can or should be used to solve problems in ethical domains have mainly been…

Computational Complexity · Computer Science 2023-02-09 Jakob Stenseke

Recently, computer scientists have developed large language models (LLMs) by training prediction models with large-scale language corpora and human reinforcements. The LLMs have become one promising way to implement artificial intelligence…

Computers and Society · Computer Science 2023-08-22 Hyemin Han

An ambitious goal for machine learning is to create agents that behave ethically: The capacity to abide by human moral norms would greatly expand the context in which autonomous agents could be practically and safely deployed, e.g. fully…

Artificial Intelligence · Computer Science 2021-07-21 Adrien Ecoffet , Joel Lehman

Practical uses of Artificial Intelligence (AI) in the real world have demonstrated the importance of embedding moral choices into intelligent agents. They have also highlighted that defining top-down ethical constraints on AI according to…

Multiagent Systems · Computer Science 2023-08-31 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

While the demand for ethical artificial intelligence (AI) systems increases, the number of unethical uses of AI accelerates, even though there is no shortage of ethical guidelines. We argue that a possible underlying cause for this is that…

Artificial Intelligence · Computer Science 2022-01-10 Inga Strümke , Marija Slavkovik , Vince I. Madai

Moral AI has been studied in the fields of philosophy and artificial intelligence. Although most existing studies are only theoretical, recent developments in AI have made it increasingly necessary to implement AI with morality. On the…

Artificial Intelligence · Computer Science 2023-06-21 Masashi Takeshita , Rzepka Rafal , Kenji Araki

Large Language Models (LLMs) have become central to advancing automation and decision-making across various sectors, raising significant ethical questions. This study proposes a comprehensive comparative analysis of the most advanced LLMs…

Artificial Intelligence · Computer Science 2024-06-07 Alejandro Tlaie

Artificial Moral Agents (AMA's) is a field in computer science with the purpose of creating autonomous machines that can make moral decisions akin to how humans do. Researchers have proposed theoretical means of creating such machines,…

Computers and Society · Computer Science 2020-03-03 George Rautenbach , C. Maria Keet

Moral cognition is a crucial yet underexplored aspect of decision-making in AI models. Regardless of the application domain, it should be a consideration that allows for ethically aligned decision-making. This paper presents a multifaceted…

Computers and Society · Computer Science 2026-02-17 Aisha Aijaz , Raghava Mutharaju , Manohar Kumar

This case study delves into the ethical ramifications of an incident involving Tesla's Autopilot, emphasizing Tesla Motors' moral responsibility. Using a seven-step ethical decision-making process, it examines user behavior, system…

Computers and Society · Computer Science 2024-09-27 Aravinda Jatavallabha

Ensuring that autonomous systems work ethically is both complex and difficult. However, the idea of having an additional `governor' that assesses options the system has, and prunes them to select the most ethical choices is well understood.…

Artificial Intelligence · Computer Science 2015-04-15 Louise A. Dennis , Michael Fisher , Alan F. T. Winfield

Ethicists, policy-makers, and the general public have questioned whether artificial entities such as robots warrant rights or other forms of moral consideration. There is little synthesis of the research on this topic so far. We identify…

Computers and Society · Computer Science 2021-09-29 Jamie Harris , Jacy Reese Anthis

We build a custom transformer model to study how neural networks make moral decisions on trolley-style dilemmas. The model processes structured scenarios using embeddings that encode who is affected, how many people, and which outcome they…

Artificial Intelligence · Computer Science 2026-02-05 Mayank Goel , Aritra Das , Paras Chopra

Big models have greatly advanced AI's ability to understand, generate, and manipulate information and content, enabling numerous applications. However, as these models become increasingly integrated into everyday life, their inherent…

Computers and Society · Computer Science 2023-10-27 Xiaoyuan Yi , Jing Yao , Xiting Wang , Xing Xie

As AI systems increasingly navigate applications in healthcare, law, and governance, understanding how they handle ethically complex scenarios becomes critical. Previous work has mainly examined the moral judgments in large language models…

Computation and Language · Computer Science 2025-10-14 Keenan Samway , Max Kleiman-Weiner , David Guzman Piedrahita , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

In recent years, the availability of massive data sets and improved computing power have driven the advent of cutting-edge machine learning algorithms. However, this trend has triggered growing concerns associated with its ethical issues.…

Computers and Society · Computer Science 2020-04-03 Tai Vu