English
Related papers

Related papers: Moral Dilemmas for Moral Machines

200 papers

Due to their unique persuasive power, language-capable robots must be able to both act in line with human moral norms and clearly and appropriately communicate those norms. These requirements are complicated by the possibility that humans…

Robotics · Computer Science 2021-04-15 Nichole D. Starr , Bertram Malle , Tom Williams

The advancement of powerful yet opaque large language models (LLMs) necessitates a fundamental revision of the philosophical criteria used to evaluate artificial moral agents (AMAs). Pre-LLM frameworks often relied on the assumption of…

Artificial Intelligence · Computer Science 2025-07-29 Matthew E. Brophy

Large language models are increasingly applied in real-world scenarios, including research and education. These models, however, come with well-known ethical issues, which may manifest in unexpected ways in human-computer interaction…

Human-Computer Interaction · Computer Science 2024-04-01 Shivani Kapania , Ruiyi Wang , Toby Jia-Jun Li , Tianshi Li , Hong Shen

The neutrality thesis holds that technology cannot be laden with values. This long-standing view has faced critiques, but much of the argumentation against neutrality has focused on traditional, non-smart technologies like bridges and…

Artificial Intelligence · Computer Science 2024-08-23 Torben Swoboda , Lode Lauwaert

Robots are becoming ever more autonomous. This expanding ability to take unsupervised decisions renders it imperative that mechanisms are in place to guarantee the safety of behaviours executed by the robot. Moreover, smart autonomous…

Robotics · Computer Science 2016-09-13 Dieter Vanderelst , Alan Winfield

Artificial Intelligence (AI) systems exert a growing influence on our society. As they become more ubiquitous, their potential negative impacts also become evident through various real-world incidents. Following such early incidents,…

Computers and Society · Computer Science 2019-11-26 Ville Vakkuri , Kai-Kristian Kemell , Pekka Abrahamsson

Being a complex subject of major importance in AI Safety research, value alignment has been studied from various perspectives in the last years. However, no final consensus on the design of ethical utility functions facilitating AI value…

Artificial Intelligence · Computer Science 2019-07-02 Nadisha-Marie Aliman , Leon Kester

This paper presents a theoretical analysis and practical approach to the moral responsibilities when developing AI systems for non-military applications that may nonetheless be used for conflict applications. We argue that AI represents a…

Computers and Society · Computer Science 2024-02-06 Daniel Trusilo , David Danks

An emerging theme in artificial intelligence research is the creation of models to simulate the decisions and behavior of specific people, in domains including game-playing, text generation, and artistic expression. These models go beyond…

Artificial Intelligence · Computer Science 2022-07-20 Reid McIlroy-Young , Jon Kleinberg , Siddhartha Sen , Solon Barocas , Ashton Anderson

Artificial intelligence (AI) assisting with antimicrobial prescribing raises significant moral questions. Utilising ethical frameworks alongside AI-driven systems, while considering infection specific complexities, can support moral…

Computers and Society · Computer Science 2022-12-06 William J Bolton , Cosmin Badea , Pantelis Georgiou , Alison Holmes , Timothy M Rawson

Reinforcement Learning is a machine learning methodology that has demonstrated strong performance across a variety of tasks. In particular, it plays a central role in the development of artificial autonomous agents. As these agents become…

Artificial Intelligence · Computer Science 2025-07-23 Lisa Dargasz

Previous research has shown that the fairness and the legitimacy of a moral decision-maker are important for people's acceptance of and compliance with the decision-maker. As technology rapidly advances, there have been increasing hopes and…

Robotics · Computer Science 2022-10-11 Boyoung Kim , Elizabeth Phillips

Large Language Models (LLMs) are increasingly integrated into software engineering (SE) tools for tasks that extend beyond code synthesis, including judgment under uncertainty and reasoning in ethically significant contexts. We present a…

Software Engineering · Computer Science 2025-10-02 Patrizio Migliarini , Mashal Afzal Memon , Marco Autili , Paola Inverardi

Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks…

Computers and Society · Computer Science 2019-10-30 Hazel Si Min Lim , Araz Taeihagh

The integration of artificial intelligence (AI) and optimization hold substantial promise for improving the efficiency, reliability, and resilience of engineered systems. Due to the networked nature of many engineered systems, ethically…

Artificial Intelligence · Computer Science 2024-09-19 Rosemarie Santa Gonzalez , Ryan Piansky , Sue M Bae , Justin Biddle , Daniel Molzahn

In an effort to guarantee that machine learning model outputs conform with human moral values, recent work has begun exploring the possibility of explicitly training models to learn the difference between right and wrong. This is typically…

Computers and Society · Computer Science 2022-05-26 Kathleen C. Fraser , Svetlana Kiritchenko , Esma Balkir

We show how to assess a language model's knowledge of basic concepts of morality. We introduce the ETHICS dataset, a new benchmark that spans concepts in justice, well-being, duties, virtues, and commonsense morality. Models predict…

Computers and Society · Computer Science 2023-02-20 Dan Hendrycks , Collin Burns , Steven Basart , Andrew Critch , Jerry Li , Dawn Song , Jacob Steinhardt

Approaches to fair and ethical AI have recently fell under the scrutiny of the emerging, chiefly qualitative, field of critical data studies, placing emphasis on the lack of sensitivity to context and complex social phenomena of such…

Computers and Society · Computer Science 2023-09-01 Andrés Domínguez Hernández , Vassilis Galanos

Generative AI is increasingly positioned as a peer in collaborative learning, yet its effects on ethical deliberation remain unclear. We report a between-subjects experiment with university students (N=217) who discussed an…

Human-Computer Interaction · Computer Science 2026-03-24 Yueqiao Jin , Roberto Martinez-Maldonado , Wanruo Shi , Songjie Huang , Mingmin Zheng , Xinbin Han , Dragan Gasevic , Lixiang Yan

One of the most remarkable things about the human moral mind is its flexibility. We can make moral judgments about cases we have never seen before. We can decide that pre-established rules should be broken. We can invent novel rules on the…