English
Related papers

Related papers: Does Moral Code Have a Moral Code? Probing Delphi'…

200 papers

As large language models (LLMs) become increasingly integrated into society, their alignment with human morals is crucial. To better understand this alignment, we created a large corpus of human- and LLM-generated responses to various moral…

Human-Computer Interaction · Computer Science 2024-10-11 Basile Garcia , Crystal Qian , Stefano Palminteri

Is it possible to evaluate the moral cognition of complex artificial agents? In this work, we take a look at one aspect of morality: `doing the right thing for the right reasons.' We propose a behavior-based analysis of artificial moral…

Artificial Intelligence · Computer Science 2023-05-30 Yiran Mao , Madeline G. Reinecke , Markus Kunesch , Edgar A. Duéñez-Guzmán , Ramona Comanescu , Julia Haas , Joel Z. Leibo

As AI systems increasingly navigate applications in healthcare, law, and governance, understanding how they handle ethically complex scenarios becomes critical. Previous work has mainly examined the moral judgments in large language models…

Computation and Language · Computer Science 2025-10-14 Keenan Samway , Max Kleiman-Weiner , David Guzman Piedrahita , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

The moral foundations theory supports that people, across cultures, tend to consider a small number of dimensions when classifying issues on a moral basis. The data also show that the statistics of weights attributed to each moral dimension…

Physics and Society · Physics 2014-03-25 Renato Vicente , Alex Susemihl , João Pedro Jericó , Nestor Caticha

Increasing interest in ensuring the safety of next-generation Artificial Intelligence (AI) systems calls for novel approaches to embedding morality into autonomous agents. This goal differs qualitatively from traditional task-specific AI…

Artificial Intelligence · Computer Science 2025-01-17 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

There is an analogy between machine learning systems and economic entities in that they are both adaptive, and their behaviour is specified in a more-or-less explicit way. It appears that the area of AI that is most analogous to the…

Computers and Society · Computer Science 2020-01-03 Travis LaCroix , Yoshua Bengio

Moral norms vary across cultures. A recent line of work suggests that English large language models contain human-like moral biases, but these studies typically do not examine moral variation in a diverse cultural setting. We investigate…

Computation and Language · Computer Science 2023-06-06 Aida Ramezani , Yang Xu

Large language models are increasingly influencing human moral decisions, yet current approaches focus primarily on evaluating rather than actively steering their moral decisions. We formulate this as an out-of-distribution moral alignment…

Artificial Intelligence · Computer Science 2025-11-18 Zhiyu An , Wan Du

While various traditions under the 'virtue ethics' umbrella have been studied extensively and advocated by ethicists, it has not been clear that there exists a version of virtue ethics rigorous enough to be a target for machine ethics…

Artificial Intelligence · Computer Science 2019-01-01 Naveen Sundar Govindarajulu , Selmer Bringsjord , Rikhiya Ghosh

As Artificial Intelligence (AI) becomes pervasive in most fields, from healthcare to autonomous driving, it is essential that we find successful ways of building morality into our machines, especially for decision-making. However, the…

Artificial Intelligence · Computer Science 2023-10-13 Reneira Seeamber , Cosmin Badea

Advances in artificial intelligence (AI) raise important questions about whether people view moral evaluations by AI systems similarly to human-generated moral evaluations. We conducted a modified Moral Turing Test (m-MTT), inspired by…

As AI systems become an increasing part of people's everyday lives, it becomes ever more important that they understand people's ethical norms. Motivated by descriptive ethics, a field of study that focuses on people's descriptive judgments…

Computation and Language · Computer Science 2021-03-25 Nicholas Lourie , Ronan Le Bras , Yejin Choi

Are AI systems truly representing human values, or merely averaging across them? Our study suggests a concerning reality: Large Language Models (LLMs) fail to represent diverse cultural moral frameworks despite their linguistic…

Computation and Language · Computer Science 2025-08-01 Simon Münker

The ethics of Machine Learning has become an unavoidable topic in the AI Community. The deployment of machine learning systems in multiple social contexts has resulted in a closer ethical scrutiny of the design, development, and application…

Computers and Society · Computer Science 2022-01-19 Miguel Sicart , Irina Shklovski , Mirabelle Jones

In this meta-ethnography, we explore three different angles of ethical artificial intelligence (AI) design implementation including the philosophical ethical viewpoint, the technical perspective, and framing through a political lens. Our…

Artificial Intelligence · Computer Science 2022-09-12 Jennafer S. Roberts , Laura N. Montoya

Although artificial intelligence (AI) is solving real-world challenges and transforming industries, there are serious concerns about its ability to behave and make decisions in a responsible way. Many AI ethics principles and guidelines for…

Artificial Intelligence · Computer Science 2022-07-22 Qinghua Lu , Liming Zhu , Xiwei Xu , Jon Whittle , David Douglas , Conrad Sanderson

Autonomous systems are being developed and deployed in situations that may require some degree of ethical decision-making ability. As a result, research in machine ethics has proliferated in recent years. This work has included using moral…

Computers and Society · Computer Science 2022-03-14 Travis LaCroix

Inferring reward functions from demonstrations and pairwise preferences are auspicious approaches for aligning Reinforcement Learning (RL) agents with human intentions. However, state-of-the art methods typically focus on learning a single…

Machine Learning · Computer Science 2022-01-04 Markus Peschl , Arkady Zgonnikov , Frans A. Oliehoek , Luciano C. Siebert

Due to their unique persuasive power, language-capable robots must be able to both act in line with human moral norms and clearly and appropriately communicate those norms. These requirements are complicated by the possibility that humans…

Robotics · Computer Science 2021-04-15 Nichole D. Starr , Bertram Malle , Tom Williams

Moral cognition is a crucial yet underexplored aspect of decision-making in AI models. Regardless of the application domain, it should be a consideration that allows for ethically aligned decision-making. This paper presents a multifaceted…

Computers and Society · Computer Science 2026-02-17 Aisha Aijaz , Raghava Mutharaju , Manohar Kumar