English
Related papers

Related papers: Methods, Models, and the Evolution of Moral Psycho…

200 papers

In social settings, much of human behavior is governed by unspoken rules of conduct. For artificial systems to be fully integrated into social environments, adherence to such norms is a central prerequisite. We investigate whether…

Computation and Language · Computer Science 2021-01-01 Denis Emelin , Ronan Le Bras , Jena D. Hwang , Maxwell Forbes , Yejin Choi

We review the literature on models that try to explain human behavior in social interactions described by normal-form games with monetary payoffs. We start by covering social and moral preferences. We then focus on the growing body of…

Computer Science and Game Theory · Computer Science 2024-03-18 Valerio Capraro , Joseph Y. Halpern , Matjaz Perc

We introduce a new computational model of moral decision making, drawing on a recent theory of commonsense moral learning via social dynamics. Our model describes moral dilemmas as a utility function that computes trade-offs in values over…

Artificial Intelligence · Computer Science 2018-01-16 Richard Kim , Max Kleiman-Weiner , Andres Abeliuk , Edmond Awad , Sohan Dsouza , Josh Tenenbaum , Iyad Rahwan

Much of the existing research on the social and ethical impact of Artificial Intelligence has been focused on defining ethical principles and guidelines surrounding Machine Learning (ML) and other Artificial Intelligence (AI) algorithms…

Computers and Society · Computer Science 2019-12-30 Alexandra Luccioni , Yoshua Bengio

In biology, the evolution of increasingly cooperative groups has shaped the history of life. Genes collaborate in the control of cells; cells efficiently divide tasks to produce cohesive multicellular individuals; individual members of…

Populations and Evolution · Quantitative Biology 2011-12-15 Steven A. Frank

Indirect reciprocity is a mechanism that explains large-scale cooperation in human societies. In indirect reciprocity, an individual chooses whether or not to cooperate with another based on reputation information, and others evaluate the…

Populations and Evolution · Quantitative Biology 2023-10-20 Yuma Fujimoto , Hisashi Ohtsuki

In this paper, we make a review on the concepts of rationality across several different fields, namely in economics, psychology and evolutionary biology and behavioural ecology. We review how processes like natural selection can help us…

Artificial Intelligence · Computer Science 2018-12-03 Catarina Moreira

Moral foundations theory helps understand differences in morality across cultures. In this paper, we propose a model to predict moral foundations (MF) from social media trending topics. We also investigate whether differences in MF…

Social and Information Networks · Computer Science 2021-03-02 Jean Marie Tshimula , Belkacem Chikhaoui , Shengrui Wang

With the rise and widespread use of Large Language Models (LLMs), ensuring their safety is crucial to prevent harm to humans and promote ethical behaviors. However, directly assessing value valence (i.e., support or oppose) by leveraging…

Computers and Society · Computer Science 2025-04-10 Yuxi Sun , Wei Gao , Jing Ma , Hongzhan Lin , Ziyang Luo , Wenxuan Zhang

Moral foundations theory (MFT) is a psychological assessment tool that decomposes human moral reasoning into five factors, including care/harm, liberty/oppression, and sanctity/degradation (Graham et al., 2009). People vary in the weight…

Artificial Intelligence · Computer Science 2023-10-25 Marwa Abdulhai , Gregory Serapio-Garcia , Clément Crepy , Daria Valter , John Canny , Natasha Jaques

Do We Need Role Models? How do Role Models Shape Collective Morality? To explore the questions, we build a multi-agent simulation powered by a Large Language Model, where agents with diverse intrinsic drives, ranging from cooperative to…

Multiagent Systems · Computer Science 2026-03-17 Junjie Liao , Huacong Tang , Zhou Ziheng , Yizhou Wang , Fangwei Zhong

This paper describes current progress on developing an ethical architecture for robots that are designed to follow human ethical decision-making processes. We surveyed both regular adults (folks) and ethics experts (experts) on what they…

Robotics · Computer Science 2022-06-23 Shengkang Chen , Vidullan Surendran , Alan R. Wagner , Jason Borenstein , Ronald C. Arkin

The concepts of blameworthiness and wrongness are of fundamental importance in human moral life. But to what extent are humans disposed to blame artificially intelligent agents, and to what extent will they judge their actions to be morally…

Computers and Society · Computer Science 2021-02-09 Michael T. Stuart , Markus Kneer

As AI systems become increasingly powerful and pervasive, there are growing concerns about machines' morality or a lack thereof. Yet, teaching morality to machines is a formidable task, as morality remains among the most intensely debated…

A human's moral decision depends heavily on the context. Yet research on LLM morality has largely studied fixed scenarios. We address this gap by introducing Contextual MoralChoice, a dataset of moral dilemmas with systematic contextual…

Artificial Intelligence · Computer Science 2026-03-25 Adrian Sauter , Mona Schirmer

Machine ethics has received increasing attention over the past few years because of the need to ensure safe and reliable artificial intelligence (AI). The two dominantly used theories in machine ethics are deontological and utilitarian…

Artificial Intelligence · Computer Science 2023-01-10 Ajay Vishwanath , Einar Duenger Bøhn , Ole-Christoffer Granmo , Charl Maree , Christian Omlin

In recent years, human behavior simulation has drawn increasing attention from both academia and industry. The reasons fall into two aspects. First, simulation serves as a critical tool for understanding human behaviors, which has become…

Human-Computer Interaction · Computer Science 2024-12-12 Zhang Guozhen , Yu Zihan , Li Nian , Yu Fudan , Long Qingyue , Jin Depeng , Li Yong

We paraphrase Descartes' famous dictum in the area of AI ethics where the "I doubt and therefore I am" is suggested as a necessary aspect of morality. Therefore AI, which cannot doubt itself, cannot possess moral agency. Of course, this is…

Artificial Intelligence · Computer Science 2025-03-13 Viktor Dorfler , Giles Cuthbert

Large Language Models (LLMs) have achieved unparalleled success across diverse language modeling tasks in recent years. However, this progress has also intensified ethical concerns, impacting the deployment of LLMs in everyday contexts.…

The ongoing debate on the ethics of self-driving cars typically focuses on two approaches to answering ethical questions: moral philosophy and social science. I argue that these two approaches are both lacking. We should neither deduce…

Computers and Society · Computer Science 2020-01-13 Johannes Himmelreich