English
Related papers

Related papers: Procedural Dilemma Generation for Evaluating Moral…

200 papers

Conversational agents have come increasingly closer to human competence in open-domain dialogue settings; however, such models can reflect insensitive, hurtful, or entirely incoherent viewpoints that erode a user's trust in the moral…

Computation and Language · Computer Science 2022-04-08 Caleb Ziems , Jane A. Yu , Yi-Chia Wang , Alon Halevy , Diyi Yang

This study examines the ethical reasoning of six prominent generative large language models: OpenAI GPT-4o, Meta LLaMA 3.1, Perplexity, Anthropic Claude 3.5 Sonnet, Google Gemini, and Mistral 7B. The research explores how these models…

Artificial Intelligence · Computer Science 2025-01-16 W. Russell Neuman , Chad Coleman , Manan Shah

There is increasing interest in building computational models of moral reasoning by people to enable effective interaction by Artificial Intelligence (AI) agents. We examine interactions on social media to understand human moral judgments…

Social and Information Networks · Computer Science 2024-04-23 Ruijie Xi , Munindar P. Singh

The recent explosion in the capabilities of large language models has led to a wave of interest in how best to prompt a model to perform a given task. While it may be tempting to simply choose a prompt based on average performance on a…

Machine Learning · Computer Science 2024-03-29 Thomas P. Zollo , Todd Morrill , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

This study establishes a novel framework for systematically evaluating the moral reasoning capabilities of large language models (LLMs) as they increasingly integrate into critical societal domains. Current assessment methodologies lack the…

Computers and Society · Computer Science 2025-05-05 Junfeng Jiao , Saleh Afroogh , Abhejay Murali , Kevin Chen , David Atkinson , Amit Dhurandhar

The question of how to make decisions that maximise the well-being of all persons is very relevant to design language models that are beneficial to humanity and free from harm. We introduce the Greatest Good Benchmark to evaluate the moral…

Computation and Language · Computer Science 2025-03-26 Giovanni Franco Gabriel Marraffini , Andrés Cotton , Noe Fabian Hsueh , Axel Fridman , Juan Wisznia , Luciano Del Corro

Prior research has demonstrated that language models can, to a limited extent, represent moral norms in a variety of cultural contexts. This research aims to replicate these findings and further explore their validity, concentrating on…

Artificial Intelligence · Computer Science 2024-12-03 Evi Papadopoulou , Hadi Mohammadi , Ayoub Bagheri

Recent advances in large language models (LLMs) have led to increasingly sophisticated safety protocols and features designed to prevent harmful, unethical, or unauthorized outputs. However, these guardrails remain susceptible to novel and…

Computation and Language · Computer Science 2025-07-08 Annika M Schoene , Cansu Canca

People increasingly rely on Large Language Models (LLMs) for moral advice, which may influence humans' decisions. Yet, little is known about how closely LLMs align with human moral judgments. To address this, we introduce the Moral Dilemma…

Computation and Language · Computer Science 2025-07-24 Giuseppe Russo , Debora Nozza , Paul Röttger , Dirk Hovy

Moral judgment is integral to large language models' (LLMs) social reasoning. As multi-agent systems gain prominence, it becomes crucial to understand how LLMs function when collaborating compared to operating as individual agents. In human…

Computation and Language · Computer Science 2025-10-30 Anita Keshmirian , Razan Baltaji , Babak Hemmatian , Hadi Asghari , Lav R. Varshney

We explore how large language models (LLMs) can be influenced by prompting them to alter their initial decisions and align them with established ethical frameworks. Our study is based on two experiments designed to assess the susceptibility…

Computation and Language · Computer Science 2024-11-19 Allison Huang , Yulu Niki Pi , Carlos Mougan

This paper explores the moral judgment and moral reasoning abilities exhibited by Large Language Models (LLMs) across languages through the Defining Issues Test. It is a well known fact that moral judgment depends on the language in which…

Computation and Language · Computer Science 2024-02-06 Aditi Khandelwal , Utkarsh Agarwal , Kumar Tanmay , Monojit Choudhury

As large language models (LLMs) are increasingly deployed in high-stakes settings, their ability to refuse ethically sensitive prompts-such as those involving hate speech or illegal activities-has become central to content moderation and…

Human-Computer Interaction · Computer Science 2025-05-22 Stefan Pasch

As AI systems become pervasive, grounding their behavior in human values is critical. Prior work suggests that language models (LMs) exhibit limited inherent moral reasoning, leading to calls for explicit moral teaching. However,…

Computation and Language · Computer Science 2026-01-27 Meysam Alizadeh , Fabrizio Gilardi , Zeynab Samei

As large language models (LLMs) become more deeply integrated into various sectors, understanding how they make moral judgments has become crucial, particularly in the realm of autonomous driving. This study utilized the Moral Machine…

Computation and Language · Computer Science 2024-02-08 Kazuhiro Takemoto

Moral actions are judged not only by their outcomes but by the context in which they occur. We present COMETH (Contextual Organization of Moral Evaluation from Textual Human inputs), a framework that integrates a probabilistic context…

Computation and Language · Computer Science 2025-12-29 Geoffroy Morlat , Marceau Nahon , Augustin Chartouny , Raja Chatila , Ismael T. Freire , Mehdi Khamassi

One open question in the study of Large Language Models (LLMs) is whether they can emulate human ethical reasoning and act as believable proxies for human judgment. To investigate this, we introduce a benchmark dataset comprising 196…

Computation and Language · Computer Science 2025-05-14 Jiashen , Du , Jesse Yao , Allen Liu , Zhekai Zhang

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

Generative AI is increasingly positioned as a peer in collaborative learning, yet its effects on ethical deliberation remain unclear. We report a between-subjects experiment with university students (N=217) who discussed an…

Human-Computer Interaction · Computer Science 2026-03-24 Yueqiao Jin , Roberto Martinez-Maldonado , Wanruo Shi , Songjie Huang , Mingmin Zheng , Xinbin Han , Dragan Gasevic , Lixiang Yan

Ensuring the safety of autonomous vehicles requires virtual scenario-based testing, which depends on the robust evaluation and generation of safety-critical scenarios. So far, researchers have used scenario-based testing frameworks that…

Artificial Intelligence · Computer Science 2025-07-21 Yuan Gao , Mattia Piccinini , Korbinian Moller , Amr Alanwar , Johannes Betz