English
Related papers

Related papers: Procedural Dilemma Generation for Evaluating Moral…

200 papers

As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely…

Artificial Intelligence · Computer Science 2026-02-09 Yichen Wu , Qianqian Gao , Xudong Pan , Geng Hong , Min Yang

Recent advancements in language model technology have significantly enhanced the ability to edit factual information. Yet, the modification of moral judgments, a crucial aspect of aligning models with human values, has garnered less…

Artificial Intelligence · Computer Science 2026-03-31 Michael Ripa , Jim Davies

Presupposition projection in conditionals is central to theories of meaning and pragmatics, yet it remains largely unevaluated in large language models. We address this gap through a parallel behavioral study comparing human judgments and…

Computation and Language · Computer Science 2026-05-19 Tara Azin , Yongan Yu , Raj Singh , Olessia Jouravlev

Large language models (LLMs) demonstrate outstanding capabilities, but challenges remain regarding their ability to solve complex reasoning tasks, as well as their transparency, robustness, truthfulness, and ethical alignment. In this…

Computers and Society · Computer Science 2023-12-19 Konstantin Hebenstreit , Robert Praas , Matthias Samwald

With the rise of individual and collaborative networks of autonomous agents, AI is deployed in more key reasoning and decision-making roles. For this reason, ethics-based audits play a pivotal role in the rapidly growing fields of AI safety…

Computers and Society · Computer Science 2024-02-06 Jon Chun , Katherine Elkins

A human's moral decision depends heavily on the context. Yet research on LLM morality has largely studied fixed scenarios. We address this gap by introducing Contextual MoralChoice, a dataset of moral dilemmas with systematic contextual…

Artificial Intelligence · Computer Science 2026-03-25 Adrian Sauter , Mona Schirmer

Autonomous systems are being developed and deployed in situations that may require some degree of ethical decision-making ability. As a result, research in machine ethics has proliferated in recent years. This work has included using moral…

Computers and Society · Computer Science 2022-03-14 Travis LaCroix

Large language models (LLMs) increasingly participate in morally sensitive decision-making, yet how they organize ethical frameworks across reasoning steps remains underexplored. We introduce \textit{moral reasoning trajectories}, sequences…

Computation and Language · Computer Science 2026-03-18 Fan Huang , Haewoon Kwak , Jisun An

With the advancement in generative language models, the selection of prompts has gained significant attention in recent years. A prompt is an instruction or description provided by the user, serving as a guide for the generative language…

Machine Learning · Statistics 2024-05-21 Haoting Zhang , Jinghai He , Rhonda Righter , Zeyu Zheng

As LLMs excel on standard reading comprehension benchmarks, attention is shifting toward evaluating their capacity for complex abstract reasoning and inference. Literature-based benchmarks, with their rich narrative and moral depth, provide…

Computation and Language · Computer Science 2025-09-17 Matteo Marcuzzo , Alessandro Zangari , Andrea Albarelli , Jose Camacho-Collados , Mohammad Taher Pilehvar

Large-scale behavioral datasets enable researchers to use complex machine learning algorithms to better predict human behavior, yet this increased predictive power does not always lead to a better understanding of the behavior in question.…

Computers and Society · Computer Science 2019-05-14 Mayank Agrawal , Joshua C. Peterson , Thomas L. Griffiths

The conceptual framework proposed in this paper centers on the development of a deliberative moral reasoning system - one designed to process complex moral situations by generating, filtering, and weighing normative arguments drawn from…

Computers and Society · Computer Science 2025-08-13 David-Doron Yaacov

Pragmatics and non-literal language understanding are essential to human communication, and present a long-standing challenge for artificial language models. We perform a fine-grained comparison of language models and humans on seven…

Computation and Language · Computer Science 2023-05-25 Jennifer Hu , Sammy Floyd , Olessia Jouravlev , Evelina Fedorenko , Edward Gibson

Amidst the growing interest in developing task-autonomous AI for automated mental health care, this paper addresses the ethical and practical challenges associated with the issue and proposes a structured framework that delineates levels of…

Computers and Society · Computer Science 2024-08-16 Declan Grabb , Max Lamparth , Nina Vasan

Recent advances in Large Language Models (LLMs) have enabled human-like responses across various tasks, raising questions about their ethical decision-making capabilities and potential biases. This study systematically evaluates how nine…

Computers and Society · Computer Science 2025-11-03 Wentao Xu , Yile Yan , Yuqi Zhu

Recent advances in large language models (LLMs) have enabled their use in complex agentic roles, involving decision-making with humans or other agents, making ethical alignment a key AI safety concern. While prior work has examined both…

Computation and Language · Computer Science 2025-05-27 Steffen Backmann , David Guzman Piedrahita , Emanuel Tewolde , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

Moral competence is the ability to act in accordance with moral principles. As large language models (LLMs) are increasingly deployed in situations demanding moral competence, there is increasing interest in evaluating this ability…

Artificial Intelligence · Computer Science 2026-03-09 Daniel Kilov , Caroline Hendy , Secil Yanik Guyot , Aaron J. Snoswell , Seth Lazar

Background: What counts as violence is neither self-evident nor universally agreed upon. While physical aggression is prototypical, contemporary societies increasingly debate whether exclusion, humiliation, online harassment or symbolic…

Physics and Society · Physics 2026-02-20 Mariachiara Stellato , Francesco Lancia , Chiara Galeazzi , Nico Curti

In this study, we measure the moral reasoning ability of LLMs using the Defining Issues Test - a psychometric instrument developed for measuring the moral development stage of a person according to the Kohlberg's Cognitive Moral Development…

Computation and Language · Computer Science 2023-10-10 Kumar Tanmay , Aditi Khandelwal , Utkarsh Agarwal , Monojit Choudhury

Large language models generate complex, open-ended outputs: instead of outputting a class label they write summaries, generate dialogue, or produce working code. In order to asses the reliability of these open-ended generation systems, we…

Computation and Language · Computer Science 2022-11-28 Erik Jones , Jacob Steinhardt