English
Related papers

Related papers: Beyond Ethical Alignment: Evaluating LLMs as Artif…

200 papers

Much of the existing research on the social and ethical impact of Artificial Intelligence has been focused on defining ethical principles and guidelines surrounding Machine Learning (ML) and other Artificial Intelligence (AI) algorithms…

Computers and Society · Computer Science 2019-12-30 Alexandra Luccioni , Yoshua Bengio

We evaluate the moral alignment of LLMs with human preferences in multilingual trolley problems. Building on the Moral Machine experiment, which captures over 40 million human judgments across 200+ countries, we develop a cross-lingual…

Large language model (LLM)-based AI agents are increasingly capable of complex clinical reasoning and may soon participate in medical decision-making with limited or no real-time human oversight. This shift raises fundamental questions…

Computers and Society · Computer Science 2026-03-17 Tom Bisson , Henriette Voelker , Sanddhya Jayabalan , A John Iafrate , Jakob N Kather , Jochen K Lennerz

The deployment of large language models (LLMs) in mental health and other sensitive domains raises urgent questions about ethical reasoning, fairness, and responsible alignment. Yet, existing benchmarks for moral and clinical…

Computation and Language · Computer Science 2025-09-16 Sai Kartheek Reddy Kasu

The question of whether artificial entities deserve moral consideration has become one of the defining ethical challenges of AI research. Existing frameworks for moral patiency rely on verified ontological properties, such as sentience,…

Computers and Society · Computer Science 2026-03-03 Faezeh B. Pasandi , Hannah B. Pasandi

Large language models (LLMs) have taken centre stage in debates on Artificial Intelligence. Yet there remains a gap in how to assess LLMs' conformity to important human values. In this paper, we investigate whether state-of-the-art LLMs,…

Artificial Intelligence · Computer Science 2024-10-23 José Luiz Nunes , Guilherme F. C. F. Almeida , Marcelo de Araujo , Simone D. J. Barbosa

Increasing interest in ensuring the safety of next-generation Artificial Intelligence (AI) systems calls for novel approaches to embedding morality into autonomous agents. This goal differs qualitatively from traditional task-specific AI…

Artificial Intelligence · Computer Science 2025-01-17 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

The potential of large language models (LLMs) to reason like humans has been a highly contested topic in Machine Learning communities. However, the reasoning abilities of humans are multifaceted and can be seen in various forms, including…

Computation and Language · Computer Science 2023-03-28 Shrivats Agrawal

Ensuring that Large Language Models (LLMs) return just responses which adhere to societal values is crucial for their broader application. Prior research has shown that LLMs often fail to perform satisfactorily on tasks requiring moral…

Computation and Language · Computer Science 2025-10-09 Guangliang Liu , Zimo Qi , Xitong Zhang , Lei Jiang , Kristen Marie Johnson

This paper explores the integration of human-like emotions and ethical considerations into Large Language Models (LLMs). We first model eight fundamental human emotions, presented as opposing pairs, and employ collaborative LLMs to…

Computation and Language · Computer Science 2024-06-26 Edward Y. Chang

As large language models (LLMs) are increasingly deployed in high-stakes settings, their ability to refuse ethically sensitive prompts-such as those involving hate speech or illegal activities-has become central to content moderation and…

Human-Computer Interaction · Computer Science 2025-05-22 Stefan Pasch

Large Language Models (LLMs) are increasingly deployed in multilingual and multicultural environments where moral reasoning is essential for generating ethically appropriate responses. Yet, the dominant pretraining of LLMs on…

Computation and Language · Computer Science 2025-09-29 Sualeha Farid , Jayden Lin , Zean Chen , Shivani Kumar , David Jurgens

One open question in the study of Large Language Models (LLMs) is whether they can emulate human ethical reasoning and act as believable proxies for human judgment. To investigate this, we introduce a benchmark dataset comprising 196…

Computation and Language · Computer Science 2025-05-14 Jiashen , Du , Jesse Yao , Allen Liu , Zhekai Zhang

Moral judgment is integral to large language models' (LLMs) social reasoning. As multi-agent systems gain prominence, it becomes crucial to understand how LLMs function when collaborating compared to operating as individual agents. In human…

Computation and Language · Computer Science 2025-10-30 Anita Keshmirian , Razan Baltaji , Babak Hemmatian , Hadi Asghari , Lav R. Varshney

Enhancing the moral alignment of Large Language Models (LLMs) is a critical challenge in AI safety. Current alignment techniques often act as superficial guardrails, leaving the intrinsic moral representations of LLMs largely untouched. In…

Computation and Language · Computer Science 2026-01-16 Luoming Hu , Jingjie Zeng , Liang Yang , Hongfei Lin

Large language models (LLMs) represent a major advance in artificial intelligence (AI) research. However, the widespread use of LLMs is also coupled with significant ethical and social challenges. Previous research has pointed towards…

Computation and Language · Computer Science 2023-06-28 Jakob Mökander , Jonas Schuett , Hannah Rose Kirk , Luciano Floridi

Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely…

Computation and Language · Computer Science 2025-05-26 Ya Wu , Qiang Sheng , Danding Wang , Guang Yang , Yifan Sun , Zhengjia Wang , Yuyan Bu , Juan Cao

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

Artificial Intelligence · Computer Science 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

As large language models (LLMs) increasingly mediate ethically sensitive decisions, understanding their moral reasoning processes becomes imperative. This study presents a comprehensive empirical evaluation of 14 leading LLMs, both…

Computation and Language · Computer Science 2025-08-12 Junchen Ding , Penghao Jiang , Zihao Xu , Ziqi Ding , Yichen Zhu , Jiaojiao Jiang , Yuekang Li