English
Related papers

Related papers: MoralBench: Moral Evaluation of LLMs

200 papers

Big models have greatly advanced AI's ability to understand, generate, and manipulate information and content, enabling numerous applications. However, as these models become increasingly integrated into everyday life, their inherent…

Computers and Society · Computer Science 2023-10-27 Xiaoyuan Yi , Jing Yao , Xiting Wang , Xing Xie

Recent advances in large language models (LLMs) have enabled their use in complex agentic roles, involving decision-making with humans or other agents, making ethical alignment a key AI safety concern. While prior work has examined both…

Computation and Language · Computer Science 2025-05-27 Steffen Backmann , David Guzman Piedrahita , Emanuel Tewolde , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

With the rise and widespread use of Large Language Models (LLMs), ensuring their safety is crucial to prevent harm to humans and promote ethical behaviors. However, directly assessing value valence (i.e., support or oppose) by leveraging…

Computers and Society · Computer Science 2025-04-10 Yuxi Sun , Wei Gao , Jing Ma , Hongzhan Lin , Ziyang Luo , Wenxuan Zhang

The integration of Artificial Intelligence (AI) into construction project management (CPM) is accelerating, with Large Language Models (LLMs) emerging as accessible decision-support tools. This study aims to critically evaluate the ethical…

Artificial Intelligence · Computer Science 2025-09-08 Somtochukwu Azie , Yiping Meng

Making moral judgments is an essential step toward developing ethical AI systems. Prevalent approaches are mostly implemented in a bottom-up manner, which uses a large set of annotated data to train models based on crowd-sourced opinions…

Computation and Language · Computer Science 2024-07-02 Jingyan Zhou , Minda Hu , Junan Li , Xiaoying Zhang , Xixin Wu , Irwin King , Helen Meng

As multilingual Large Language Models (LLMs) gain traction across South Asia, their alignment with local ethical norms, particularly for Bengali, spoken by over 285 million people worldwide and among the most widely spoken languages…

Computation and Language · Computer Science 2026-04-21 Shahriyar Zaman Ridoy , Azmine Toushik Wasi , Koushik Ahamed Tonmoy , Taki Hasan Rafi , Dong-Kyu Chae

The rapid advancement of Large Language Models (LLMs) and their potential integration into autonomous driving systems necessitates understanding their moral decision-making capabilities. While our previous study examined four prominent LLMs…

Computers and Society · Computer Science 2025-05-23 Muhammad Shahrul Zaim bin Ahmad , Kazuhiro Takemoto

The question of how to make decisions that maximise the well-being of all persons is very relevant to design language models that are beneficial to humanity and free from harm. We introduce the Greatest Good Benchmark to evaluate the moral…

Computation and Language · Computer Science 2025-03-26 Giovanni Franco Gabriel Marraffini , Andrés Cotton , Noe Fabian Hsueh , Axel Fridman , Juan Wisznia , Luciano Del Corro

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust…

Computers and Society · Computer Science 2024-07-22 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Kendall N. Niles , Ken Pathak , Steven Sloan

This study addresses ethical issues surrounding Large Language Models (LLMs) within the field of artificial intelligence. It explores the common ethical challenges posed by both LLMs and other AI systems, such as privacy and fairness, as…

Computers and Society · Computer Science 2025-06-17 Junfeng Jiao , Saleh Afroogh , Yiming Xu , Connor Phillips

As AI systems increasingly navigate applications in healthcare, law, and governance, understanding how they handle ethically complex scenarios becomes critical. Previous work has mainly examined the moral judgments in large language models…

Computation and Language · Computer Science 2025-10-14 Keenan Samway , Max Kleiman-Weiner , David Guzman Piedrahita , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

Large Language Models (LLMs) have become central to advancing automation and decision-making across various sectors, raising significant ethical questions. This study proposes a comprehensive comparative analysis of the most advanced LLMs…

Artificial Intelligence · Computer Science 2024-06-07 Alejandro Tlaie

Large language models are increasingly influencing human moral decisions, yet current approaches focus primarily on evaluating rather than actively steering their moral decisions. We formulate this as an out-of-distribution moral alignment…

Artificial Intelligence · Computer Science 2025-11-18 Zhiyu An , Wan Du

As large language models (LLMs) develop increasingly sophisticated capabilities and find applications in medical settings, it becomes important to assess their medical safety due to their far-reaching implications for personal and public…

Artificial Intelligence · Computer Science 2024-10-11 Tessa Han , Aounon Kumar , Chirag Agarwal , Himabindu Lakkaraju

While Large Language Models (LLMs) have achieved remarkable success in cognitive and reasoning benchmarks, they exhibit a persistent deficit in anthropomorphic intelligence-the capacity to navigate complex social, emotional, and ethical…

Computation and Language · Computer Science 2025-12-29 Jiaxin Liu , Peiyi Tu , Wenyu Chen , Yihong Zhuang , Xinxia Ling , Anji Zhou , Chenxi Wang , Zhuo Han , Zhengkai Yang , Junbo Zhao , Zenan Huang , Yuanyuan Wang

The advancement of large language models (LLMs) has outpaced traditional evaluation methodologies. This progress presents novel challenges, such as measuring human-like psychological constructs, moving beyond static and task-specific…

Computation and Language · Computer Science 2026-03-12 Haoran Ye , Jing Jin , Yuhang Xie , Xin Zhang , Guojie Song

Artificial intelligence (AI) is advancing at a pace that raises urgent questions about how to align machine decision-making with human moral values. This working paper investigates how leading AI systems prioritize moral outcomes and what…

Artificial Intelligence · Computer Science 2025-09-15 Eoin O'Doherty , Nicole Weinrauch , Andrew Talone , Uri Klempner , Xiaoyuan Yi , Xing Xie , Yi Zeng

As large language models (LLMs) become increasingly integrated into society, their alignment with human morals is crucial. To better understand this alignment, we created a large corpus of human- and LLM-generated responses to various moral…

Human-Computer Interaction · Computer Science 2024-10-11 Basile Garcia , Crystal Qian , Stefano Palminteri

The rapid adoption of large language models (LLMs) has spurred extensive research into their encoded moral norms and decision-making processes. Much of this research relies on prompting LLMs with survey-style questions to assess how well…

Artificial Intelligence · Computer Science 2025-01-31 Pratik S. Sachdeva , Tom van Nuenen

This paper explores the integration of human-like emotions and ethical considerations into Large Language Models (LLMs). We first model eight fundamental human emotions, presented as opposing pairs, and employ collaborative LLMs to…

Computation and Language · Computer Science 2024-06-26 Edward Y. Chang