English
Related papers

Related papers: LLM Ethics Benchmark: A Three-Dimensional Assessme…

200 papers

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions.…

Computers and Society · Computer Science 2021-05-04 Jakob Mokander , Luciano Floridi

The increasing integration of large language models (LLMs) into mental health applications necessitates robust frameworks for evaluating professional safety alignment. Current evaluative approaches primarily rely on refusal-based safety…

Computation and Language · Computer Science 2026-01-08 Yaling Shen , Stephanie Fong , Yiwen Jiang , Zimu Wang , Feilong Tang , Qingyang Xu , Xiangyu Zhao , Zhongxing Xu , Jiahe Liu , Jinpeng Hu , Dominic Dwyer , Zongyuan Ge

The pervasive use of AI applications is increasingly influencing our everyday decisions. However, the ethical challenges associated with AI transcend conventional ethics and single-discipline approaches. In this paper, we propose…

Human-Computer Interaction · Computer Science 2024-04-23 Lizhi Ma , Tong Zhao , Huachuan Qiu , Zhenzhong Lan

The advancement of powerful yet opaque large language models (LLMs) necessitates a fundamental revision of the philosophical criteria used to evaluate artificial moral agents (AMAs). Pre-LLM frameworks often relied on the assumption of…

Artificial Intelligence · Computer Science 2025-07-29 Matthew E. Brophy

As Large Language Models (LLMs) become increasingly sophisticated and ubiquitous in natural language processing (NLP) applications, ensuring their robustness, trustworthiness, and alignment with human values has become a critical challenge.…

Computation and Language · Computer Science 2024-08-09 Wrick Talukdar , Anjanava Biswas

Contemporary artificial intelligence research has been organized around two dominant ambitions: productivity, which treats AI systems as tools for accelerating work and economic output, and alignment, which focuses on ensuring that…

Artificial Intelligence · Computer Science 2026-03-10 W. Russell Neuman , Chad Coleman

As large language models (LLMs) are increasingly deployed in high-stakes settings, their ability to refuse ethically sensitive prompts-such as those involving hate speech or illegal activities-has become central to content moderation and…

Human-Computer Interaction · Computer Science 2025-05-22 Stefan Pasch

AI systems are becoming increasingly intertwined with human life. In order to effectively collaborate with humans and ensure safety, AI systems need to be able to understand, interpret and predict human moral judgments and decisions. Human…

How do Large Language Models understand moral dimensions compared to humans? This first large-scale Bayesian evaluation of market-leading language models provides the answer. In contrast to prior work using deterministic ground truth…

Computation and Language · Computer Science 2025-11-24 Maciej Skorski , Alina Landowska

Artificial intelligence (AI) ethics has emerged as a burgeoning yet pivotal area of scholarly research. This study conducts a comprehensive bibliometric analysis of the AI ethics literature over the past two decades. The analysis reveals a…

Computers and Society · Computer Science 2024-03-25 Di Kevin Gao , Andrew Haverly , Sudip Mittal , Jiming Wu , Jingdao Chen

Ethical reasoning is a crucial skill for Large Language Models (LLMs). However, moral values are not universal, but rather influenced by language and culture. This paper explores how three prominent LLMs -- GPT-4, ChatGPT, and…

Computation and Language · Computer Science 2024-04-30 Utkarsh Agarwal , Kumar Tanmay , Aditi Khandelwal , Monojit Choudhury

As the range of potential uses for Artificial Intelligence (AI), in particular machine learning (ML), has increased, so has awareness of the associated ethical issues. This increased awareness has led to the realisation that existing…

Computers and Society · Computer Science 2021-02-19 Jessica Morley , Anat Elhalal , Francesca Garcia , Libby Kinsey , Jakob Mokander , Luciano Floridi

Aligning large language models (LLMs) with a human reasoning approach ensures that LLMs produce morally correct and human-like decisions. Ethical concerns are raised because current models are prone to generating false positives and…

In this meta-ethnography, we explore three different angles of ethical artificial intelligence (AI) design implementation including the philosophical ethical viewpoint, the technical perspective, and framing through a political lens. Our…

Artificial Intelligence · Computer Science 2022-09-12 Jennafer S. Roberts , Laura N. Montoya

Human decision-making belongs to the foundation of our society and civilization, but we are on the verge of a future where much of it will be delegated to artificial intelligence. The arrival of Large Language Models (LLMs) has transformed…

Artificial Intelligence · Computer Science 2025-06-23 Hao Li , Gengrui Zhang , Petter Holme , Shuyue Hu , Zhen Wang

Large-scale Language Models (LLMs) have revolutionized human-AI interaction and achieved significant success in the generation of novel ideas. However, current assessments of idea generation overlook crucial factors such as knowledge…

Artificial Intelligence · Computer Science 2025-05-27 Yansheng Qiu , Haoquan Zhang , Zhaopan Xu , Ming Li , Diping Song , Zheng Wang , Kaipeng Zhang

Large Language Models (LLMs) are rapidly evolving and impacting various fields, necessitating the development of effective methods to evaluate and compare their performance. Most current approaches for performance evaluation are either…

Computation and Language · Computer Science 2025-02-11 Behrad Moniri , Hamed Hassani , Edgar Dobriban

While Medical Large Language Models (MedLLMs) have demonstrated remarkable potential in clinical tasks, their ethical safety remains insufficiently explored. This paper introduces $\textbf{MedEthicsQA}$, a comprehensive benchmark comprising…

Computation and Language · Computer Science 2025-07-01 Jianhui Wei , Zijie Meng , Zikai Xiao , Tianxiang Hu , Yang Feng , Zhijie Zhou , Jian Wu , Zuozhu Liu

The widespread application of Large Language Models (LLMs) involves ethical risks for users and societies. A prominent ethical risk of LLMs is the generation of unfair language output that reinforces or exacerbates harm for members of…

Computation and Language · Computer Science 2025-03-03 Luise Mehner , Lena Alicija Philine Fiedler , Sabine Ammon , Dorothea Kolossa

Large Language Models (LLMs) have transformed how people interact with artificial intelligence (AI) systems, achieving state-of-the-art results in various tasks, including scientific discovery and hypothesis generation. However, the lack of…

Computation and Language · Computer Science 2024-11-06 Sikun Guo , Amir Hassan Shariatmadari , Guangzhi Xiong , Albert Huang , Eric Xie , Stefan Bekiranov , Aidong Zhang