中文
相关论文

相关论文: A Comparative Analysis on Ethical Benchmarking in …

200 篇论文

Ethics review is a foundational mechanism of modern research governance, yet contemporary systems face increasing strain as ethical risks arise as structural consequences of large-scale, interdisciplinary scientific practice. The demand for…

As Large Language Models (LLMs) advance, their potential for widespread societal impact grows simultaneously. Hence, rigorous LLM evaluations are both a technical necessity and social imperative. While numerous evaluation benchmarks have…

计算与语言 · 计算机科学 2025-04-22 Jaime Raldua Veuthey , Zainab Ali Majid , Suhas Hariharan , Jacob Haimes

Medicine is inherently pluralistic. Principles such as autonomy, beneficence, nonmaleficence, and justice routinely conflict, and such ethical dilemmas often sharply divide reasonable physicians. Good clinical practice navigates these…

Recent advances in Large Language Models (LLMs) have enabled human-like responses across various tasks, raising questions about their ethical decision-making capabilities and potential biases. This study systematically evaluates how nine…

计算机与社会 · 计算机科学 2025-11-03 Wentao Xu , Yile Yan , Yuqi Zhu

Quantitative Artificial Intelligence (AI) Benchmarks have emerged as fundamental tools for evaluating the performance, capability, and safety of AI models and systems. Currently, they shape the direction of AI development and are playing an…

The recent rise in popularity of large language models (LLMs) has prompted considerable concerns about their moral capabilities. Although considerable effort has been dedicated to aligning LLMs with human moral values, existing benchmarks…

人工智能 · 计算机科学 2025-08-19 Alessio Galatolo , Luca Alberto Rappuoli , Katie Winkle , Meriem Beloucif

Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely…

计算与语言 · 计算机科学 2025-05-26 Ya Wu , Qiang Sheng , Danding Wang , Guang Yang , Yifan Sun , Zhengjia Wang , Yuyan Bu , Juan Cao

The question of whether artificial entities deserve moral consideration has become one of the defining ethical challenges of AI research. Existing frameworks for moral patiency rely on verified ontological properties, such as sentience,…

计算机与社会 · 计算机科学 2026-03-03 Faezeh B. Pasandi , Hannah B. Pasandi

Large Language Models (LLMs) are increasingly integrated into software engineering (SE) tools for tasks that extend beyond code synthesis, including judgment under uncertainty and reasoning in ethically significant contexts. We present a…

软件工程 · 计算机科学 2025-10-02 Patrizio Migliarini , Mashal Afzal Memon , Marco Autili , Paola Inverardi

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Critical decision-making in socially consequential spaces is increasingly involving AI systems at varying capacities. Yet, despite the ubiquity of autonomous systems, most approaches to handling autonomous moral decision-making resort to…

人工智能 · 计算机科学 2026-05-28 Aisha Aijaz , Rahul Goel , Arnav Batra , Raghava Mutharaju

We find ourselves surrounded by a rapidly increasing number of autonomous and semi-autonomous systems. Two grand challenges arise from this development: Machine Ethics and Machine Explainability. Machine Ethics, on the one hand, is…

人工智能 · 计算机科学 2019-01-04 Kevin Baum , Holger Hermanns , Timo Speith

AI Ethics is now a global topic of discussion in academic and policy circles. At least 84 public-private initiatives have produced statements describing high-level principles, values, and other tenets to guide the ethical development,…

计算机与社会 · 计算机科学 2020-02-20 Brent Mittelstadt

As autonomous systems grow more advanced, objective metrics to evaluate their ethical and legal compliance are critical for informing end users of their limitations and ensuring accountability of those who misuse them. Current ethical…

As autonomous systems such as drones, become increasingly deployed in high-stakes, human-centric domains, it is critical to evaluate the ethical alignment since failure to do so imposes imminent danger to human lives, and long term bias in…

人工智能 · 计算机科学 2026-03-12 Anjali Parashar , Yingke Li , Eric Yang Yu , Fei Chen , James Neidhoefer , Devesh Upadhyay , Chuchu Fan

Models like Delphi have been able to label ethical dilemmas as moral or immoral with astonishing accuracy. This paper challenges accuracy as a holistic metric for ethics modeling by identifying issues with translating moral dilemmas into…

人工智能 · 计算机科学 2024-07-09 Ben Fitzgerald

In this meta-ethnography, we explore three different angles of ethical artificial intelligence (AI) design implementation including the philosophical ethical viewpoint, the technical perspective, and framing through a political lens. Our…

人工智能 · 计算机科学 2022-09-12 Jennafer S. Roberts , Laura N. Montoya

We introduce MENAValues, a novel benchmark designed to evaluate the cultural alignment and multilingual biases of large language models (LLMs) with respect to the beliefs and values of the Middle East and North Africa (MENA) region, an…

计算与语言 · 计算机科学 2025-10-16 Pardis Sadat Zahraei , Ehsaneddin Asgari

HealthBench, a benchmark designed to measure the capabilities of AI systems for health better (Arora et al., 2025), has advanced medical language model evaluation through physician-crafted dialogues and transparent rubrics. However, its…

人工智能 · 计算机科学 2025-08-04 Fred Mutisya , Shikoh Gitau , Nasubo Ongoma , Keith Mbae , Elizabeth Wamicha

Developing AI systems capable of nuanced ethical reasoning is critical as they increasingly influence human decisions, yet existing models often rely on superficial correlations rather than principled moral understanding. This paper…

计算机与社会 · 计算机科学 2025-10-16 Mahamodul Hasan Mahadi , Md. Nasif Safwan , Souhardo Rahman , Shahnaj Parvin , Aminun Nahar , Kamruddin Nur