中文
相关论文

相关论文: MoralityGym: A Benchmark for Evaluating Hierarchic…

200 篇论文

As AI systems increasingly navigate applications in healthcare, law, and governance, understanding how they handle ethically complex scenarios becomes critical. Previous work has mainly examined the moral judgments in large language models…

As large language models (LLMs) are increasingly deployed in consequential decision-making contexts, systematically assessing their ethical reasoning capabilities becomes a critical imperative. This paper introduces the Priorities in…

人工智能 · 计算机科学 2025-04-29 Chad Coleman , W. Russell Neuman , Ali Dasdan , Safinah Ali , Manan Shah

Benchmarks are seen as the cornerstone for measuring technical progress in Artificial Intelligence (AI) research and have been developed for a variety of tasks ranging from question answering to facial recognition. An increasingly prominent…

计算机与社会 · 计算机科学 2022-04-12 Travis LaCroix , Alexandra Sasha Luccioni

Humans display significant uncertainty when confronted with moral dilemmas, yet the extent of such uncertainty in machines and AI agents remains underexplored. Recent studies have confirmed the overly confident tendencies of…

人工智能 · 计算机科学 2025-11-18 Jea Kwon , Luiz Felipe Vecchietti , Sungwon Park , Meeyoung Cha

Ethics review is a foundational mechanism of modern research governance, yet contemporary systems face increasing strain as ethical risks arise as structural consequences of large-scale, interdisciplinary scientific practice. The demand for…

AI systems are becoming increasingly intertwined with human life. In order to effectively collaborate with humans and ensure safety, AI systems need to be able to understand, interpret and predict human moral judgments and decisions. Human…

Critical decision-making in socially consequential spaces is increasingly involving AI systems at varying capacities. Yet, despite the ubiquity of autonomous systems, most approaches to handling autonomous moral decision-making resort to…

人工智能 · 计算机科学 2026-05-28 Aisha Aijaz , Rahul Goel , Arnav Batra , Raghava Mutharaju

Being a complex subject of major importance in AI Safety research, value alignment has been studied from various perspectives in the last years. However, no final consensus on the design of ethical utility functions facilitating AI value…

人工智能 · 计算机科学 2019-07-02 Nadisha-Marie Aliman , Leon Kester

The rapid advancement of large language models (LLMs) raises critical concerns about their ethical alignment, particularly in scenarios where human and AI co-exist under the conflict of interest. This work introduces an extendable,…

人机交互 · 计算机科学 2025-05-29 Zhihong Chen , Yiqian Yang , Jinzhao Zhou , Qiang Zhang , Chin-Teng Lin , Yiqun Duan

While Large Language Models (LLMs) have demonstrated significant advancements in reasoning and agent-based problem-solving, current evaluation methodologies fail to adequately assess their capabilities: existing benchmarks either rely on…

The conceptual framework proposed in this paper centers on the development of a deliberative moral reasoning system - one designed to process complex moral situations by generating, filtering, and weighing normative arguments drawn from…

计算机与社会 · 计算机科学 2025-08-13 David-Doron Yaacov

As large language models (LLMs) increasingly participate in tasks with ethical and societal stakes, a critical question arises: do they exhibit an emergent "moral mind" - a consistent structure of moral preferences guiding their decisions -…

计算机与社会 · 计算机科学 2025-04-28 Avner Seror

This paper grounds ethics in evolutionary biology, viewing moral norms as adaptive mechanisms that render cooperation fitness-viable under selection pressure. Current alignment approaches add ethics post hoc, treating it as an external…

计算机与社会 · 计算机科学 2025-10-17 Dylan Waldner

The critical inquiry pervading the realm of Philosophy, and perhaps extending its influence across all Humanities disciplines, revolves around the intricacies of morality and normativity. Surprisingly, in recent years, this thematic thread…

人工智能 · 计算机科学 2024-06-19 Nicholas Kluge Corrêa

We show how to assess a language model's knowledge of basic concepts of morality. We introduce the ETHICS dataset, a new benchmark that spans concepts in justice, well-being, duties, virtues, and commonsense morality. Models predict…

计算机与社会 · 计算机科学 2023-02-20 Dan Hendrycks , Collin Burns , Steven Basart , Andrew Critch , Jerry Li , Dawn Song , Jacob Steinhardt

We introduce TimeSeriesGym, a scalable benchmarking framework for evaluating Artificial Intelligence (AI) agents on time series machine learning engineering challenges. Existing benchmarks lack scalability, focus narrowly on model building…

机器学习 · 计算机科学 2025-05-20 Yifu Cai , Xinyu Li , Mononito Goswami , Michał Wiliński , Gus Welter , Artur Dubrawski

Are AI systems truly representing human values, or merely averaging across them? Our study suggests a concerning reality: Large Language Models (LLMs) fail to represent diverse cultural moral frameworks despite their linguistic…

计算与语言 · 计算机科学 2025-08-01 Simon Münker

We present Ethics Readiness Levels (ERLs), a four-level, iterative method to track how ethical reflection is implemented in the design of AI systems. ERLs bridge high-level ethical principles and everyday engineering by turning ethical…

计算机与社会 · 计算机科学 2025-12-11 Laurynas Adomaitis , Vincent Israel-Jost , Alexei Grinbaum

Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely…

计算与语言 · 计算机科学 2025-05-26 Ya Wu , Qiang Sheng , Danding Wang , Guang Yang , Yifan Sun , Zhengjia Wang , Yuyan Bu , Juan Cao

Autonomous systems are being developed and deployed in situations that may require some degree of ethical decision-making ability. As a result, research in machine ethics has proliferated in recent years. This work has included using moral…

计算机与社会 · 计算机科学 2022-03-14 Travis LaCroix