中文
相关论文

相关论文: MoralityGym: A Benchmark for Evaluating Hierarchic…

200 篇论文

This paper addresses the question of how to align AI systems with human values and situates it within a wider body of thought regarding technology and value. Far from existing in a vacuum, there has long been an interest in the ability of…

计算机与社会 · 计算机科学 2021-01-19 Iason Gabriel , Vafa Ghazavi

As AI systems become increasingly sophisticated, questions about machine consciousness and its ethical implications have moved from fringe speculation to mainstream academic debate. Current ethical frameworks in this domain often implicitly…

计算机与社会 · 计算机科学 2025-12-03 Zhou Ziheng , Haiqiang Dai , Bin Ling , Ying Nian Wu , Demetri Terzopoulos

Conversational agents have come increasingly closer to human competence in open-domain dialogue settings; however, such models can reflect insensitive, hurtful, or entirely incoherent viewpoints that erode a user's trust in the moral…

计算与语言 · 计算机科学 2022-04-08 Caleb Ziems , Jane A. Yu , Yi-Chia Wang , Alon Halevy , Diyi Yang

Algorithmic (including AI/ML) decision-making artifacts are an established and growing part of our decision-making ecosystem. They are indispensable tools for managing the flood of information needed to make effective decisions in a complex…

计算机与社会 · 计算机科学 2020-11-11 Osonde A. Osoba , Benjamin Boudreaux , Douglas Yeung

One of today's most significant societal challenges is building AI systems whose behaviour, or the behaviour it enables within communities of interacting agents (human and artificial), aligns with human values. To address this challenge, we…

人工智能 · 计算机科学 2026-02-09 Nardine Osman , Mark d'Inverno

Alignment methods in moral domains seek to elicit moral preferences of human stakeholders and incorporate them into AI. This presupposes moral preferences as static targets, but such preferences often evolve over time. Proper alignment of…

This paper introduces a checks-and-balances framework for ethical alignment of Large Language Models (LLMs), inspired by three-branch governmental systems. It implements three independent yet interacting components: LLMs as the executive…

计算与语言 · 计算机科学 2025-05-29 Edward Y. Chang

Value alignment is central to the development of safe and socially compatible artificial intelligence. However, how Large Language Models (LLMs) represent and enact human values in real-world decision contexts remains under-explored. We…

计算与语言 · 计算机科学 2026-01-14 Jen-tse Huang , Jiantong Qin , Xueli Qiu , Sharon Levy , Michelle R. Kaufman , Mark Dredze

Responsible AI must be able to make or support decisions that consider human values and can be justified by human morals. Accommodating values and morals in responsible decision making is supported by adopting a perspective of macro ethics,…

计算机与社会 · 计算机科学 2024-09-12 Jessica Woodgate , Nirav Ajmeri

This study investigates students' perceptions of Artificial Intelligence (AI) grading systems in an undergraduate computer science course (n = 27), focusing on a block-based programming final project. Guided by the ethical principles…

人工智能 · 计算机科学 2026-02-24 Bahare Riahi , Viktoriia Storozhevykh , Veronica Catete

A Large Language Model (LLM) is considered consistent if semantically equivalent prompts produce semantically equivalent responses. Despite recent advancements showcasing the impressive capabilities of LLMs in conversational systems, we…

计算与语言 · 计算机科学 2024-03-04 Vamshi Krishna Bonagiri , Sreeram Vennam , Manas Gaur , Ponnurangam Kumaraguru

Large language models (LLMs) are increasingly used in human-AI interaction research and practice, yet existing capability and safety benchmarks reveal little about the value priorities these systems express or how those priorities…

人工智能 · 计算机科学 2026-05-19 Gabriel Rongyang Lau , Wei Yan Low , Seow Min Koh , Fiona Fui-Hoon Nah , Andree Hartanto

Generative AI is increasingly positioned as a peer in collaborative learning, yet its effects on ethical deliberation remain unclear. We report a between-subjects experiment with university students (N=217) who discussed an…

With the rise of individual and collaborative networks of autonomous agents, AI is deployed in more key reasoning and decision-making roles. For this reason, ethics-based audits play a pivotal role in the rapidly growing fields of AI safety…

计算机与社会 · 计算机科学 2024-02-06 Jon Chun , Katherine Elkins

As large language models (LLMs) become more powerful and pervasive across society, ensuring these systems are beneficial, safe, and aligned with human values is crucial. Current alignment techniques, like Constitutional AI (CAI), involve…

计算机与社会 · 计算机科学 2025-06-03 Matthew Brophy

As AI systems become an increasing part of people's everyday lives, it becomes ever more important that they understand people's ethical norms. Motivated by descriptive ethics, a field of study that focuses on people's descriptive judgments…

计算与语言 · 计算机科学 2021-03-25 Nicholas Lourie , Ronan Le Bras , Yejin Choi

We introduce NAEL (Non-Anthropocentric Ethical Logic), a novel ethical framework for artificial agents grounded in active inference and symbolic reasoning. Departing from conventional, human-centred approaches to AI ethics, NAEL formalizes…

人工智能 · 计算机科学 2025-10-17 Bianca Maria Lerma , Rafael Peñaloza

Inferring reward functions from demonstrations and pairwise preferences are auspicious approaches for aligning Reinforcement Learning (RL) agents with human intentions. However, state-of-the art methods typically focus on learning a single…

机器学习 · 计算机科学 2022-01-04 Markus Peschl , Arkady Zgonnikov , Frans A. Oliehoek , Luciano C. Siebert

This paper introduces the Shepherd Test, a new conceptual test for assessing the moral and relational dimensions of superintelligent artificial agents. The test is inspired by human interactions with animals, where ethical considerations…

人工智能 · 计算机科学 2025-09-30 Djallel Bouneffouf , Matthew Riemer , Kush Varshney

As AI systems increasingly operate with autonomy and adaptability, the traditional boundaries of moral responsibility in techno-social systems are being challenged. This paper explores the evolving discourse on the delegation of…

计算机与社会 · 计算机科学 2024-11-26 Gordana Dodig-Crnkovic , Gianfranco Basti , Tobias Holstein