English
Related papers

Related papers: Quasi-Dilemmas for Artificial Moral Agents

200 papers

This paper presents our research towards a near-term future in which legal entities, such as individuals and organisations can entrust semi-autonomous AI-driven agents to carry out online interactions on their behalf. The author's research…

Artificial Intelligence · Computer Science 2024-09-10 Jesse Wright

Advances in artificial intelligence (AI) raise important questions about whether people view moral evaluations by AI systems similarly to human-generated moral evaluations. We conducted a modified Moral Turing Test (m-MTT), inspired by…

Artificially intelligent systems, given a set of non-trivial ethical rules to follow, will inevitably be faced with scenarios which call into question the scope of those rules. In such cases, human reasoners typically will engage in…

Artificial Intelligence · Computer Science 2019-11-06 John Licato , Zaid Marji , Sophia Abraham

Given the fast rise of increasingly autonomous artificial agents and robots, a key acceptability criterion will be the possible moral implications of their actions. In particular, intelligent persuasive systems (systems designed to…

Computers and Society · Computer Science 2014-04-16 Marco Guerini , Fabio Pianesi , Oliviero Stock

Work in AI ethics and fairness has made much progress in regulating LLMs to reflect certain values, such as fairness, truth, and diversity. However, it has taken the problem of how LLMs might 'mean' anything at all for granted. Without…

Computation and Language · Computer Science 2023-11-07 Mark Pock , Andre Ye , Jared Moore

An ambitious goal for machine learning is to create agents that behave ethically: The capacity to abide by human moral norms would greatly expand the context in which autonomous agents could be practically and safely deployed, e.g. fully…

Artificial Intelligence · Computer Science 2021-07-21 Adrien Ecoffet , Joel Lehman

Growing concerns about safety and alignment of AI systems highlight the importance of embedding moral capabilities in artificial agents: a promising solution is the use of learning from experience, i.e., Reinforcement Learning. In…

Multiagent Systems · Computer Science 2026-02-11 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

This book-length article combines several peer reviewed papers and new material to analyze the issues of ethical artificial intelligence (AI). The behavior of future AI systems can be described by mathematical equations, which are adapted…

Artificial Intelligence · Computer Science 2015-11-18 Bill Hibbard

Can AI agents deal with hard choices -- cases where options are incommensurable because multiple objectives are pursued simultaneously? Adopting a technologically engaged approach distinct from existing philosophical literature, I submit…

Artificial Intelligence · Computer Science 2026-04-21 Kangyu Wang

The tragedy of the commons illustrates a fundamental social dilemma where individual rational actions lead to collectively undesired outcomes, threatening the sustainability of shared resources. Strategies to escape this dilemma, however,…

Computer Science and Game Theory · Computer Science 2026-03-26 Arend Hintze , Christoph Adami

Increasing interest in ensuring the safety of next-generation Artificial Intelligence (AI) systems calls for novel approaches to embedding morality into autonomous agents. This goal differs qualitatively from traditional task-specific AI…

Artificial Intelligence · Computer Science 2025-01-17 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

As large language models (LLMs) become increasingly capable of autonomous decision-making, they introduce new challenges and opportunities for human-AI cooperation in mixed-motive contexts. While prior research has primarily examined AI in…

Human-Computer Interaction · Computer Science 2025-05-29 Guanxuan Jiang , Shirao Yang , Yuyang Wang , Pan Hui

In the last decade, there have been significant advances in multi-agent reinforcement learning (MARL) but there are still numerous challenges, such as high sample complexity and slow convergence to stable policies, that need to be overcome…

Artificial Intelligence · Computer Science 2023-03-02 Sriram Ganapathi Subramanian , Matthew E. Taylor , Kate Larson , Mark Crowley

Despite rapid progress in artificial intelligence, current systems struggle with the interconnected challenges that define real-world decision making. Practical domains, such as business management, require optimizing an open-ended and…

To achieve desirable performance, current AI systems often require huge amounts of training data. This is especially problematic in domains where collecting data is both expensive and time-consuming, e.g., where AI systems require having…

Artificial Intelligence · Computer Science 2022-10-11 Ardavan S. Nobandegani , Thomas R. Shultz , Irina Rish

The integration of Artificial Intelligence (AI) into construction project management (CPM) is accelerating, with Large Language Models (LLMs) emerging as accessible decision-support tools. This study aims to critically evaluate the ethical…

Artificial Intelligence · Computer Science 2025-09-08 Somtochukwu Azie , Yiping Meng

One of the major challenges we face with ethical AI today is developing computational systems whose reasoning and behaviour are provably aligned with human values. Human values, however, are notorious for being ambiguous, contradictory and…

Artificial Intelligence · Computer Science 2023-05-05 Nardine Osman , Mark d'Inverno

AI agents are increasingly used in consumer-facing applications to assist with tasks such as product search, negotiation, and transaction execution. In this paper, we explore a future scenario where both consumers and merchants authorize AI…

Artificial Intelligence · Computer Science 2025-09-23 Shenzhe Zhu , Jiao Sun , Yi Nian , Tobin South , Alex Pentland , Jiaxin Pei

Incorporating ethics into the requirement elicitation process is essential for creating ethically aligned systems. Although eliciting manual ethics requirements is effective, it requires diverse input from multiple stakeholders, which can…

Artificial Intelligence · Computer Science 2025-08-27 Asma Yamani , Malak Baslyman , Moataz Ahmed

Decision-making agents based on pre-trained Large Language Models (LLMs) are increasingly being deployed across various domains of human activity. While their applications are currently rather specialized, several research efforts are…

Machine Learning · Computer Science 2025-05-13 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi