English
Related papers

Related papers: Smart But Not Moral? Moral Alignment In Human-AI D…

200 papers

Robots and other artificial intelligence (AI) systems are widely perceived as moral agents responsible for their actions. As AI proliferates, these perceptions may become entangled via the moral spillover of attitudes towards one AI to…

Artificial Intelligence · Computer Science 2024-12-10 Aikaterina Manoli , Janet V. T. Pauketat , Jacy Reese Anthis

The concepts of ``human-centered AI'' and ``value-based decision'' have gained significant attention in both research and industry. However, many critical aspects remain underexplored and require further investigation. In particular, there…

Artificial Intelligence · Computer Science 2025-08-26 Sz-Ting Tzeng , Frank Dignum

Deep neural networks excel in medical imaging but remain prone to biases, leading to fairness gaps across demographic groups. We provide the first systematic exploration of Human-AI alignment and fairness in this domain. Our results show…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Haozhe Luo , Ziyu Zhou , Zixin Shu , Aurélie Pahud de Mortanges , Robert Berke , Mauricio Reyes

Evaluating moral alignment in agents navigating conflicting, hierarchically structured human norms is a critical challenge at the intersection of AI safety, moral philosophy, and cognitive science. We introduce Morality Chains, a novel…

Algorithmic (including AI/ML) decision-making artifacts are an established and growing part of our decision-making ecosystem. They are indispensable tools for managing the flood of information needed to make effective decisions in a complex…

Computers and Society · Computer Science 2020-11-11 Osonde A. Osoba , Benjamin Boudreaux , Douglas Yeung

In the last five years, private companies, research institutions as well as public sector organisations have issued principles and guidelines for ethical AI, yet there is debate about both what constitutes "ethical AI" and which ethical…

Computers and Society · Computer Science 2019-09-04 Anna Jobin , Marcello Ienca , Effy Vayena

Advances in artificial intelligence (AI) raise important questions about whether people view moral evaluations by AI systems similarly to human-generated moral evaluations. We conducted a modified Moral Turing Test (m-MTT), inspired by…

Practical uses of Artificial Intelligence (AI) in the real world have demonstrated the importance of embedding moral choices into intelligent agents. They have also highlighted that defining top-down ethical constraints on AI according to…

Multiagent Systems · Computer Science 2023-08-31 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

The integration of artificial intelligence (AI) and optimization hold substantial promise for improving the efficiency, reliability, and resilience of engineered systems. Due to the networked nature of many engineered systems, ethically…

Artificial Intelligence · Computer Science 2024-09-19 Rosemarie Santa Gonzalez , Ryan Piansky , Sue M Bae , Justin Biddle , Daniel Molzahn

Recent advances in general-purpose AI underscore the urgent need to align AI systems with human goals and values. Yet, the lack of a clear, shared understanding of what constitutes "alignment" limits meaningful progress and…

The rapid integration of Large Language Models (LLMs) in high-stakes decision-making -- such as allocating scarce resources like donor organs -- raises critical questions about their alignment with human moral values. We systematically…

Computers and Society · Computer Science 2026-04-21 John P. Dickerson , Hadi Hosseini , Samarth Khanna , Leona Pierce

Solidarity is one of the fundamental values at the heart of the construction of peaceful societies and present in more than one third of world's constitutions. Still, solidarity is almost never included as a principle in ethical guidelines…

Computers and Society · Computer Science 2019-10-29 Miguel Luengo-Oroz

An important step in the development of value alignment (VA) systems in AI is understanding how values can interrelate with facts. Designers of future VA systems will need to utilize a hybrid approach in which ethical reasoning and…

Artificial Intelligence · Computer Science 2019-07-15 Tae Wan Kim , Thomas Donaldson , John Hooker

This paper argues that Machine Learning (ML) algorithms must be educated. ML-trained algorithms moral decisions are ubiquitous in human society. Sometimes reverting the societal advances governments, NGOs and civil society have achieved…

Machine Learning · Computer Science 2023-05-23 Susana Perez Blazquez , Inas Hipolito

The value alignment problem for artificial intelligence (AI) is often framed as a purely technical or normative challenge, sometimes focused on hypothetical future systems. I argue that the problem is better understood as a structural…

Computers and Society · Computer Science 2026-04-23 Travis LaCroix

Moral AI has been studied in the fields of philosophy and artificial intelligence. Although most existing studies are only theoretical, recent developments in AI have made it increasingly necessary to implement AI with morality. On the…

Artificial Intelligence · Computer Science 2023-06-21 Masashi Takeshita , Rzepka Rafal , Kenji Araki

principles that should govern autonomous AI systems. It essentially states that a system's goals and behaviour should be aligned with human values. But how to ensure value alignment? In this paper we first provide a formal model to…

Artificial Intelligence · Computer Science 2024-02-08 Carles Sierra , Nardine Osman , Pablo Noriega , Jordi Sabater-Mir , Antoni Perelló

In the current era, people and society have grown increasingly reliant on artificial intelligence (AI) technologies. AI has the potential to drive us towards a future in which all of humanity flourishes. It also comes with substantial risks…

Computers and Society · Computer Science 2021-08-24 Lu Cheng , Kush R. Varshney , Huan Liu

Instruction-tuned Large Language Models (LLMs) are increasingly deployed as AI Assistants in firms for support in cognitive tasks. These AI assistants carry embedded perspectives which influence factors across the firm including…

Computers and Society · Computer Science 2025-05-27 Noah Broestl , Benjamin Lange , Cristina Voinea , Geoff Keeling , Rachael Lam

As more and more decisions that have a significant ethical dimension are being outsourced to AI systems, it is important to have a definition of moral responsibility that can be applied to AI systems. Moral responsibility for an outcome of…

Artificial Intelligence · Computer Science 2023-10-30 Sander Beckers