English
Related papers

Related papers: Smart But Not Moral? Moral Alignment In Human-AI D…

200 papers

Making moral judgments is an essential step toward developing ethical AI systems. Prevalent approaches are mostly implemented in a bottom-up manner, which uses a large set of annotated data to train models based on crowd-sourced opinions…

Computation and Language · Computer Science 2024-07-02 Jingyan Zhou , Minda Hu , Junan Li , Xiaoying Zhang , Xixin Wu , Irwin King , Helen Meng

As large language models (LLMs) are increasingly deployed in consequential decision-making contexts, systematically assessing their ethical reasoning capabilities becomes a critical imperative. This paper introduces the Priorities in…

Artificial Intelligence · Computer Science 2025-04-29 Chad Coleman , W. Russell Neuman , Ali Dasdan , Safinah Ali , Manan Shah

Effective collaboration between humans and AI-based systems requires effective modeling of the human in the loop, both in terms of the mental state as well as the physical capabilities of the latter. However, these models can also open up…

Artificial Intelligence · Computer Science 2018-01-31 Tathagata Chakraborti , Subbarao Kambhampati

Ethicists, policy-makers, and the general public have questioned whether artificial entities such as robots warrant rights or other forms of moral consideration. There is little synthesis of the research on this topic so far. We identify…

Computers and Society · Computer Science 2021-09-29 Jamie Harris , Jacy Reese Anthis

As AI systems become increasingly powerful and pervasive, there are growing concerns about machines' morality or a lack thereof. Yet, teaching morality to machines is a formidable task, as morality remains among the most intensely debated…

Is it possible to evaluate the moral cognition of complex artificial agents? In this work, we take a look at one aspect of morality: `doing the right thing for the right reasons.' We propose a behavior-based analysis of artificial moral…

Artificial Intelligence · Computer Science 2023-05-30 Yiran Mao , Madeline G. Reinecke , Markus Kunesch , Edgar A. Duéñez-Guzmán , Ramona Comanescu , Julia Haas , Joel Z. Leibo

Recent advances in large language models (LLMs) have enabled their use in complex agentic roles, involving decision-making with humans or other agents, making ethical alignment a key AI safety concern. While prior work has examined both…

Computation and Language · Computer Science 2025-05-27 Steffen Backmann , David Guzman Piedrahita , Emanuel Tewolde , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

Fairness in AI-driven decision-making systems has become a critical concern, especially when these systems directly affect human lives. This paper explores the public's comprehension of fairness in healthcare recommendations. We conducted a…

Machine Learning · Computer Science 2024-09-10 Veronica Kecki , Alan Said

Recent advances in AI research make it increasingly plausible that artificial agents with consequential real-world impact will soon operate beyond tightly controlled environments. Ensuring that these agents are not only safe but that they…

Computers and Society · Computer Science 2025-06-10 Kevin Baum

As AI systems increasingly permeate everyday life, designers and developers face mounting pressure to balance innovation with ethical design choices. To date, the operationalisation of AI ethics has predominantly depended on frameworks that…

Human-Computer Interaction · Computer Science 2025-09-18 Benjamin J. Carroll , Jianlong Zhou , Paul F. Burke , Sabine Ammon

Agentic AIs $-$ AIs that are capable and permitted to undertake complex actions with little supervision $-$ mark a new frontier in AI capabilities and raise new questions about how to safely create and align such systems with users,…

Computers and Society · Computer Science 2024-10-04 Hayley Clatterbuck , Clinton Castro , Arvo Muñoz Morán

With increasing digitalization, Artificial Intelligence (AI) is becoming ubiquitous. AI-based systems to identify, optimize, automate, and scale solutions to complex economic and societal problems are being proposed and implemented. This…

This article reviews the landscape of ethical challenges of integrating artificial intelligence (AI) into smart healthcare products, including medical electronic devices. Differences between traditional ethics in the medical domain and…

Computers and Society · Computer Science 2022-11-14 Sudeep Pasricha

Artificial Intelligence (AI) technology epitomizes the complex challenges posed by human-made artifacts, particularly those widely integrated into society and exerting significant influence, highlighting potential benefits and their…

Artificial Intelligence · Computer Science 2025-10-06 Michael Papademas , Xenia Ziouvelou , Antonis Troumpoukis , Vangelis Karkaletsis

What does it mean for a machine learning model to be `fair', in terms which can be operationalised? Should fairness consist of ensuring everyone has an equal probability of obtaining some benefit, or should we aim instead to minimise the…

Computers and Society · Computer Science 2021-03-24 Reuben Binns

Ensuring that Large Language Models (LLMs) align with the diverse and evolving human values across different regions and cultures remains a critical challenge in AI ethics. Current alignment approaches often yield superficial conformity…

Artificial Intelligence · Computer Science 2025-11-04 Jiahao Wang , Songkai Xue , Jinghui Li , Xiaozhen Wang

As artificial intelligence (AI) models continue to scale up, they are becoming more capable and integrated into various forms of decision-making systems. For models involved in moral decision-making, also known as artificial moral agents…

Artificial Intelligence · Computer Science 2023-07-04 Avish Vijayaraghavan , Cosmin Badea

Critical examinations of AI systems often apply principles such as fairness, justice, accountability, and safety, which is reflected in AI regulations such as the EU AI Act. Are such principles sufficient to promote the design of systems…

Human-Computer Interaction · Computer Science 2022-06-16 William Seymour , Max Van Kleek , Reuben Binns , Dave Murray-Rust

Complementary collaboration between humans and AI is essential for human-AI decision making. One feasible approach to achieving it involves accounting for the calibrated confidence levels of both AI and users. However, this process would…

Human-Computer Interaction · Computer Science 2025-12-08 Jingshu Li , Yitian Yang , Q. Vera Liao , Junti Zhang , Yi-Chieh Lee

Scientific research organizations that are developing and deploying Artificial Intelligence (AI) systems are at the intersection of technological progress and ethical considerations. The push for Responsible AI (RAI) in such institutions…

Artificial Intelligence · Computer Science 2023-12-18 Muneera Bano , Didar Zowghi , Pip Shea , Georgina Ibarra