English
Related papers

Related papers: Ethics2vec: aligning automatic agents and human pr…

200 papers

Our ability to build autonomous agents that leverage Generative AI continues to increase by the day. As builders and users of such agents it is unclear what parameters we need to align on before the agents start performing tasks on our…

Artificial Intelligence · Computer Science 2024-04-09 Nitesh Goyal , Minsuk Chang , Michael Terry

Agreement Technologies refer to open computer systems in which autonomous software agents interact with one another, typically on behalf of humans, in order to come to mutually acceptable agreements. With the advance of AI systems in recent…

Computers and Society · Computer Science 2026-02-05 Andrés Holgado-Sánchez , Holger Billhardt , Alberto Fernández , Sascha Ossowski

Pluralistic alignment is concerned with ensuring that an AI system's objectives and behaviors are in harmony with the diversity of human values and perspectives. In this paper we study the notion of pluralistic alignment in the context of…

Artificial Intelligence · Computer Science 2024-11-19 Parand A. Alamdari , Toryn Q. Klassen , Rodrigo Toro Icarte , Sheila A. McIlraith

Artificial intelligence (AI) based assistive systems, so called intelligent assistive technology (IAT) are becoming increasingly ubiquitous by each day. IAT helps people in improving their quality of life by providing intelligent assistance…

Computers and Society · Computer Science 2023-03-08 M. Salman Shaukat , J. -C. Põder , Sebastian Bader , Thomas Kirste

Artificial Intelligence (AI) technology epitomizes the complex challenges posed by human-made artifacts, particularly those widely integrated into society and exerting significant influence, highlighting potential benefits and their…

Artificial Intelligence · Computer Science 2025-10-06 Michael Papademas , Xenia Ziouvelou , Antonis Troumpoukis , Vangelis Karkaletsis

Alignment of artificial intelligence (AI) encompasses the normative problem of specifying how AI systems should act and the technical problem of ensuring AI systems comply with those specifications. To date, AI alignment has generally…

As AI systems increasingly permeate everyday life, designers and developers face mounting pressure to balance innovation with ethical design choices. To date, the operationalisation of AI ethics has predominantly depended on frameworks that…

Human-Computer Interaction · Computer Science 2025-09-18 Benjamin J. Carroll , Jianlong Zhou , Paul F. Burke , Sabine Ammon

The rise of artificial intelligence (A.I.) based systems is already offering substantial benefits to the society as a whole. However, these systems may also enclose potential conflicts and unintended consequences. Notably, people will tend…

Computers and Society · Computer Science 2020-12-23 Pedro Fernandes , Francisco C. Santos , Manuel Lopes

When AI agents don't align their actions with human values they may cause serious harm. One way to solve the value alignment problem is by including a human operator who monitors all of the agent's actions. Despite the fact, that this…

Human-Computer Interaction · Computer Science 2023-06-13 Yitzhak Spielberg , Amos Azaria

This paper introduces the concept of value awareness in AI, which goes beyond the traditional value-alignment problem. Our definition of value awareness presents us with a concise and simplified roadmap for engineering value-aware AI. The…

Artificial Intelligence · Computer Science 2025-12-16 Nardine Osman

Operationalizing human values alongside functional and adaptation requirements remains challenging due to their ambiguous, pluralistic, and context-dependent nature. Explicit representations are needed to support the elicitation, analysis,…

Software Engineering · Computer Science 2026-02-11 Everaldo Silva Júnior , Lina Marsso , Ricardo Caldas , Marsha Chechik , Genaína Nunes Rodrigues

A morally acceptable course of AI development should avoid two dangers: creating unaligned AI systems that pose a threat to humanity and mistreating AI systems that merit moral consideration in their own right. This paper argues these two…

Computers and Society · Computer Science 2025-10-16 Adam Bradley , Bradford Saad

Recent advances in AI research make it increasingly plausible that artificial agents with consequential real-world impact will soon operate beyond tightly controlled environments. Ensuring that these agents are not only safe but that they…

Computers and Society · Computer Science 2025-06-10 Kevin Baum

Machine ethics has received increasing attention over the past few years because of the need to ensure safe and reliable artificial intelligence (AI). The two dominantly used theories in machine ethics are deontological and utilitarian…

Artificial Intelligence · Computer Science 2023-01-10 Ajay Vishwanath , Einar Duenger Bøhn , Ole-Christoffer Granmo , Charl Maree , Christian Omlin

AI alignment is a field of research that aims to develop methods to ensure that agents always behave in a manner aligned with (i.e. consistently with) the goals and values of their human operators, no matter their level of capability. This…

Artificial Intelligence · Computer Science 2025-05-26 Eli Sennesh , Maxwell Ramstead

Incorporating ethics into the requirement elicitation process is essential for creating ethically aligned systems. Although eliciting manual ethics requirements is effective, it requires diverse input from multiple stakeholders, which can…

Artificial Intelligence · Computer Science 2025-08-27 Asma Yamani , Malak Baslyman , Moataz Ahmed

A new wave of decision-support systems are being built today using AI services that draw insights from data (like text and video) and incorporate them in human-in-the-loop assistance. However, just as we expect humans to be ethical, the…

Artificial Intelligence · Computer Science 2019-01-16 Biplav Srivastava , Francesca Rossi

The novel research area of computational empathy is in its infancy and moving towards developing methods and standards. One major problem is the lack of agreement on the evaluation of empathy in artificial interactive systems. Even though…

Artificial Intelligence · Computer Science 2019-08-16 Özge Nilay Yalçın

Does AI conform to humans, or will we conform to AI? An ethical evaluation of AI-intensive companies will allow investors to knowledgeably participate in the decision. The evaluation is built from nine performance indicators that can be…

Computers and Society · Computer Science 2025-07-11 James Brusseau

While various traditions under the 'virtue ethics' umbrella have been studied extensively and advocated by ethicists, it has not been clear that there exists a version of virtue ethics rigorous enough to be a target for machine ethics…

Artificial Intelligence · Computer Science 2019-01-01 Naveen Sundar Govindarajulu , Selmer Bringsjord , Rikhiya Ghosh