English
Related papers

Related papers: Goal Conflict in Designing an Autonomous Artificia…

200 papers

The increasing prevalence of artificial agents creates a correspondingly increasing need to manage disagreements between humans and artificial agents, as well as between artificial agents themselves. Considering this larger space of…

Neurons and Cognition · Quantitative Biology 2023-10-23 Kerem Oktar , Ilia Sucholutsky , Tania Lombrozo , Thomas L. Griffiths

Artificial Intelligence (AI) systems are increasingly placed in positions where their decisions have real consequences, e.g., moderating online spaces, conducting research, and advising on policy. Ensuring they operate in a safe and…

Artificial Intelligence · Computer Science 2025-05-09 Joel Z. Leibo , Alexander Sasha Vezhnevets , William A. Cunningham , Sébastien Krier , Manfred Diaz , Simon Osindero

One of the most important aims of the fields of robotics, artificial intelligence and artificial life is the design and construction of systems and machines as versatile and as reliable as living organisms at performing high level…

Artificial Intelligence · Computer Science 2014-12-24 Hector Zenil

Artificial intelligence (AI) is a digital technology that will be of major importance for the development of humanity in the near future. AI has raised fundamental questions about what we should do with such systems, what the systems…

Computers and Society · Computer Science 2025-08-26 Vincent C. Müller

Researchers at artificial intelligence labs and universities are concerned that highly capable artificial intelligence (AI) systems may erode human control by pursuing instrumental goals. Existing mitigations remain largely technical and…

Artificial Intelligence · Computer Science 2026-02-03 Willem Fourie

A morally acceptable course of AI development should avoid two dangers: creating unaligned AI systems that pose a threat to humanity and mistreating AI systems that merit moral consideration in their own right. This paper argues these two…

Computers and Society · Computer Science 2025-10-16 Adam Bradley , Bradford Saad

The introduction of artificial intelligence into activities traditionally carried out by human beings produces brutal changes. This is not without consequences for human values. This paper is about designing and implementing models of…

Artificial Intelligence · Computer Science 2020-10-16 Fabrice Muhlenbach

Creating systems that are aligned with our goals is seen as a leading approach to create safe and beneficial AI in both leading AI companies and the academic field of AI safety. We defend the view that misaligned AGI - future, generally…

Computers and Society · Computer Science 2025-06-05 Max Hellrigel-Holderbaum , Leonard Dung

Artificial intelligence has advanced rapidly across perception, language, reasoning, and multimodal domains. Yet despite these achievements, modern AI systems remain fundamentally limited in their ability to self-monitor, self-correct, and…

Artificial Intelligence · Computer Science 2025-12-03 Noorbakhsh Amiri Golilarz , Sindhuja Penchala , Shahram Rahimi

Homogeneity and heterogeneity represent a well-known trade-off in the design of modular robot systems. This work addresses the heterogeneity concept, its rationales, design choices and performance evaluation. We introduce challenges for…

If autonomous AI systems are to be reliably safe in novel situations, they will need to incorporate general principles guiding them to recognize and avoid harmful behaviours. Such principles may need to be supported by a binding system of…

Computers and Society · Computer Science 2023-04-21 Ondrej Bajgar , Jan Horenovsky

The proliferation of Artificial Intelligence (AI) systems exhibiting complex and seemingly agentive behaviours necessitates a critical philosophical examination of their agency, autonomy, and moral status. In this paper we undertake a…

Computers and Society · Computer Science 2026-02-03 Paul Formosa , Inês Hipólito , Thomas Montefiore

As in any interaction process, misunderstandings, ambiguity, and failures to correctly understand the interaction partner are bound to happen in human-robot interaction. We term these failures 'conflicts' and are interested in both conflict…

Robotics · Computer Science 2020-01-01 Avinash Kumar Singh , Kai-Florian Richter

Recent developments in artificial intelligence (AI) have permeated through an array of different immersive environments, including virtual, augmented, and mixed realities. AI brings a wealth of potential that centers on its ability to…

Human-Computer Interaction · Computer Science 2024-05-10 Wangfan Li , Rohit Mallick , Carlos Toxtli-Hernandez , Christopher Flathmann , Nathan J. McNeese

In societies increasingly entangled with algorithms, our choices are constantly influenced and shaped by automated systems. This convergence highlights significant concerns for individual autonomy in the age of data-driven AI. It leads to…

Human-Computer Interaction · Computer Science 2024-11-11 Ge Wang , Roy Pea

Alignment of artificial intelligence (AI) encompasses the normative problem of specifying how AI systems should act and the technical problem of ensuring AI systems comply with those specifications. To date, AI alignment has generally…

Many assumptions that underpin human concepts of identity do not hold for machine minds that can be copied, edited, or simulated. We argue that there exist many different coherent identity boundaries (e.g.\ instance, model, persona), and…

Artificial Intelligence · Computer Science 2026-03-13 Raymond Douglas , Jan Kulveit , Ondrej Havlicek , Theia Pearson-Vogel , Owen Cotton-Barratt , David Duvenaud

Can AI agents deal with hard choices -- cases where options are incommensurable because multiple objectives are pursued simultaneously? Adopting a technologically engaged approach distinct from existing philosophical literature, I submit…

Artificial Intelligence · Computer Science 2026-04-21 Kangyu Wang

Artificial Intelligence (AI) is a double-edged sword: on one hand, AI promises to provide great advances that could benefit humanity, but on the other hand, AI poses substantial (even existential) risks. With advancements happening daily,…

Computers and Society · Computer Science 2024-02-05 Willem van der Maden , Derek Lomas , Malak Sadek , Paul Hekkert

Effective collaboration between humans and AI-based systems requires effective modeling of the human in the loop, both in terms of the mental state as well as the physical capabilities of the latter. However, these models can also open up…

Artificial Intelligence · Computer Science 2018-01-31 Tathagata Chakraborti , Subbarao Kambhampati