English
Related papers

Related papers: We Need Accountability in Human-AI Agent Relations…

200 papers

The deployment of capable AI agents raises fresh questions about safety, human-machine relationships and social coordination. We argue for greater engagement by scientists, scholars, engineers and policymakers with the implications of a…

Computers and Society · Computer Science 2025-09-15 Iason Gabriel , Geoff Keeling , Arianna Manzini , James Evans

AI systems are becoming increasingly complex, ubiquitous and autonomous, leading to increasing concerns about their impacts on individuals and society. In response, researchers have begun investigating how to ensure that the methods…

Multiagent Systems · Computer Science 2026-04-09 Stephen Cranefield , Nir Oren

AI agents that take actions in their environment autonomously over extended time horizons require robust governance interventions to curb their potentially consequential risks. Prior proposals for governing AI agents primarily target…

Computers and Society · Computer Science 2025-12-02 K. J. Kevin Feng , Tae Soo Kim , Rock Yuren Pang , Faria Huq , Tal August , Amy X. Zhang

From its inception, AI has had a rather ambivalent relationship with humans -- swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI…

Artificial Intelligence · Computer Science 2024-05-28 Sarath Sreedharan , Anagha Kulkarni , Subbarao Kambhampati

With humans interacting with AI-based systems at an increasing rate, it is necessary to ensure the artificial systems are acting in a manner which reflects understanding of the human. In the case of humans and artificial AI agents operating…

Human-Computer Interaction · Computer Science 2023-02-03 Andrew Fuchs , Andrea Passarella , Marco Conti

Humans strive to design safe AI systems that align with our goals and remain under our control. However, as AI capabilities advance, we face a new challenge: the emergence of deeper, more persistent relationships between humans and AI…

Human-Computer Interaction · Computer Science 2025-02-05 Hannah Rose Kirk , Iason Gabriel , Chris Summerfield , Bertie Vidgen , Scott A. Hale

The AI we use is powerful, and its power is increasing rapidly. If this powerful AI is to serve the needs of consumers, voters, and decision makers, then it is imperative that the AI is accountable. In general, an agent is accountable to a…

Artificial Intelligence · Computer Science 2025-10-31 Andrew L. Kun

This position paper states that AI Alignment in Multi-Agent Systems (MAS) should be considered a dynamic and interaction-dependent process that heavily depends on the social environment where agents are deployed, either collaborative,…

Artificial Intelligence · Computer Science 2025-06-09 Florian Carichon , Aditi Khandelwal , Marylou Fauchard , Golnoosh Farnadi

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

I am a person and so are you. Philosophically we sometimes grant personhood to non-human animals, and entities such as sovereign states or corporations can legally be considered persons. But when, if ever, should we ascribe personhood to AI…

Artificial Intelligence · Computer Science 2025-01-24 Francis Rhys Ward

Our ability to build autonomous agents that leverage Generative AI continues to increase by the day. As builders and users of such agents it is unclear what parameters we need to align on before the agents start performing tasks on our…

Artificial Intelligence · Computer Science 2024-04-09 Nitesh Goyal , Minsuk Chang , Michael Terry

Recent works have recognized the need for human-centered perspectives when designing and evaluating human-AI interactions and explainable AI methods. Yet, current approaches fall short at intercepting and managing unexpected user behavior…

Human-Computer Interaction · Computer Science 2022-05-04 Michaela Benk , Raphael Weibel , Andrea Ferrario

As Generative AI systems increasingly engage in long-term, personal, and relational interactions, human-AI engagements are becoming significantly complex, making them more challenging to understand and govern. These Interactive AI systems…

Computers and Society · Computer Science 2025-08-26 Yulu Pi , Cagatay Turkay , Daniel Bogiatzis-Gibbons

We study the problem of designing AI agents that can robustly cooperate with people in human-machine partnerships. Our work is inspired by real-life scenarios in which an AI agent, e.g., a virtual assistant, has to cooperate with new users…

Machine Learning · Computer Science 2020-06-17 Ahana Ghosh , Sebastian Tschiatschek , Hamed Mahdavi , Adish Singla

In the rapidly evolving field of artificial intelligence (AI) agents, designing the agent's characteristics is crucial for shaping user experience. This workshop aims to establish a research community focused on AI agent persona design for…

Human-Computer Interaction · Computer Science 2024-10-31 Nima Zargham , Mateusz Dubiel , Smit Desai , Thomas Mildner , Hanz-Joachim Belz

Agentic AI seeks to endow systems with sustained autonomy, reasoning, and interaction capabilities. To realize this vision, its assumptions about agency must be complemented by explicit models of cognition, cooperation, and governance. This…

Artificial Intelligence · Computer Science 2026-02-11 Virginia Dignum , Frank Dignum

Human computer interaction is shifting from screen-based systems to multimodal interfaces where artificial intelligence powered systems increasingly interpret user intent through speech, gesture, and gaze. Yet users rarely understand how…

Human-Computer Interaction · Computer Science 2026-05-05 Ankur Bhatt , Sven Mayer

AI is transforming the healthcare domain and is increasingly helping practitioners to make health-related decisions. Therefore, accountability becomes a crucial concern for critical AI-driven decisions. Although regulatory bodies, such as…

Artificial Intelligence · Computer Science 2025-09-04 Prachi Bagave , Marcus Westberg , Marijn Janssen , Aaron Yi Ding

As artificial intelligence (AI) systems rapidly gain autonomy, the need for robust responsible AI frameworks becomes paramount. This paper investigates how organizations perceive and adapt such frameworks amidst the emerging landscape of…

Computers and Society · Computer Science 2025-04-17 Lee Ackerman
‹ Prev 1 2 3 10 Next ›