English
Related papers

Related papers: We Need Accountability in Human-AI Agent Relations…

200 papers

Ensuring fairness in decentralized multi-agent systems presents significant challenges due to emergent biases, systemic inefficiencies, and conflicting agent incentives. This paper provides a comprehensive survey of fairness in multi-agent…

Multiagent Systems · Computer Science 2025-03-04 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

The need for AI systems to provide explanations for their behaviour is now widely recognised as key to their adoption. In this paper, we examine the problem of trustworthy AI and explore what delivering this means in practice, with a focus…

Artificial Intelligence · Computer Science 2022-11-30 Rob Procter , Peter Tolmie , Mark Rouncefield

What is agency, and why does it matter? In this work, we draw from the political science and philosophy literature and give two competing visions of what it means to be an (ethical) agent. The first view, which we term mechanistic, is…

Computers and Society · Computer Science 2024-04-23 Jessica Dai

As AI is increasingly being adopted into application solutions, the challenge of supporting interaction with humans is becoming more apparent. Partly this is to support integrated working styles, in which humans and intelligent systems…

Artificial Intelligence · Computer Science 2017-10-02 Maria Fox , Derek Long , Daniele Magazzeni

Existing accountability frameworks for AI systems, legal, ethical, and regulatory, rest on a shared assumption: for any consequential outcome, at least one identifiable person had enough involvement and foresight to bear meaningful…

Artificial Intelligence · Computer Science 2026-04-10 Haileleol Tibebu

As the deployment of artificial intelligence (AI) is changing many fields and industries, there are concerns about AI systems making decisions and recommendations without adequately considering various ethical aspects, such as…

Computers and Society · Computer Science 2023-10-02 Conrad Sanderson , Qinghua Lu , David Douglas , Xiwei Xu , Liming Zhu , Jon Whittle

AI agents are able to tackle increasingly complex tasks. To achieve more ambitious goals, AI agents need to be able to meaningfully decompose problems into manageable sub-components, and safely delegate their completion across to other AI…

Artificial Intelligence · Computer Science 2026-02-13 Nenad Tomašev , Matija Franklin , Simon Osindero

AI systems have long been expected to interact with users, answering questions, generating content, and continuing (social) conversations. Agentic AI, however, breaks from this expectation, as its primary objective is workflow execution on…

Human-Computer Interaction · Computer Science 2026-05-05 Eunchae Jang , S. Shyam Sundar

Existing approaches for generating human-aware agent behaviors have considered different measures of interpretability in isolation. Further, these measures have been studied under differing assumptions, thus precluding the possibility of…

Artificial Intelligence · Computer Science 2021-04-23 Sarath Sreedharan , Anagha Kulkarni , David E. Smith , Subbarao Kambhampati

Autonomy is a double-edged sword for AI agents, simultaneously unlocking transformative possibilities and serious risks. How can agent developers calibrate the appropriate levels of autonomy at which their agents should operate? We argue…

Human-Computer Interaction · Computer Science 2025-07-29 K. J. Kevin Feng , David W. McDonald , Amy X. Zhang

Individuals are turning to increasingly anthropomorphic, general-purpose chatbots for AI companionship, rather than roleplay-specific platforms. However, not much is known about how individuals perceive and conduct their relationships with…

In order to have effective human-AI collaboration, it is necessary to address how the AI agent's behavior is being perceived by the humans-in-the-loop. When the agent's task plans are generated without such considerations, they may often…

Artificial Intelligence · Computer Science 2019-03-15 Anagha Kulkarni , Yantian Zha , Tathagata Chakraborti , Satya Gautam Vadlamudi , Yu Zhang , Subbarao Kambhampati

Deployed, autonomous AI systems must often evaluate multiple plausible courses of action (extended sequences of behavior) in novel or under-specified contexts. Despite extensive training, these systems will inevitably encounter scenarios…

Artificial Intelligence · Computer Science 2025-11-19 Steven J. Jones , Robert E. Wray , John E. Laird

Artificial Intelligence (AI) agents capable of autonomous learning and independent decision-making hold great promise for addressing complex challenges across various critical infrastructure domains, including transportation, energy…

Multiagent Systems · Computer Science 2025-07-02 Hepeng Li , Yuhong Liu , Jun Yan , Jie Gao , Xiaoou Yang

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

Machine learning has been applied to a number of creative, design-oriented tasks. However, it remains unclear how to best empower human users with these machine learning approaches, particularly those users without technical expertise. In…

Human-Computer Interaction · Computer Science 2019-03-26 Matthew Guzdial , Mark Riedl

Current societal challenges exceed the capacity of humans operating either alone or collectively. As AI evolves, its role within human collectives will vary from an assistive tool to a participatory member. Humans and AI possess…

Computers and Society · Computer Science 2024-11-26 Hao Cui , Taha Yasseri

This paper develops a control-theoretic framework for analyzing agentic systems embedded within feedback control loops, where an AI agent may adapt controller parameters, select among control strategies, invoke external tools, reconfigure…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Ali Eslami , Jiangbo Yu

According to several empirical investigations, despite enhancing human capabilities, human-AI cooperation frequently falls short of expectations and fails to reach true synergy. We propose a task-driven framework that reverses prevalent…

Computers and Society · Computer Science 2026-05-26 Saleh Afroogh , Kush R. Varshney , Jason D'Cruz

Agent-based modelling is a powerful tool when simulating human systems, yet when human behaviour cannot be described by simple rules or maximising one's own profit, we quickly reach the limits of this methodology. Machine learning has the…

Multiagent Systems · Computer Science 2022-01-21 Georg Jäger , Daniel Reisinger