English
Related papers

Related papers: Symmetry-Breaking Augmentations for Ad Hoc Teamwor…

200 papers

In the future, artificial learning agents are likely to become increasingly widespread in our society. They will interact with both other learning agents and humans in a variety of complex settings including social dilemmas. We argue that…

Artificial Intelligence · Computer Science 2022-02-22 Tobias Baumann

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

People frequently face challenging decision-making problems in which outcomes are uncertain or unknown. Artificial intelligence (AI) algorithms exist that can outperform humans at learning such tasks. Thus, there is an opportunity for AI…

Artificial Intelligence · Computer Science 2018-12-27 Ravi Pandya , Sandy H. Huang , Dylan Hadfield-Menell , Anca D. Dragan

The cooperation among AI systems, and between AI systems and humans is becoming increasingly important. In various real-world tasks, an agent needs to cooperate with unknown partner agent types. This requires the agent to assess the…

Machine Learning · Computer Science 2021-10-05 Antti Keurulainen , Isak Westerlund , Ariel Kwiatkowski , Samuel Kaski , Alexander Ilin

As AI usage becomes more prevalent in social contexts, understanding agent-user interaction is critical to designing systems that improve both individual and group outcomes. We present an online behavioral experiment (N = 243) in which…

Computer Science and Game Theory · Computer Science 2026-02-16 Kehang Zhu , Nithum Thain , Vivian Tsai , James Wexler , Crystal Qian

Recent superhuman results in games have largely been achieved in a variety of zero-sum settings, such as Go and Poker, in which agents need to compete against others. However, just like humans, real-world AI systems have to coordinate and…

Artificial Intelligence · Computer Science 2019-12-06 Adam Lerer , Hengyuan Hu , Jakob Foerster , Noam Brown

Artificial intelligence (AI) has revolutionized human cognitive abilities and facilitated the development of new AI entities capable of interacting with humans in both physical and virtual environments. Despite the existence of virtual…

Human-Computer Interaction · Computer Science 2024-01-30 Zhenliang Zhang , Zeyu Zhang , Ziyuan Jiao , Yao Su , Hangxin Liu , Wei Wang , Song-Chun Zhu

As AI technology continues to develop, more and more agents will become capable of long term autonomy alongside people. Thus, a recent line of research has studied the problem of teaching autonomous agents the concept of ethics and human…

Computers and Society · Computer Science 2019-05-03 Shani Alkoby , Avilash Rath , Peter Stone

A leading proposal for aligning artificial superintelligence (ASI) is to use AI agents to automate an increasing fraction of alignment research as capabilities improve. We argue that, even when research agents are not scheming to…

Artificial Intelligence · Computer Science 2026-05-18 Aleksandr Bowkis , Marie Davidsen Buhl , Jacob Pfau , Geoffrey Irving

With recent advancements in AI and computation tools, intelligent paradigms emerged to empower different fields such as healthcare robots with new capabilities. Advanced AI robotic algorithms (e.g., reinforcement learning) can be trained…

Robotics · Computer Science 2024-07-25 Reza Abiri , Ali Rabiee , Sima Ghafoori , Anna Cetera

While we would like agents that can coordinate with humans, current algorithms such as self-play and population-based training create agents that can coordinate with themselves. Agents that assume their partner to be optimal or similar to…

Machine Learning · Computer Science 2020-01-10 Micah Carroll , Rohin Shah , Mark K. Ho , Thomas L. Griffiths , Sanjit A. Seshia , Pieter Abbeel , Anca Dragan

Recent work has shown that, in classification tasks, it is possible to design decision support systems that do not require human experts to understand when to cede agency to a classifier or when to exercise their own agency to achieve…

Machine Learning · Computer Science 2025-10-21 Eleni Straitouri , Stratis Tsirtsis , Ander Artola Velasco , Manuel Gomez-Rodriguez

This paper tackles the critical challenge of human-AI complementarity in decision-making. Departing from the traditional focus on algorithmic performance in favor of performance of the human-AI team, and moving past the framing of…

Artificial Intelligence · Computer Science 2025-11-04 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga

Ensuring robust decision-making in multi-agent systems is challenging when agents have distinct, possibly conflicting objectives and lack full knowledge of each other's strategies. This is apparent in safety-critical applications such as…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Francesco Bianchin , Robert Lefringhausen , Elisa Gaetan , Samuel Tesfazgi , Sandra Hirche

Artificial intelligence is undergoing a structural transformation marked by the rise of agentic systems capable of open-ended action trajectories, generative representations and outputs, and evolving objectives. These properties introduce…

Artificial Intelligence · Computer Science 2026-03-06 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang

Foundation models have rapidly advanced AI, raising the question of whether their decisions will ultimately surpass human strategies in real-world domains. The exponential, and possibly super-exponential, pace of AI development makes such…

Machine Learning · Computer Science 2025-12-02 Moein E. Samadi , Andreas Schuppert

AI support of collaborative interactions entails mediating potential misalignment between interlocutor beliefs. Common preference alignment methods like DPO excel in static settings, but struggle in dynamic collaborative tasks where the…

Computation and Language · Computer Science 2025-05-27 Abhijnan Nath , Carine Graff , Andrei Bachinin , Nikhil Krishnaswamy

While the complexity of 21st-century demands has promoted pedagogical approaches to foster complex competencies, a persistent gap remains between in-class learning activities and individualized learning or assessment practices. To address…

Human-Computer Interaction · Computer Science 2025-06-09 Eunhye Grace Ko , Soo Hyoung Joo

Due to the continuously changing environment of service-based applications (SBAs), the ability to adapt to environmental and contextual changes has become a crucial characteristic of such applications. Providing SBAs with this ability is a…

Software Engineering · Computer Science 2021-05-04 Kavan Sedighiani , Saeed Shokrollahi , Fereidoon Shams

Balancing user agency and system automation is essential for effective human-AI interactions. Fully automated systems can deliver efficiency but risk undermining usability and user autonomy, while purely manual tools are often inefficient…

Human-Computer Interaction · Computer Science 2025-02-20 Thomas Langerak