English
Related papers

Related papers: Teaching Social Behavior through Human Reinforceme…

200 papers

Modern Reinforcement Learning (RL) algorithms are able to outperform humans in a wide variety of tasks. Multi-agent reinforcement learning (MARL) settings present additional challenges, and successful cooperation in mixed-motive groups of…

Multiagent Systems · Computer Science 2024-06-25 Ram Rachum , Yonatan Nakar , Bill Tomlinson , Nitay Alon , Reuth Mirsky

A key goal of ad hoc teamwork is to develop a learning agent that cooperates with unknown teams, without resorting to any pre-coordination protocol. Despite a vast number of ad hoc teamwork algorithms in the literature, most of them cannot…

Multiagent Systems · Computer Science 2022-05-09 Alexandre Neves , Alberto Sardinha

An ambitious goal for machine learning is to create agents that behave ethically: The capacity to abide by human moral norms would greatly expand the context in which autonomous agents could be practically and safely deployed, e.g. fully…

Artificial Intelligence · Computer Science 2021-07-21 Adrien Ecoffet , Joel Lehman

Planning for ad hoc teamwork is challenging because it involves agents collaborating without any prior coordination or communication. The focus is on principled methods for a single agent to cooperate with others. This motivates…

Multiagent Systems · Computer Science 2014-09-02 Muthukumaran Chandrasekaran , Prashant Doshi , Yifeng Zeng , Yingke Chen

Teamwork is a set of interrelated reasoning, actions and behaviors of team members that facilitate common objectives. Teamwork theory and experiments have resulted in a set of states and processes for team effectiveness in both human-human…

Robotics · Computer Science 2021-03-09 Tianwei Ni , Huao Li , Siddharth Agrawal , Suhas Raja , Fan Jia , Yikang Gui , Dana Hughes , Michael Lewis , Katia Sycara

Human interactions are influenced by emotions, temperament, and affection, often conflicting with individuals' underlying preferences. Without explicit knowledge of those preferences, judging whether behaviour is appropriate becomes…

Computer Science and Game Theory · Computer Science 2025-11-05 Victor Villin , Christos Dimitrakakis

Constructing a universal moral code for artificial intelligence (AI) is difficult or even impossible, given that different human cultures have different definitions of morality and different societal norms. We therefore argue that the value…

In multi-agent reinforcement learning, the cooperative learning behavior of agents is very important. In the field of heterogeneous multi-agent reinforcement learning, cooperative behavior among different types of agents in a group is…

Artificial Intelligence · Computer Science 2021-04-14 Taeyoung Kim , Luiz Felipe Vecchietti , Kyujin Choi , Sanem Sariel , Dongsoo Har

With humans interacting with AI-based systems at an increasing rate, it is necessary to ensure the artificial systems are acting in a manner which reflects understanding of the human. In the case of humans and artificial AI agents operating…

Human-Computer Interaction · Computer Science 2023-02-03 Andrew Fuchs , Andrea Passarella , Marco Conti

Increasing interest in ensuring the safety of next-generation Artificial Intelligence (AI) systems calls for novel approaches to embedding morality into autonomous agents. This goal differs qualitatively from traditional task-specific AI…

Artificial Intelligence · Computer Science 2025-01-17 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

As AI agents are increasingly used in high-stakes domains like healthcare and law enforcement, aligning their behaviour with social, legal, ethical, empathetic, and cultural (SLEEC) norms has become a critical engineering challenge. While…

Artificial Intelligence · Computer Science 2026-03-13 Radu Calinescu , Ana Cavalcanti , Marsha Chechik , Lina Marsso , Beverley Townsend

Multi-agent models are a suitable starting point to model complex social interactions. However, as the complexity of the systems increase, we argue that novel modeling approaches are needed that can deal with inter-dependencies at different…

Artificial Intelligence · Computer Science 2018-09-25 Frank Dignum

We focus on how individual behavior that complies with social norms interferes with performance-based incentive mechanisms in organizations with multiple distributed decision-making agents. We model social norms to emerge from interactions…

General Economics · Economics 2021-02-25 Ravshanbek Khodzhimatov , Stephan Leitner , Friederike Wall

This paper is concerned with evaluating different multiagent learning (MAL) algorithms in problems where individual agents may be heterogenous, in the sense of utilizing different learning strategies, without the opportunity for prior…

Multiagent Systems · Computer Science 2019-07-23 Stefano V. Albrecht , Subramanian Ramamoorthy

The rise of artificial intelligence (A.I.) based systems is already offering substantial benefits to the society as a whole. However, these systems may also enclose potential conflicts and unintended consequences. Notably, people will tend…

Computers and Society · Computer Science 2020-12-23 Pedro Fernandes , Francisco C. Santos , Manuel Lopes

Real-time collaboration with humans poses challenges due to the different behavior patterns of humans resulting from diverse physical constraints. Existing works typically focus on learning safety constraints for collaboration, or how to…

Robotics · Computer Science 2024-03-06 Shibei Zhu , Tran Nguyen Le , Samuel Kaski , Ville Kyrki

The introduction of artificial intelligence (AI) agents into human group settings raises essential questions about how these novel participants influence cooperative social norms. While previous studies on human-AI cooperation have…

Artificial Intelligence · Computer Science 2026-01-30 Nico Mutzner , Taha Yasseri , Heiko Rauhut

People frequently face challenging decision-making problems in which outcomes are uncertain or unknown. Artificial intelligence (AI) algorithms exist that can outperform humans at learning such tasks. Thus, there is an opportunity for AI…

Artificial Intelligence · Computer Science 2018-12-27 Ravi Pandya , Sandy H. Huang , Dylan Hadfield-Menell , Anca D. Dragan

In collaborative tasks, autonomous agents fall short of humans in their capability to quickly adapt to new and unfamiliar teammates. We posit that a limiting factor for zero-shot coordination is the lack of shared task abstractions, a…

Multiagent Systems · Computer Science 2025-05-08 Stéphane Aroca-Ouellette , Miguel Aroca-Ouellette , Katharina von der Wense , Alessandro Roncone

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques