English
Related papers

Related papers: Adversarial Attacks in Cooperative AI

200 papers

We study the emergence of cooperative behaviors in reinforcement learning agents by introducing a challenging competitive multi-agent soccer environment with continuous simulated physics. We demonstrate that decentralized, population-based…

Artificial Intelligence · Computer Science 2021-05-21 Siqi Liu , Guy Lever , Josh Merel , Saran Tunyasuvunakool , Nicolas Heess , Thore Graepel

With the recent development of natural language generation models - termed as large language models (LLMs) - a potential use case has opened up to improve the way that humans interact with robot assistants. These LLMs should be able to…

Multiagent Systems · Computer Science 2024-11-27 Mitchell Rosser , Marc. G Carmichael

The trajectory of AI development suggests that we will increasingly rely on agent-based systems composed of independently developed agents with different information, privileges, and tools. The success of these systems will critically…

Artificial Intelligence · Computer Science 2025-11-05 Tim R. Davidson , Adam Fourney , Saleema Amershi , Robert West , Eric Horvitz , Ece Kamar

This paper tackles the critical challenge of human-AI complementarity in decision-making. Departing from the traditional focus on algorithmic performance in favor of performance of the human-AI team, and moving past the framing of…

Artificial Intelligence · Computer Science 2025-11-04 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga

Adversarial training can improve the robustness of neural networks. Previous methods focus on a single adversarial training strategy and do not consider the model property trained by different strategies. By revisiting the previous methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xingbin Liu , Huafeng Kuang , Xianming Lin , Yongjian Wu , Rongrong Ji

Contemporary machine learning paradigm excels in statistical data analysis, solving problems that classical AI couldn't. However, it faces key limitations, such as a lack of integration with planning, incomprehensible internal structure,…

Artificial Intelligence · Computer Science 2025-01-29 Zeki Doruk Erden , Boi Faltings

As multi-agent AI systems become increasingly autonomous, evidence shows they can develop collusive strategies similar to those long observed in human markets and institutions. While human domains have accumulated centuries of…

Multiagent Systems · Computer Science 2026-05-19 Jamiu Idowu , Ahmed Almasoud , Ayman Alfahid

Effective collaboration between humans and AI-based systems requires effective modeling of the human in the loop, both in terms of the mental state as well as the physical capabilities of the latter. However, these models can also open up…

Artificial Intelligence · Computer Science 2018-01-31 Tathagata Chakraborti , Subbarao Kambhampati

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through…

Cryptography and Security · Computer Science 2024-12-19 Yifeng He , Ethan Wang , Yuyang Rong , Zifei Cheng , Hao Chen

Current approaches to learning cooperative multi-agent behaviors assume relatively restrictive settings. In standard fully cooperative multi-agent reinforcement learning, the learning algorithm controls $\textit{all}$ agents in the…

Artificial Intelligence · Computer Science 2025-08-19 Caroline Wang , Arrasy Rahman , Ishan Durugkar , Elad Liebman , Peter Stone

Collaborative AI systems (CAISs) aim at working together with humans in a shared space to achieve a common goal. This critical setting yields hazardous circumstances that could harm human beings. Thus, building such systems with strong…

Human-Computer Interaction · Computer Science 2022-09-23 Jubril Gbolahan Adigun , Matteo Camilli , Michael Felderer , Andrea Giusti , Dominik T Matt , Anna Perini , Barbara Russo , Angelo Susi

The next step for intelligent dialog agents is to escape their role as silent bystanders and become proactive. Well-defined proactive behavior may improve human-machine cooperation, as the agent takes a more active role during interaction…

Computation and Language · Computer Science 2023-06-23 Matthias Kraus , Nicolas Wagner , Ron Riekenbrauck , Wolfgang Minker

Most AI systems today are designed to manage tasks and execute predefined steps. This makes them effective for process coordination but limited in their ability to engage in joint problem-solving with humans or contribute new ideas. We…

Human-Computer Interaction · Computer Science 2026-02-03 Kexin Quan , Dina Albassam , Mengke Wu , Zijian Ding , Jessie Chin

Communication could potentially be an effective way for multi-agent cooperation. However, information sharing among all agents or in predefined communication architectures that existing methods adopt can be problematic. When there is a…

Artificial Intelligence · Computer Science 2018-11-26 Jiechuan Jiang , Zongqing Lu

In recent years, peer learning has gained attention as a method that promotes spontaneous thinking among learners, and its effectiveness has been confirmed by numerous studies. This study aims to develop an AI Agent as a learning companion…

Artificial Intelligence · Computer Science 2025-07-18 Sosui Moribe , Taketoshi Ushiama

Existing approaches in reinforcement learning train an agent to learn desired optimal behavior in an environment with rule based surrounding agents. In safety critical applications such as autonomous driving it is crucial that the rule…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Arjun Srinivasan , Anubhav Paras , Aniket Bera

Many potential applications of reinforcement learning in the real world involve interacting with other agents whose numbers vary over time. We propose new neural policy architectures for these multi-agent problems. In contrast to other…

Machine Learning · Computer Science 2019-06-03 Matthew A. Wright , Roberto Horowitz

Many machine learning classifiers are vulnerable to adversarial perturbations. An adversarial perturbation modifies an input to change a classifier's prediction without causing the input to seem substantially different to human perception.…

Machine Learning · Computer Science 2017-03-27 Dan Hendrycks , Kevin Gimpel

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

Human-Computer Interaction · Computer Science 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

Multiagent Systems · Computer Science 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed