English
Related papers

Related papers: Two Body Problem: Collaborative Visual Task Comple…

200 papers

Current AI writing support tools are largely designed for individuals, complicating collaboration when co-writers must leave the shared workspace to use AI and then communicate and reintegrate results. We propose integrating AI agents…

Human-Computer Interaction · Computer Science 2026-02-24 Florian Lehmann , Krystsina Shauchenka , Daniel Buschek

In this work we create agents that can perform well beyond a single, individual task, that exhibit much wider generalisation of behaviour to a massive, rich space of challenges. We define a universe of tasks within an environment domain and…

In this paper, we introduce Watch-And-Help (WAH), a challenge for testing social intelligence in agents. In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently. To succeed, the AI agent needs to i)…

Artificial Intelligence · Computer Science 2021-05-04 Xavier Puig , Tianmin Shu , Shuang Li , Zilin Wang , Yuan-Hong Liao , Joshua B. Tenenbaum , Sanja Fidler , Antonio Torralba

Many tasks in AI require the collaboration of multiple agents. Typically, the communication protocol between agents is manually specified and not altered during training. In this paper we explore a simple neural model, called CommNet, that…

Machine Learning · Computer Science 2016-11-01 Sainbayar Sukhbaatar , Arthur Szlam , Rob Fergus

Learning to navigate in complex environments with dynamic elements is an important milestone in developing AI agents. In this work we formulate the navigation question as a reinforcement learning problem and show that data efficiency and…

The real world is awash with multi-agent problems that require collective action by self-interested agents, from the routing of packets across a computer network to the management of irrigation systems. Such systems have local incentives…

Multiagent Systems · Computer Science 2021-02-16 Michiel A. Bakker , Richard Everett , Laura Weidinger , Iason Gabriel , William S. Isaac , Joel Z. Leibo , Edward Hughes

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Doug Creighton , Saeid Nahavandi

We introduce the first goal-driven training for visual question answering and dialog agents. Specifically, we pose a cooperative 'image guessing' game between two agents -- Qbot and Abot -- who communicate in natural language dialog so that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-22 Abhishek Das , Satwik Kottur , José M. F. Moura , Stefan Lee , Dhruv Batra

Collaborative brain-computer interface (cBCI) that conduct motor imagery (MI) among multiple users has the potential not only to improve overall BCI performance by integrating information from multiple users, but also to leverage…

Human-Computer Interaction · Computer Science 2024-06-04 Shiwei Cheng , Jialing Wang

A growing field in robotics and Artificial Intelligence (AI) research is human-robot collaboration, whose target is to enable effective teamwork between humans and robots. However, in many situations human teams are still superior to…

Robotics · Computer Science 2017-11-27 Giovanni Saponaro , Lorenzo Jamone , Alexandre Bernardino , Giampiero Salvi

While there has been significant progress in curriculum learning and continuous learning for training agents to generalize across a wide variety of environments in the context of single-agent reinforcement learning, it is unclear if these…

Artificial Intelligence · Computer Science 2023-12-20 Rupali Bhati , Sai Krishna Gottipati , Clodéric Mars , Matthew E. Taylor

Securing coordination between AI agent and teammates (human players or AI agents) in contexts involving unfamiliar humans continues to pose a significant challenge in Zero-Shot Coordination. The issue of cooperative incompatibility becomes…

Artificial Intelligence · Computer Science 2024-03-01 Yang Li , Shao Zhang , Jichen Sun , Wenhao Zhang , Yali Du , Ying Wen , Xinbing Wang , Wei Pan

Human-guided robotic exploration is a useful approach to gathering information at remote locations, especially those that might be too risky, inhospitable, or inaccessible for humans. Maintaining common ground between the remotely-located…

Human-Computer Interaction · Computer Science 2023-10-27 Stephanie M. Lukin , Kimberly A. Pollard , Claire Bonial , Taylor Hudson , Ron Arstein , Clare Voss , David Traum

Achieving machine intelligence requires a smooth integration of perception and reasoning, yet models developed to date tend to specialize in one or the other; sophisticated manipulation of symbols acquired from rich perceptual spaces has so…

Machine Learning · Computer Science 2018-09-14 Eric Crawford , Guillaume Rabusseau , Joelle Pineau

Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous work on multi-agent transfer learning accommodate teams of different sizes, heavily relying on the…

Artificial Intelligence · Computer Science 2022-03-10 Rongjun Qin , Feng Chen , Tonghan Wang , Lei Yuan , Xiaoran Wu , Zongzhang Zhang , Chongjie Zhang , Yang Yu

Cooperative multi-agent reinforcement learning (MARL) aims to develop agents that can collaborate effectively. However, most cooperative MARL methods overfit training agents, making learned policies not generalize well to unseen…

Artificial Intelligence · Computer Science 2025-01-13 Kanefumi Matsuyama , Kefan Su , Jiangxing Wang , Deheng Ye , Zongqing Lu

As language and visual understanding by machines progresses rapidly, we are observing an increasing interest in holistic architectures that tightly interlink both modalities in a joint learning and inference process. This trend has allowed…

Artificial Intelligence · Computer Science 2021-08-23 Mateusz Malinowski , Mario Fritz

The intuitive collaboration of humans and intelligent robots (embodied AI) in the real-world is an essential objective for many desirable applications of robotics. Whilst there is much research regarding explicit communication, we focus on…

Robotics · Computer Science 2020-08-04 Ali Shafti , Jonas Tjomsland , William Dudley , A. Aldo Faisal

The interest in Artificial Intelligence (AI) and its applications has seen unprecedented growth in the last few years. The success can be partly attributed to the advancements of deep neural networks made in the sub-fields of AI such as…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Xuewen Yang

In an increasing number of AI scenarios, collaborations among different organizations or agents (e.g., human and robots, mobile units) are often essential to accomplish an organization-specific mission. However, to avoid leaking useful and…

Machine Learning · Computer Science 2020-12-08 Xun Xian , Xinran Wang , Jie Ding , Reza Ghanadan