English
Related papers

Related papers: Multi-Agent Cooperative Learning for Robust Vision…

200 papers

Attention models are widely used in Vision-language (V-L) tasks to perform the visual-textual correlation. Humans perform such a correlation with a strong linguistic understanding of the visual world. However, even the best performing…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Gouthaman KV , Athira Nambiar , Kancheti Sai Srinivas , Anurag Mittal

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

Machine Learning · Computer Science 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers

Active Multi-Object Tracking (AMOT) is a task where cameras are controlled by a centralized system to adjust their poses automatically and collaboratively so as to maximize the coverage of targets in their shared visual field. In AMOT, each…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Zeyu Fang , Jian Zhao , Mingyu Yang , Wengang Zhou , Zhenbo Lu , Houqiang Li

Vision-language models (VLMs) struggle in open-world applications, where out-of-distribution (OOD) concepts often trigger cross-modal alignment collapse and severely degrade zero-shot performance. We identify the root cause as modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Keze Wang

Model-agnostic meta-learners aim to acquire meta-learned parameters from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. With the flexibility in the choice of models, those frameworks demonstrate…

Machine Learning · Computer Science 2019-10-31 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

In the real world, unmanned surface vehicles (USV) often need to coordinate with each other to accomplish specific tasks. However, achieving cooperative control in multi-agent systems is challenging due to issues such as non-stationarity…

Robotics · Computer Science 2024-10-30 Y. Wang , Y. Zhao

Deep reinforcement learning (RL) has been applied extensively to solve complex decision-making problems. In many real-world scenarios, tasks often have several conflicting objectives and may require multiple agents to cooperate, which are…

Artificial Intelligence · Computer Science 2026-03-03 Tianmeng Hu , Biao Luo , Chunhua Yang , Tingwen Huang

Multi-agent distributed collaborative mapping provides comprehensive and efficient representations for robots. However, existing approaches lack instance-level awareness and semantic understanding of environments, limiting their…

Robotics · Computer Science 2025-09-03 Jianyu Dou , Yinan Deng , Jiahui Wang , Xingsi Tang , Yi Yang , Yufeng Yue

Multimodal Large Language Models (MLLMs) excel at descriptive tasks within images but often struggle with precise object localization, a critical element for reliable visual interpretation. In contrast, traditional object detection models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Jingru Yang , Huan Yu , Yang Jingxin , Chentianye Xu , Yin Biao , Yu Sun , Shengfeng He

Reaching consensus is key to multi-agent coordination. To accomplish a cooperative task, agents need to coherently select optimal joint actions to maximize the team reward. However, current cooperative multi-agent reinforcement learning…

Artificial Intelligence · Computer Science 2024-03-06 Liangzhou Wang , Kaiwen Zhu , Fengming Zhu , Xinghu Yao , Shujie Zhang , Deheng Ye , Haobo Fu , Qiang Fu , Wei Yang

Cooperative multi-agent learning plays a crucial role for developing effective strategies to achieve individual or shared objectives in multi-agent teams. In real-world settings, agents may face unexpected failures, such as a robot's leg…

Multiagent Systems · Computer Science 2024-07-30 Yasin Findik , Hunter Hasenfus , Reza Azadeh

Multi-agent collaboration has emerged as a pivotal paradigm for addressing complex, distributed tasks in large language model (LLM)-driven applications. While prior research has focused on high-level architectural frameworks, the granular…

Multiagent Systems · Computer Science 2025-05-20 Haochun Wang , Sendong Zhao , Jingbo Wang , Zewen Qiang , Bing Qin , Ting Liu

In this paper, we propose multi-agent automated machine learning (MA2ML) with the aim to effectively handle joint optimization of modules in automated machine learning (AutoML). MA2ML takes each machine learning module, such as data…

Machine Learning · Computer Science 2022-10-18 Zhaozhi Wang , Kefan Su , Jian Zhang , Huizhu Jia , Qixiang Ye , Xiaodong Xie , Zongqing Lu

In this article, we propose a centralized Multi-Agent Learning framework for learning a policy that models the simultaneous behavior of multiple agents that need to coordinate to solve a certain task. Centralized approaches often suffer…

Artificial Intelligence · Computer Science 2025-04-08 Ángel Aso-Mollar , Eva Onaindia

Aligning signals from different modalities is an important step in vision-language representation learning as it affects the performance of later stages such as cross-modality fusion. Since image and text typically reside in different…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jiali Duan , Liqun Chen , Son Tran , Jinyu Yang , Yi Xu , Belinda Zeng , Trishul Chilimbi

Real-world multi-agent tasks usually involve dynamic team composition with the emergence of roles, which should also be a key to efficient cooperation in multi-agent reinforcement learning (MARL). Drawing inspiration from the correlation…

Multiagent Systems · Computer Science 2024-03-05 Zican Hu , Zongzhang Zhang , Huaxiong Li , Chunlin Chen , Hongyu Ding , Zhi Wang

We study the problem of learning multi-task, multi-agent policies for cooperative, temporal objectives, under centralized training, decentralized execution. In this setting, using automata to represent tasks enables the decomposition of…

Multiagent Systems · Computer Science 2025-11-05 Beyazit Yalcinkaya , Marcell Vazquez-Chanlatte , Ameesh Shah , Hanna Krasowski , Sanjit A. Seshia

As large language model (LLM)-based multi-agent systems scale to handle increasingly complex tasks, balancing structural stability and dynamic adaptability becomes increasingly challenging. Existing systems typically adopt either…

Multiagent Systems · Computer Science 2026-05-26 Haoran Li , Shulun Chen , Shaoyuan Sun , Hanchen Wang