English
Related papers

Related papers: Active Asymmetric Multi-Agent Multimodal Learning …

200 papers

Modeling multi-agent systems requires understanding how agents interact. Such systems are often difficult to model because they can involve a variety of types of interactions that layer together to drive rich social behavioral dynamics.…

Machine Learning · Computer Science 2023-01-26 Fan-Yun Sun , Isaac Kauvar , Ruohan Zhang , Jiachen Li , Mykel Kochenderfer , Jiajun Wu , Nick Haber

Mathematical error detection in educational settings presents a significant challenge for Multimodal Large Language Models (MLLMs), requiring a sophisticated understanding of both visual and textual mathematical content along with complex…

Computation and Language · Computer Science 2025-05-21 Yibo Yan , Shen Wang , Jiahao Huo , Philip S. Yu , Xuming Hu , Qingsong Wen

Multi-Agent Reinforcement Learning (MARL) has gained significant traction for solving complex real-world tasks, but the inherent stochasticity and uncertainty in these environments pose substantial challenges to efficient and robust policy…

Machine Learning · Computer Science 2025-01-22 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

Multimodal AI models are increasingly used in fields like healthcare, finance, and autonomous driving, where information is drawn from multiple sources or modalities such as images, texts, audios, videos. However, effectively managing…

Machine Learning · Computer Science 2025-05-16 Grigor Bezirganyan , Sana Sellami , Laure Berti-Équille , Sébastien Fournier

As instruction-tuned large language models (LLMs) evolve, aligning pretrained foundation models presents increasing challenges. Existing alignment strategies, which typically leverage diverse and high-quality data sources, often overlook…

Computation and Language · Computer Science 2024-06-10 Yikun Wang , Rui Zheng , Liang Ding , Qi Zhang , Dahua Lin , Dacheng Tao

Multi-agent neural implicit mapping allows robots to collaboratively capture and reconstruct complex environments with high fidelity. However, existing approaches often rely on synchronous communication, which is impractical in real-world…

Robotics · Computer Science 2025-04-29 Hongrui Zhao , Boris Ivanovic , Negar Mehr

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

In multi-modal multi-agent trajectory forecasting, two major challenges have not been fully tackled: 1) how to measure the uncertainty brought by the interaction module that causes correlations among the predicted trajectories of multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bohan Tang , Yiqi Zhong , Chenxin Xu , Wei-Tao Wu , Ulrich Neumann , Yanfeng Wang , Ya Zhang , Siheng Chen

With a growing number of robots being deployed across diverse applications, robust multimodal anomaly detection becomes increasingly important. In robotic manipulation, failures typically arise from (1) robot-driven anomalies due to an…

Robotics · Computer Science 2025-06-25 Christoph Willibald , Daniel Sliwowski , Dongheui Lee

Agentic methods have emerged as a powerful and autonomous paradigm that enhances reasoning, collaboration, and adaptive control, enabling systems to coordinate and independently solve complex tasks. We extend this paradigm to safety…

Artificial Intelligence · Computer Science 2025-10-30 Juan Ren , Mark Dras , Usman Naseem

Agent unified modeling languages (AUML) are agent-oriented approaches that supports the specification, design, visualization and documentation of an agent-based system. This paper presents the use of Prometheus AUML approach for the…

Multiagent Systems · Computer Science 2021-02-26 Kennedy E. Ehimwenma , Sujatha Krishnamoorthy

Human behavior in interactive settings is shaped not only by individual objectives but also by shared constraints with others, such as safety. Understanding how people allocate responsibility, i.e., how much one deviates from their desired…

Multiagent Systems · Computer Science 2026-04-16 Isaac Remy , Caleb Chang , Karen Leung

Multi-agent multi-objective systems (MAMOS) have emerged as powerful frameworks for modelling complex decision-making problems across various real-world domains, such as robotic exploration, autonomous traffic management, and sensor network…

Multiagent Systems · Computer Science 2025-11-13 Zhuhui Li , Chunbo Luo , Liming Huang , Luyu Qi , Geyong Min

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

This paper introduces a novel Multi-Agent Cooperative Learning (MACL) framework to address cross-modal alignment collapse in vision-language models when handling out-of-distribution (OOD) concepts. Four core agents, including image, text,…

Multiagent Systems · Computer Science 2026-04-08 Philip Xu

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

Robotics · Computer Science 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Robots can rapidly acquire new skills from demonstrations. However, during generalisation of skills or transitioning across fundamentally different skills, it is unclear whether the robot has the necessary knowledge to perform the task.…

Machine Learning · Statistics 2018-08-08 Nutan Chen , Alexej Klushyn , Alexandros Paraschos , Djalel Benbouzid , Patrick van der Smagt

Human intuition allows to detect abnormal driving scenarios in situations they never experienced before. Like humans detect those abnormal situations and take countermeasures to prevent collisions, self-driving cars need anomaly detection…

Robotics · Computer Science 2022-09-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance…

Machine Learning · Computer Science 2019-06-27 Tung-Long Vuong , Kenneth Tran

Model fusion is a key strategy for robust recognition in unconstrained scenarios, as different models provide complementary strengths. This is especially important for whole-body human recognition, where biometric cues such as face, gait,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jie Zhu , Xiao Guo , Yiyang Su , Anil Jain , Xiaoming Liu