English
Related papers

Related papers: ConSensus: Multi-Agent Collaboration for Multimoda…

200 papers

The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assume access to all…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuxing Chen , Maofan Zhao , Lorenzo Bruzzone

Multimodal large language models (MLLMs) achieve strong performance by jointly processing inputs from multiple modalities, such as vision, audio, and language. However, building such models or extending them to new modalities often requires…

Machine Learning · Computer Science 2026-03-24 Md Kaykobad Reza , Ameya Patil , Edward Ayrapetian , M. Salman Asif

Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents: small errors compound across steps, and even state-of-the-art models often hallucinate or lose coherence. We identify…

Artificial Intelligence · Computer Science 2025-10-13 Guangya Wan , Mingyang Ling , Xiaoqi Ren , Rujun Han , Sheng Li , Zizhao Zhang

The unprecedented advancements in Multimodal Large Language Models (MLLMs) have demonstrated strong potential in interacting with humans through both language and visual inputs to perform downstream tasks such as visual question answering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Wenjia Xu , Zijian Yu , Boyang Mu , Zhiwei Wei , Yuanben Zhang , Guangzuo Li , Jiuniu Wang , Mugen Peng

Large Language Models (LLMs) have achieved high accuracy on complex commonsense and mathematical problems that involve the composition of multiple reasoning steps. However, current compositional benchmarks testing these skills tend to focus…

Computation and Language · Computer Science 2026-05-26 Lisa Alazraki , Lihu Chen , Ana Brassard , Joe Stacey , Hossein A. Rahmani , Marek Rei

Large Language Model (LLM)-based agents significantly extend the utility of LLMs by interacting with dynamic environments. However, enabling agents to continually learn new tasks without catastrophic forgetting remains a critical challenge,…

Computation and Language · Computer Science 2026-04-14 Zheng Wu , Xingyu Lou , Xinbei Ma , Yansi Li , Weiwen Liu , Weinan Zhang , Jun Wang , Zhuosheng Zhang

To improve the reasoning and question-answering capabilities of Large Language Models (LLMs), several multi-agent approaches have been introduced. While these methods enhance performance, the application of collective intelligence-based…

Artificial Intelligence · Computer Science 2024-07-10 Ciaran Regan , Alexandre Gournail , Mizuki Oka

Multimodal large language models (MLLMs) promise enhanced reasoning by integrating diverse inputs such as text, vision, and audio. Yet cross-modal reasoning remains underexplored, with conflicting reports on whether added modalities help or…

Computation and Language · Computer Science 2026-05-01 Yucheng Wang , Yifan Hou , Aydin Javadov , Mubashara Akhtar , Mrinmaya Sachan

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

Large language models (LLMs) often struggle with complex reasoning tasks due to their limitations in addressing the vast reasoning space and inherent ambiguities of natural language. We propose the Mixture-of-Search-Agents (MoSA) paradigm,…

Artificial Intelligence · Computer Science 2025-02-27 Sen Yang , Yafu Li , Wai Lam , Yu Cheng

Traditional single-modal sensing systems-based solely on either radio frequency (RF) or visual data-struggle to cope with the demands of complex and dynamic environments. Furthermore, single-device systems are constrained by limited…

Signal Processing · Electrical Eng. & Systems 2025-06-02 Yubo Peng , Luping Xiang , Bingxin Zhang , Kun Yang

Autonomous agents utilizing Large Language Models (LLMs) have demonstrated remarkable capabilities in isolated medical tasks like diagnosis and image analysis, but struggle with integrated clinical workflows that connect diagnostic…

Artificial Intelligence · Computer Science 2025-10-14 Hongjie Zheng , Zesheng Shi , Ping Yi

With recent breakthroughs in large language models (LLMs) for reasoning, planning, and complex task generation, artificial intelligence systems are transitioning from isolated single-agent architectures to multi-agent systems with…

Artificial Intelligence · Computer Science 2026-02-17 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou

With the growing prevalence of multimodal news content, effective news topic classification demands models capable of jointly understanding and reasoning over heterogeneous data such as text and images. Existing methods often process…

Computation and Language · Computer Science 2026-04-07 Tailong Luo , Hao Li , Rong Fu , Xinyue Jiang , Huaxuan Ding , Yiduo Zhang , Zilin Zhao , Simon Fong , Guangyin Jin , Jianyuan Ni

Predicting group behavior, how individuals coordinate, communicate, and interact during collaborative tasks, is essential for designing systems that can support team performance through real-time prediction and realistic simulation of…

Human-Computer Interaction · Computer Science 2026-04-13 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Traditional single-modality sensing faces limitations in accuracy and capability, and its decoupled implementation with communication systems increases latency in bandwidth-constrained environments. Additionally, single-task-oriented…

Machine Learning · Computer Science 2025-03-13 Yubo Peng , Luping Xiang , Kun Yang , Feibo Jiang , Kezhi Wang , Dapeng Oliver Wu

Developing effective multimodal data fusion strategies has become increasingly essential for improving the predictive power of statistical machine learning methods across a wide range of applications, from autonomous driving to medical…

Machine Learning · Computer Science 2025-07-29 Ziyi Liang , Annie Qu , Babak Shahbaba

Agent-based social simulation provides a valuable methodology for predicting social information diffusion, yet existing approaches face two primary limitations. Traditional agent models often rely on rigid behavioral rules and lack semantic…

Computers and Society · Computer Science 2025-10-21 Xinyi Li , Zhiqiang Guo , Qinglang Guo , Hao Jin , Weizhi Ma , Min Zhang

Large Language Model (LLM)-enhanced agents become increasingly prevalent in Human-AI communication, offering vast potential from entertainment to professional domains. However, current multi-modal dialogue systems overlook the acoustic…

Computation and Language · Computer Science 2024-06-19 Haoqiu Yan , Yongxin Zhu , Kai Zheng , Bing Liu , Haoyu Cao , Deqiang Jiang , Linli Xu