English
Related papers

Related papers: A Unified Multi-Agent Framework for Universal Mult…

200 papers

Recent advances in multimodal large language models (LLMs) have led to significant progress in understanding, generation, and retrieval tasks. However, current solutions often treat these tasks in isolation or require training LLMs from…

Machine Learning · Computer Science 2025-09-24 Teng Xiao , Zuchao Li , Lefei Zhang

Multi-agent interactions between Large Language Model (LLM) agents have shown major improvements on diverse reasoning tasks. However, these involve long generations from multiple models across several rounds, making them expensive.…

Computation and Language · Computer Science 2024-06-11 Justin Chih-Yao Chen , Swarnadeep Saha , Elias Stengel-Eskin , Mohit Bansal

Despite recent advances in multimodal large language models (MLLMs), their ability to understand and interact with music remains limited. Music understanding requires grounded reasoning over symbolic scores and expressive performance audio,…

Multimedia · Computer Science 2026-01-21 Qihao Zhao , Yunqi Cao , Yangyu Huang , Hui Yi Leong , Fan Zhang , Kim-Hui Yap , Wei Hu

Recent advances in large language models (LLMs) have demonstrated the power of reasoning through self-generated chains of thought. Multiple reasoning agents can collaborate to raise joint reasoning quality above individual outcomes.…

Artificial Intelligence · Computer Science 2025-05-19 Chan-Jan Hsu , Davide Buffelli , Jamie McGowan , Feng-Ting Liao , Yi-Chang Chen , Sattar Vakili , Da-shan Shiu

This paper proposes a novel framework utilizing multi-modal large language models (MLLMs) for referring video object segmentation (RefVOS). Previous MLLM-based methods commonly struggle with the dilemma between "Ref" and "VOS": they either…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Lang Lin , Xueyang Yu , Ziqi Pang , Yu-Xiong Wang

Effective knowledge management is critical for preserving institutional expertise and improving the efficiency of workforce training in state transportation agencies. Traditional approaches, such as static documentation, classroom-based…

Computation and Language · Computer Science 2026-03-05 Divija Amaram , Lu Gao , Gowtham Reddy Gudla , Tejaswini Sanjay Katale

Although large language model (LLM) based multi-agent systems (MAS) show their capability to solve complex tasks and achieve higher performance over single agent systems, they lead to huge computational overheads because of heavy…

Multiagent Systems · Computer Science 2026-05-29 Ziyang Ma , Dingyi Zhang , Sichu Liang , Jiajia Chu , Pengfei Xia , Hui Zang , Deyu Zhou

Reasoning over tabular data is a crucial capability for tasks like question answering and fact verification, as it requires models to comprehend both free-form questions and semi-structured tables. However, while methods like…

Artificial Intelligence · Computer Science 2026-04-14 Qixian Huang , Hongqiang Lin , Tong Fu , Yingsen Wang , Zhenghui Fu , Qirui Wang , Yiding Sun , Dongxu Zhang

Enhancing fuel efficiency in public transportation requires the integration of complex multimodal data into interpretable, decision-relevant insights. However, traditional analytics and visualization methods often yield fragmented outputs…

Artificial Intelligence · Computer Science 2025-11-18 Zhipeng Ma , Ali Rida Bahja , Andreas Burgdorf , André Pomp , Tobias Meisen , Bo Nørregaard Jørgensen , Zheng Grace Ma

In this paper, we propose XGC-AVis, a multi-agent framework that enhances the audio-video temporal alignment capabilities of multimodal large models (MLLMs) and improves the efficiency of retrieving key video segments through 4 stages:…

Multimedia · Computer Science 2025-09-30 Yuqin Cao , Xiongkuo Min , Yixuan Gao , Wei Sun , Zicheng Zhang , Jinliang Han , Guangtao Zhai

Unified multimodal models have recently shown remarkable gains in both capability and versatility, yet most leading systems are still trained from scratch and require substantial computational resources. In this paper, we show that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeyu Wang , Zilong Chen , Chenhui Gou , Feng Li , Chaorui Deng , Deyao Zhu , Kunchang Li , Weihao Yu , Haoqin Tu , Haoqi Fan , Cihang Xie

Integrating image generation and understanding into a single framework has become a pivotal goal in the multimodal domain. However, how understanding can effectively assist generation has not been fully explored. Unlike previous works that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Yanbing Zeng , Jia Wang , Hanghang Ma , Junqiang Wu , Jie Zhu , Xiaoming Wei , Jie Hu

Unifying visual understanding and generation within a single multimodal framework remains a significant challenge, as the two inherently heterogeneous tasks require representations at different levels of granularity. Current approaches that…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Size Wu , Wenwei Zhang , Lumin Xu , Sheng Jin , Zhonghua Wu , Qingyi Tao , Wentao Liu , Wei Li , Chen Change Loy

With recent breakthroughs in large language models (LLMs) for reasoning, planning, and complex task generation, artificial intelligence systems are transitioning from isolated single-agent architectures to multi-agent systems with…

Artificial Intelligence · Computer Science 2026-02-17 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

Audio agents extend large audio-language models (LALMs) by decomposing audio questions into tool calls, intermediate evidence, and iterative reasoning steps. However, as LALMs become stronger, the key challenge shifts from enabling tool use…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-28 Yucheng Wang , Jing Peng , Hanqi Li , Chenghao Wang , Wenming Tu , Yu Xi , Zhaokai Sun , Kai Yu , Shuai Wang

We propose GAM-Agent, a game-theoretic multi-agent framework for enhancing vision-language reasoning. Unlike prior single-agent or monolithic models, GAM-Agent formulates the reasoning process as a non-zero-sum game between base…

Artificial Intelligence · Computer Science 2025-05-30 Jusheng Zhang , Yijia Fan , Wenjun Lin , Ruiqi Chen , Haoyi Jiang , Wenhao Chai , Jian Wang , Keze Wang

Retrieval-Augmented Generation (RAG) has emerged as the dominant paradigm for grounding large language model outputs in verifiable evidence. However, as modern AI agents transition from static knowledge bases to continuous multimodal…

Machine Learning · Computer Science 2025-11-05 Rohan Wandre , Yash Gajewar , Namrata Patel , Vivek Dhalkari

Foundation models are becoming valuable tools in medicine. Yet despite their promise, the best way to leverage Large Language Models (LLMs) in complex medical tasks remains an open question. We introduce a novel multi-agent framework, named…

Computation and Language · Computer Science 2024-10-31 Yubin Kim , Chanwoo Park , Hyewon Jeong , Yik Siu Chan , Xuhai Xu , Daniel McDuff , Hyeonhoon Lee , Marzyeh Ghassemi , Cynthia Breazeal , Hae Won Park

Large Language Models (LLMs) are increasingly deployed as reasoning systems, where reasoning paradigms - such as Chain-of-Thought (CoT) and multi-agent systems (MAS) - play a critical role, yet their relative effectiveness and cost-accuracy…

Machine Learning · Computer Science 2026-01-21 Yapeng Li , Jiakuo Yu , Zhixin Liu , Xinnan Liu , Jing Yu , Songze Li , Tonghua Su