English
Related papers

Related papers: M^3-Bench: Multi-Modal, Multi-Hop, Multi-Threaded …

200 papers

Large Language Models (LLMs) have demonstrated significant potential in decision-making and reasoning, particularly when integrated with various tools to effectively solve complex problems. However, existing benchmarks for evaluating LLMs'…

Multimodal Large Language Models (MLLMs) have shown promise in single-agent vision tasks, yet benchmarks for evaluating multi-agent collaborative perception remain scarce. This gap is critical, as multi-drone systems provide enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jirong Zha , Yuxuan Fan , Tianyu Zhang , Geng Chen , Yingfeng Chen , Chen Gao , Xinlei Chen

Large Language Models (LLMs) with tool-calling capabilities have demonstrated remarkable potential in executing complex tasks through external tool integration. The Model Context Protocol (MCP) has emerged as a standardized framework for…

Software Engineering · Computer Science 2026-03-24 Sarat Mudunuri , Jian Wan , Ally Qin , Srinivasan Manoharan

Multimodal Large Language Models (MLLMs), are recent advancement of Vision-Language Models (VLMs) that have driven major advances in video understanding. However, their vulnerability to adversarial tampering and manipulations remains…

Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models (LLMs). However, progress has been hindered by a lack of reliable evaluation…

Computation and Language · Computer Science 2025-05-21 Junjie Ye , Zhengyin Du , Xuesong Yao , Weijian Lin , Yufei Xu , Zehui Chen , Zaiyuan Wang , Sining Zhu , Zhiheng Xi , Siyu Yuan , Tao Gui , Qi Zhang , Xuanjing Huang , Jiecao Chen

Recent advancements in Large Language Models (LLMs) and the introduction of the Model Context Protocol (MCP) have significantly expanded LLM agents' capability to interact dynamically with external tools and APIs. However, existing tool…

Computation and Language · Computer Science 2025-05-13 Elias Lumer , Anmol Gulati , Vamse Kumar Subbiah , Pradeep Honaganahalli Basavaraju , James A. Burke

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Recently, 3D understanding has become popular to facilitate autonomous agents to perform further decisionmaking. However, existing 3D datasets and methods are often limited to specific tasks. On the other hand, recent progress in Large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mingsheng Li , Xin Chen , Chi Zhang , Sijin Chen , Hongyuan Zhu , Fukun Yin , Gang Yu , Tao Chen

Large Language Models (LLMs) increasingly rely on external tools to perform complex, realistic tasks, yet their ability to utilize the rapidly expanding Model Contextual Protocol (MCP) ecosystem remains limited. Existing MCP research covers…

Artificial Intelligence · Computer Science 2026-04-17 Wenhao Wang , Peizhi Niu , Zhao Xu , Zhaoyu Chen , Jian Du , Yaxin Du , Xianghe Pang , Keduan Huang , Yanfeng Wang , Qiang Yan , Siheng Chen

Current LLM agents are proficient at calling isolated APIs but struggle with the "last mile" of commercial software automation. In real-world scenarios, tools are not independent; they are atomic, interdependent, and prone to environmental…

Artificial Intelligence · Computer Science 2026-05-21 Yuanyang Li , Xue Yang , Longyue Wang , Weihua Luo , Hongyang Chen

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chaoyou Fu , Peixian Chen , Yunhang Shen , Yulei Qin , Mengdan Zhang , Xu Lin , Jinrui Yang , Xiawu Zheng , Ke Li , Xing Sun , Yunsheng Wu , Rongrong Ji , Caifeng Shan , Ran He

Deep Research Agents (DRAs) generate citation-rich reports via multi-step search and synthesis, yet existing benchmarks mainly target text-only settings or short-form multimodal QA, missing end-to-end multimodal evidence use. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Peizhou Huang , Zixuan Zhong , Zhongwei Wan , Donghao Zhou , Samiul Alam , Xin Wang , Zexin Li , Zhihao Dou , Li Zhu , Jing Xiong , Chaofan Tao , Yan Xu , Dimitrios Dimitriadis , Tuo Zhang , Mi Zhang

Spatial cognition is fundamental to real-world multimodal intelligence, allowing models to effectively interact with the physical environment. While multimodal large language models (MLLMs) have made significant strides, existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-08 Peiran Xu , Sudong Wang , Yao Zhu , Jianing Li , Gege Qi , Yunjian Zhang

The Model Context Protocol (MCP) enables large language models (LLMs) to access external resources on demand. While commonly assumed to enhance performance, how LLMs actually leverage this capability remains poorly understood. We introduce…

Artificial Intelligence · Computer Science 2025-08-19 Wei Song , Haonan Zhong , Ziqi Ding , Jingling Xue , Yuekang Li

The Model Context Protocol (MCP) standardizes how AI agents discover and invoke external tools, with over 10,000 active servers and 97 million monthly SDK downloads as of early 2026. Yet MCP does not yet standardize how agents safely…

Software Engineering · Computer Science 2026-04-16 Vasundra Srinivasan

Multimodal large language models (MLLMs) are increasingly deployed in real-world, agentic settings where outputs must not only be correct, but also conform to predefined data schemas. Despite recent progress in structured generation in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Di Feng , Kaixin Ma , Feng Nan , Haofeng Chen , Bohan Zhai , David Griffiths , Mingfei Gao , Zhe Gan , Eshan Verma , Yinfei Yang , Zhifeng Chen , Afshin Dehghan

The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content. While prior studies have…

Artificial Intelligence · Computer Science 2024-09-30 Lin Li , Guikun Chen , Hanrong Shi , Jun Xiao , Long Chen

Multimodal Large Language Models (MLLMs) have demonstrated significant potential to advance a broad range of domains. However, current benchmarks for evaluating MLLMs primarily emphasize general knowledge and vertical step-by-step reasoning…

With the recent advancements in reasoning capabilities, tool calling using MCP servers and Audio Language Models (ALMs), development and integration of multi-modal agents (with voice and text support) has come to the industry forefront.…

Sound · Computer Science 2026-03-03 Anupam Purwar , Aditya Choudhary

Multimodal Large Language Models are primarily trained and evaluated on aligned image-text pairs, which leaves their ability to detect and resolve real-world inconsistencies largely unexplored. In open-domain applications visual and textual…